-- Logs begin at Tue 2022-09-06 00:32:30 UTC, end at Tue 2022-09-06 01:35:49 UTC. -- Sep 06 00:58:10.159128 dv-cinder-847732-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 06 00:58:10.168578 dv-cinder-847732-2-smb devstack@keystone.service[81729]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 06 00:58:10.171147 dv-cinder-847732-2-smb devstack@keystone.service[81729]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 00:58:10 2022] *** Sep 06 00:58:10.171281 dv-cinder-847732-2-smb devstack@keystone.service[81729]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 00:58:10.171385 dv-cinder-847732-2-smb devstack@keystone.service[81729]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 00:58:10.171482 dv-cinder-847732-2-smb devstack@keystone.service[81729]: nodename: dv-cinder-847732-2-smb Sep 06 00:58:10.171584 dv-cinder-847732-2-smb devstack@keystone.service[81729]: machine: x86_64 Sep 06 00:58:10.171678 dv-cinder-847732-2-smb devstack@keystone.service[81729]: clock source: unix Sep 06 00:58:10.171773 dv-cinder-847732-2-smb devstack@keystone.service[81729]: pcre jit disabled Sep 06 00:58:10.171868 dv-cinder-847732-2-smb devstack@keystone.service[81729]: detected number of CPU cores: 4 Sep 06 00:58:10.171950 dv-cinder-847732-2-smb devstack@keystone.service[81729]: current working directory: / Sep 06 00:58:10.172046 dv-cinder-847732-2-smb devstack@keystone.service[81729]: detected binary path: /usr/bin/uwsgi-core Sep 06 00:58:10.172179 dv-cinder-847732-2-smb devstack@keystone.service[81729]: your processes number limit is 47680 Sep 06 00:58:10.172179 dv-cinder-847732-2-smb devstack@keystone.service[81729]: your memory page size is 4096 bytes Sep 06 00:58:10.172179 dv-cinder-847732-2-smb devstack@keystone.service[81729]: detected max file descriptor number: 2048 Sep 06 00:58:10.172179 dv-cinder-847732-2-smb devstack@keystone.service[81729]: lock engine: pthread robust mutexes Sep 06 00:58:10.172577 dv-cinder-847732-2-smb devstack@keystone.service[81729]: thunder lock: enabled Sep 06 00:58:10.172577 dv-cinder-847732-2-smb devstack@keystone.service[81729]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 06 00:58:10.172685 dv-cinder-847732-2-smb devstack@keystone.service[81729]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 00:58:10.211380 dv-cinder-847732-2-smb devstack@keystone.service[81729]: Python main interpreter initialized at 0x55fd83c3a9c0 Sep 06 00:58:10.211380 dv-cinder-847732-2-smb devstack@keystone.service[81729]: python threads support enabled Sep 06 00:58:10.211380 dv-cinder-847732-2-smb devstack@keystone.service[81729]: your server socket listen backlog is limited to 100 connections Sep 06 00:58:10.211380 dv-cinder-847732-2-smb devstack@keystone.service[81729]: your mercy for graceful operations on workers is 90 seconds Sep 06 00:58:10.211727 dv-cinder-847732-2-smb devstack@keystone.service[81729]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 00:58:10.211802 dv-cinder-847732-2-smb devstack@keystone.service[81729]: *** Operational MODE: preforking *** Sep 06 00:58:10.212062 dv-cinder-847732-2-smb devstack@keystone.service[81729]: *** uWSGI is running in multiple interpreter mode *** Sep 06 00:58:10.212062 dv-cinder-847732-2-smb devstack@keystone.service[81729]: spawned uWSGI master process (pid: 81729) Sep 06 00:58:10.212269 dv-cinder-847732-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 06 00:58:10.213292 dv-cinder-847732-2-smb devstack@keystone.service[81729]: spawned uWSGI worker 1 (pid: 81741, cores: 1) Sep 06 00:58:10.213292 dv-cinder-847732-2-smb devstack@keystone.service[81729]: spawned uWSGI worker 2 (pid: 81742, cores: 1) Sep 06 00:58:10.213292 dv-cinder-847732-2-smb devstack@keystone.service[81729]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 00:58:14.465016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 00:58:14.465016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: from cryptography.utils import int_from_bytes Sep 06 00:58:14.465812 dv-cinder-847732-2-smb devstack@keystone.service[81741]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 00:58:14.465812 dv-cinder-847732-2-smb devstack@keystone.service[81741]: from cryptography.utils import int_from_bytes Sep 06 00:58:14.467023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 00:58:14.467023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: from cryptography.utils import int_from_bytes Sep 06 00:58:14.467512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 00:58:14.467512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: from cryptography.utils import int_from_bytes Sep 06 00:58:14.514826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 00:58:14.515031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 00:58:14.515187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] command line args: [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 00:58:14.515457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 00:58:14.515586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ================================================================================ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 00:58:14.515859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] admin_token = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.516100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] config_dir = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.516260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.516493 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] config_source = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.516622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] debug = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.516849 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.517229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.517386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.517670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.517912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.518141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.518264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_config_append = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.518474 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.518596 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 00:58:14.518666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_dir = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.518731 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 00:58:14.518796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_file = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.518867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] command line args: [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 00:58:14.519027 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.519107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 00:58:14.519235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.519321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ================================================================================ {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 00:58:14.519488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.519586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] admin_token = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.519725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.519816 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] config_dir = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.519878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.519944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.520127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.520277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] config_source = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.520277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] debug = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.520451 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.520529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.520635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.520709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.520774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.520843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.520974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.521079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.521202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.521297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.521443 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.521542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.521660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.521749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] log_config_append = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.521829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.521902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.522021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] log_dir = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.522153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.522245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] log_file = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.522406 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.522623 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.522725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.522793 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] publish_errors = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.522884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.523003 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.523126 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.523240 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.523321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.523434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.523551 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.523667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.523755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.523866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.523950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.524090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] standard_threads = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.524207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.524350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.524428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.524572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.524652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.524746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.524830 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.524911 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] use_journal = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.525029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.525115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] use_json = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.525230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] use_stderr = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.525315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.525394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] use_syslog = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.525531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.525609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.525849 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.526019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.526109 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.526193 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] publish_errors = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.526328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.526411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.526552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.526633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.526793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.526870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.527024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.527108 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.527243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.527322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.527472 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] standard_threads = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.527552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.527706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.527783 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.527947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.528024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.528119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.528195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.528318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] use_journal = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.528434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.528528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] use_json = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.528644 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] use_stderr = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.528722 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.528819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] use_syslog = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.528897 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.529047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 00:58:14.529133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.529304 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.529381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.529543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.529620 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.529803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.529892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.530041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.530131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.530279 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.530401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.530511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.530603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.530756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.530833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.530992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.531070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.531237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.531326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.531480 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.531557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.531708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.531790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.531934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.532090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.532166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.532237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.532400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.532479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.532700 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.532903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.532989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.533160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.533389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.533507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.533633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.533754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.533877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.534017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.534099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.534278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.534368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.534527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.534612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.534766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.534845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.534995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.535083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.535223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.535301 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.535452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.535530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.535688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.535839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.535918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.535988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.536123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.536203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.536389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.536487 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.536617 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.536695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.536853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.536931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.537078 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.537167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.537308 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.537385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.537539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.537617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.537783 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.537940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.538016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.538087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.538231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.538309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.538467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.538899 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.539046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.539129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.539281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.539359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.539515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.539602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.539743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.539819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.539972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.540048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.540202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.540302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.540457 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.540545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.540688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.540776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.540935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.541020 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.541168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.541254 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.541394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.541502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.541599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.541706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.541832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.541936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.542064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.542164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.542311 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.542397 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.542541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.542619 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.542777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.542866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.543009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.543088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.543240 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.543320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.543471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.543553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.543703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.543779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.543934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.544012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.544166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.544254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.544423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.544503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.544654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.544774 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.544884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.544971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.545114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.545191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.545344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.545423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.545574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.545655 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.545805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.545883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.546036 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.546118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.546292 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.546371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.546530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.546653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.546771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.546849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.547011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.547138 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.547243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.547326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.547475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.547553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.547704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.547781 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.547936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.548014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.548197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.548356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.548484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.548667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.549002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.549080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.549261 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.549349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.549507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.549598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.549746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.549823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.549969 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.550044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.550212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.550290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.550442 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.550528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.550676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.550763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.550915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.550995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.551165 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.551243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.551394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.external = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.551481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.551623 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.551702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.551869 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.551946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.552109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.552199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.552369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.password = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.552453 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.552599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.token = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.552676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.552832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.552922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.553064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.553141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.553295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.553372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.553521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.553628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.553750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.553838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.553988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.554076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.554213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.554299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.554442 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.554529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.554675 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.554753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.554915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.554993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.555151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.555239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.555389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.555467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.555628 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.555706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.555856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.555943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.556096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.556176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.external = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.556345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.556436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.556587 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.556674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.556834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.556913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.557084 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.password = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.557162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.557317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.token = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.557408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.557558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.557638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.557797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.557882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.558045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.558132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.558274 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.558356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.558506 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.558586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.558751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.558838 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.558979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.559058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.559206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.559284 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.559448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.559538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.559682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.559761 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.559927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.560004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.560156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.560242 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.560423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.560503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.560661 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.560740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.560901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.560991 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.561134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.561212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.561374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.561455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.561614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.561693 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.561844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.561923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.562074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.562153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.562316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.562396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.562543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.562621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.562774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.562853 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.563018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.563098 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.563261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.563340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.563487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.563565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.563713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.563816 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.564149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.564458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.564596 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.564709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.564862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.564945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.565111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.565190 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.565375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.565454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.565620 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.565701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.565881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.565962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.566128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.566241 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.566336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.566411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.566571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.566652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.566797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.566875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.567028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.567108 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.567264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.567342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.567501 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.567579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.567745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.567825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.567973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.568052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.568217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.568321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.568493 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.568574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.568732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.568808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.568967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.569044 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.569200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.569280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.569429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.569506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.569663 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.569743 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.569890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.569969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.570126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.570204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.570359 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.570437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.570596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.570676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.570828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.570906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.571060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.571145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.571309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.571446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.571575 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.571700 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.571823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.571948 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.572081 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.572207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.572378 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.572500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.572625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.572770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.572903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.573027 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.573152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.573277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.573407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.573538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.573670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.573795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.573919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.574043 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.574165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.574297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.574432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.574555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.574680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.574804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.574929 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.575060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.575184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.575306 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.575431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.575553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.575676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.575807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.575931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.576053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.576184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.576327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.576408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.576491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.576566 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.576638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.576710 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.576781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.576853 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.576935 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.577009 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.577080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.577151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.577228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.577307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.577385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.577528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.577613 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.577772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.577855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.578006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.578099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.578239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.578322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.578470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.578554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.578738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.578875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.578957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.579030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.579213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.579337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.579472 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.579571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.579742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.579963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.580204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.580382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.580468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.580561 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.580638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.580754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.580870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.580990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.581113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.581230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.581352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.581484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.581581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.581691 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.581816 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.581927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.582052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.582176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.582296 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.582428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.582539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.582675 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.582776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.582920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.583019 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.583167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.583252 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.583397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.583476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.583642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.583720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.583878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.583956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.584114 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.584203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.584370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.584455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] role.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.584608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.584687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] role.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.584841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.584922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.585086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.585165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.585319 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.585403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.585561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.585640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.585796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.585874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.586037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.586124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.586272 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.586351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.586506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.586585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.586743 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.586900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.586977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.587039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.587216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.587296 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.587447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.587536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.587684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.587770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.587928 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.588007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.588177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.588334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.588446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.588577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.588684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.588825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.588934 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.589071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.589183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.589313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.589418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.589557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.589663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.589788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.589900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.590038 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.590133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.590287 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.590370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] role.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.590518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.590600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] role.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.590746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.590825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.590973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.591052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.591199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.591279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.591445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.591524 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.591695 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.591773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.591937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.592017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.592173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.592252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.592429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.592510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.592661 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.592742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.592893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.592972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.593126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.593205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.593370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.593451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.593601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.593680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.593846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.593960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.594210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.594288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.594446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.594564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.594687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.594775 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.594928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.595009 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.595203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.595430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.595666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.595755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.595896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.595975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.596136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.596214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.596428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.596523 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.596658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.596746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.596898 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.596978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.597138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.597280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.597358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.597440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.597592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.597672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.597844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.597924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.598083 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.598163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.598320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.598399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.598556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.598635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.598789 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.598869 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.599018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.599100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.599246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.599324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] token.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.599481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.599561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.599710 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.599844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.599948 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.600028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.600178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.600259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.600445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.600526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.600675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.600754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.600917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.600997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.601142 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.601220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.601375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.601454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.601606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.601686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.601758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 00:58:14.601829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.602063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.602308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.602586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.602817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.603060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.603324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.603581 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.connection = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.603824 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.604070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.604324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.604570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.604806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.605041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.605275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.605508 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.605752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.605988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.606231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.606465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.606712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.606948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.607190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.607421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.607659 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.607898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 00:58:14.608065 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 00:58:14.630795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.631020 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.631274 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.633930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.634166 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.634389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.639585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.643322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.667917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.668115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.670040 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.670277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.721503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.722401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.769912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.770102 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.771509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.771746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.929182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.929390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.929593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.929767 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.929931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.930005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.930082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.930277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.930400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.930549 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.930682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.930806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.953396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.953530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.953600 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.953684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.953844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.953969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.954039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.954101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.954233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.954326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.954513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.954643 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.954712 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.955231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.965826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.966168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.978689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.978857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.979162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.979299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.979371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.979455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.979575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.979665 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.979779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.979868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.980018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.980151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.980220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.980487 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 00:58:14.997087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:14.997342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 00:58:14.997629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:14.997752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:14.997822 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 00:58:14.997906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 00:58:14.998173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:14.998296 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:14.998365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 00:58:14.998427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:14.998620 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:14.998745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:14.998888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:14.999013 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:14.999120 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:14.999391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.008502 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.008786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.009050 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.009326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.009684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.009965 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.010235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.010517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.016233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.018022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.019175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.019457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.019738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.020024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.020333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.020572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.020835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.020928 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.021077 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.021239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.021329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.021465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.021608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.021739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.021877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.022017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.022283 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.022547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.022806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.023075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.023345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.023612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.044855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.046312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.046594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.046998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.049012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.049296 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.051452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.051736 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.052022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.053954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.054239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.054523 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.058293 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.058571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.060878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.061164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.064396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.064764 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.065058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.065344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.065626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.065902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.066165 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.066431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.067528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.067829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.068121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.068437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.068716 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.068998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.069259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.069532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.081908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.082191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.085467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.085747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.086012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.089243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.089512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.089632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.092747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.093043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.093678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.096996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.097750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.100343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.100648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.100833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.100956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.101228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.101502 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.101792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.103971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.104266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.104579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.104870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.105144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.105422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.117425 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.117712 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.117978 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.118234 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.121516 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.121806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.122073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.122334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.124983 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.126602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.128097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.128391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.129817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.130994 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.131276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.131397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.131526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.131854 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.132349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.132910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.133184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.135851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.136145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.136450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.136715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.137142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.143312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.143593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.143873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.144152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.144557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.144837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.145097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.148810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.149101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.149376 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.149652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.150015 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.150294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.150570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.160603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.163476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.166688 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.166907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.168334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.169654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.169888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.170158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.170560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.172544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.174684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.176156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.176458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.176857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.177427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.178877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.181766 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.182159 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.182440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.182721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.183235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.184847 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.187701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.188101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.188413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.188698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.194980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.195272 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.195560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.197090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.197353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.197664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.202479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.202767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.203049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.203323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.203608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.203859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.204157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.204492 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.204618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 00:58:15.204774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.205051 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.205286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.205431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.205521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.205638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.205793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.205881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.206094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.206221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.206357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.206670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.206933 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.207210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.207478 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.207766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.208027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.208313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.208581 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 00:58:15.239842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fd83c3a9c0 pid: 81741 (default app) Sep 06 00:58:15.243187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715bf93-08d0-40f9-89e4-966af1fbce2f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:15.243334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fd83c3a9c0 pid: 81742 (default app) Sep 06 00:58:15.243424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715bf93-08d0-40f9-89e4-966af1fbce2f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:15.243720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715bf93-08d0-40f9-89e4-966af1fbce2f None None] PATH_INFO: `/v3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:15.247920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Tue Sep 6 00:58:15 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:21.876879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2b2c-a431-40e9-b844-9b1f22885c52 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:21.877510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2b2c-a431-40e9-b844-9b1f22885c52 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:21.877510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2b2c-a431-40e9-b844-9b1f22885c52 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:21.881926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:21.888360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb00a0-7d6e-438f-885a-3dc312cbff35 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:21.889271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb00a0-7d6e-438f-885a-3dc312cbff35 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:21.889271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb00a0-7d6e-438f-885a-3dc312cbff35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:21.969958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: INFO dbcounter [None req-6cdb00a0-7d6e-438f-885a-3dc312cbff35 None None] Registered counter for database keystone Sep 06 00:58:21.990542 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG oslo_db.sqlalchemy.engines [None req-6cdb00a0-7d6e-438f-885a-3dc312cbff35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 00:58:22.001979 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writer thread running {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 00:58:22.183410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG passlib.handlers.bcrypt [None req-6cdb00a0-7d6e-438f-885a-3dc312cbff35 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81741) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 00:58:22.183701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG passlib.handlers.bcrypt [None req-6cdb00a0-7d6e-438f-885a-3dc312cbff35 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81741) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 00:58:22.242759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6cdb00a0-7d6e-438f-885a-3dc312cbff35 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:22.244418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6cdb00a0-7d6e-438f-885a-3dc312cbff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:22.379696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 06 00:58:22.930610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d2b2c-a431-40e9-b844-9b1f22885c52 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:23.011447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: INFO dbcounter [None req-f73d2b2c-a431-40e9-b844-9b1f22885c52 None None] Registered counter for database keystone Sep 06 00:58:23.036937 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG oslo_db.sqlalchemy.engines [None req-f73d2b2c-a431-40e9-b844-9b1f22885c52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 00:58:23.044887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writer thread running {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 00:58:23.165741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d2b2c-a431-40e9-b844-9b1f22885c52 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:23.171241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ab2cd-4f04-414b-a039-19cd2ecd8798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:23.171880 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ab2cd-4f04-414b-a039-19cd2ecd8798 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:23.172156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ab2cd-4f04-414b-a039-19cd2ecd8798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:23.172471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ab2cd-4f04-414b-a039-19cd2ecd8798 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:23.182364 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ab2cd-4f04-414b-a039-19cd2ecd8798 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:23.234335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: WARNING keystone.common.rbac_enforcer.enforcer [None req-464ab2cd-4f04-414b-a039-19cd2ecd8798 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 00:58:23.234672 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ab2cd-4f04-414b-a039-19cd2ecd8798 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:23.245638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Sep 6 00:58:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 00:58:23.253127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb00a0-7d6e-438f-885a-3dc312cbff35 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:23.276978 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb00a0-7d6e-438f-885a-3dc312cbff35 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:23.285786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5e723-4437-4205-a844-bd2933e89207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:23.286902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5e723-4437-4205-a844-bd2933e89207 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:23.287176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5e723-4437-4205-a844-bd2933e89207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:23.287436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5e723-4437-4205-a844-bd2933e89207 admin admin] PATH_INFO: `/v3/projects/13e2411eaf2541e38a8d727a7403f2f2` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:23.289615 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5e723-4437-4205-a844-bd2933e89207 admin admin] RBAC: Authorizing `identity:get_project(project_id=13e2411eaf2541e38a8d727a7403f2f2)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:23.342300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9ba5e723-4437-4205-a844-bd2933e89207 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 00:58:23.342634 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5e723-4437-4205-a844-bd2933e89207 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:23.347614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Sep 6 00:58:23 2022] GET /identity/v3/projects/13e2411eaf2541e38a8d727a7403f2f2 => generated 344 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:25.221810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249087-b149-4d4e-9911-b9f291e2ff9b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:25.222378 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249087-b149-4d4e-9911-b9f291e2ff9b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:25.222378 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249087-b149-4d4e-9911-b9f291e2ff9b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:25.226526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 00:58:25.233404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90fb75-8232-4f35-ac2f-5577cec26b17 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:25.234108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90fb75-8232-4f35-ac2f-5577cec26b17 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:25.234267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90fb75-8232-4f35-ac2f-5577cec26b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:25.256876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6d90fb75-8232-4f35-ac2f-5577cec26b17 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:25.258419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6d90fb75-8232-4f35-ac2f-5577cec26b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:25.266636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 06 00:58:25.529959 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01249087-b149-4d4e-9911-b9f291e2ff9b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:25.544429 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01249087-b149-4d4e-9911-b9f291e2ff9b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:25.549214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28f1e1-7756-4607-ab0d-4701095ba11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:25.549824 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28f1e1-7756-4607-ab0d-4701095ba11b admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:25.550086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28f1e1-7756-4607-ab0d-4701095ba11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:25.550361 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28f1e1-7756-4607-ab0d-4701095ba11b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:25.558630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28f1e1-7756-4607-ab0d-4701095ba11b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:25.560506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28f1e1-7756-4607-ab0d-4701095ba11b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:25.569562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Sep 6 00:58:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 00:58:25.575312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90fb75-8232-4f35-ac2f-5577cec26b17 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:25.587342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90fb75-8232-4f35-ac2f-5577cec26b17 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:25.596792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4beaee-d195-4ece-8f18-c96fbe52cf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:25.597431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4beaee-d195-4ece-8f18-c96fbe52cf0d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:25.597707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4beaee-d195-4ece-8f18-c96fbe52cf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:25.597971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4beaee-d195-4ece-8f18-c96fbe52cf0d admin admin] PATH_INFO: `/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:25.599465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4beaee-d195-4ece-8f18-c96fbe52cf0d admin admin] RBAC: Authorizing `identity:get_user(user_id=c84cb4aedf5f40eeb73ee0c384202e9a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:25.601405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4beaee-d195-4ece-8f18-c96fbe52cf0d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:25.602907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Tue Sep 6 00:58:25 2022] GET /identity/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:27.581995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f940faa-7be2-4d82-b51e-67fd4f1f2b00 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:27.582574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f940faa-7be2-4d82-b51e-67fd4f1f2b00 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:27.582574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f940faa-7be2-4d82-b51e-67fd4f1f2b00 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:27.583846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 00:58:27.588270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd67b19-7ce6-4eec-b9e4-790a105eeedc None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:27.588727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd67b19-7ce6-4eec-b9e4-790a105eeedc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:27.588963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd67b19-7ce6-4eec-b9e4-790a105eeedc None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:27.590907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a224bc2-87d4-421c-a5bd-f04db6ee5f97 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:27.591040 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:27.591296 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a224bc2-87d4-421c-a5bd-f04db6ee5f97 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:27.591711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a224bc2-87d4-421c-a5bd-f04db6ee5f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:27.599008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a2ee2-293c-4e84-977e-9a83a5c3056b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:27.599403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a2ee2-293c-4e84-977e-9a83a5c3056b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:27.599829 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a2ee2-293c-4e84-977e-9a83a5c3056b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:27.622534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-073a2ee2-293c-4e84-977e-9a83a5c3056b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:27.623723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-073a2ee2-293c-4e84-977e-9a83a5c3056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:27.642498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG passlib.handlers.bcrypt [None req-8a224bc2-87d4-421c-a5bd-f04db6ee5f97 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81742) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 00:58:27.642942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG passlib.handlers.bcrypt [None req-8a224bc2-87d4-421c-a5bd-f04db6ee5f97 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81742) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 00:58:27.691783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8a224bc2-87d4-421c-a5bd-f04db6ee5f97 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:27.693383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8a224bc2-87d4-421c-a5bd-f04db6ee5f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:27.705070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 7/12] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:58:27.798734 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 6/13] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:27.965366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a2ee2-293c-4e84-977e-9a83a5c3056b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:27.991210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:28.068652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a224bc2-87d4-421c-a5bd-f04db6ee5f97 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:28.072652 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a2ee2-293c-4e84-977e-9a83a5c3056b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:28.107224 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc080-91b0-40f8-ae29-3748bd9c7287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:28.107869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc080-91b0-40f8-ae29-3748bd9c7287 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:28.108153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc080-91b0-40f8-ae29-3748bd9c7287 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:28.108478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc080-91b0-40f8-ae29-3748bd9c7287 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:28.120201 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dc080-91b0-40f8-ae29-3748bd9c7287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f09dc080-91b0-40f8-ae29-3748bd9c7287 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:28.129168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:28.130149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:58:28.130961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 8/14] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:58:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:28.136136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc080-91b0-40f8-ae29-3748bd9c7287 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:28.172604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a224bc2-87d4-421c-a5bd-f04db6ee5f97 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:28.175544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:28.213343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09d509-e312-4330-bb22-9b135b0d13e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:28.214223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09d509-e312-4330-bb22-9b135b0d13e6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:28.214506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09d509-e312-4330-bb22-9b135b0d13e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:28.214786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09d509-e312-4330-bb22-9b135b0d13e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:28.218190 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:28.236591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc080-91b0-40f8-ae29-3748bd9c7287 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:28.271266 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbb50c-11bf-41c3-b490-2e2e674a85a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:28.271884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbb50c-11bf-41c3-b490-2e2e674a85a0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:28.272164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbb50c-11bf-41c3-b490-2e2e674a85a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:28.272459 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbb50c-11bf-41c3-b490-2e2e674a85a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:28.273133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbb50c-11bf-41c3-b490-2e2e674a85a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:28.273441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbb50c-11bf-41c3-b490-2e2e674a85a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:28.274894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbb50c-11bf-41c3-b490-2e2e674a85a0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:28.281415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09d509-e312-4330-bb22-9b135b0d13e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:28.282958 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09d509-e312-4330-bb22-9b135b0d13e6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:28.287816 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 9/15] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:28.294100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbb50c-11bf-41c3-b490-2e2e674a85a0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:28.383540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 7/16] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 00:58:28.389222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09d509-e312-4330-bb22-9b135b0d13e6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:28.391956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:28.393608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbb50c-11bf-41c3-b490-2e2e674a85a0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:28.433770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db975a-4bf9-4a3c-8a42-f9ff3000a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:28.434706 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db975a-4bf9-4a3c-8a42-f9ff3000a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:28.435125 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db975a-4bf9-4a3c-8a42-f9ff3000a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:28.435518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db975a-4bf9-4a3c-8a42-f9ff3000a1a5 None admin] PATH_INFO: `/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:28.437212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db975a-4bf9-4a3c-8a42-f9ff3000a1a5 None admin] RBAC: Authorizing `identity:get_user(user_id=c84cb4aedf5f40eeb73ee0c384202e9a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:28.439731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db975a-4bf9-4a3c-8a42-f9ff3000a1a5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:28.442477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 10/17] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:28 2022] GET /identity/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:58:28.450058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db975a-4bf9-4a3c-8a42-f9ff3000a1a5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:28.467952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:28.496980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09d509-e312-4330-bb22-9b135b0d13e6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:28.533246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778304cc-d0e6-448b-a736-e9cd283827cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:28.534158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778304cc-d0e6-448b-a736-e9cd283827cb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:28.534439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778304cc-d0e6-448b-a736-e9cd283827cb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:28.534713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778304cc-d0e6-448b-a736-e9cd283827cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:28.552321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db975a-4bf9-4a3c-8a42-f9ff3000a1a5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:28.553540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778304cc-d0e6-448b-a736-e9cd283827cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:28.555080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778304cc-d0e6-448b-a736-e9cd283827cb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-778304cc-d0e6-448b-a736-e9cd283827cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:58:28.573657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:28.574637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:58:28.575454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:58:28.575454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:58:28.575454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:58:28.575454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 8/18] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:58:28.580628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778304cc-d0e6-448b-a736-e9cd283827cb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:28.587352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e6ed8-bfbc-45cb-97de-91c0c89cb8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:28.587993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e6ed8-bfbc-45cb-97de-91c0c89cb8bc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:28.588271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e6ed8-bfbc-45cb-97de-91c0c89cb8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:28.588572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e6ed8-bfbc-45cb-97de-91c0c89cb8bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:28.589700 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e6ed8-bfbc-45cb-97de-91c0c89cb8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:28.591197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e6ed8-bfbc-45cb-97de-91c0c89cb8bc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:28.592872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 11/19] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:58:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:58:28.598585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e6ed8-bfbc-45cb-97de-91c0c89cb8bc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:28.636557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:28.679637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:28.684979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778304cc-d0e6-448b-a736-e9cd283827cb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:28.698556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e6ed8-bfbc-45cb-97de-91c0c89cb8bc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:28.718697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62674220-a110-4e4a-baff-798a32079485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:28.719314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62674220-a110-4e4a-baff-798a32079485 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:28.719593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62674220-a110-4e4a-baff-798a32079485 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:28.719882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62674220-a110-4e4a-baff-798a32079485 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:28.720559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62674220-a110-4e4a-baff-798a32079485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:28.720892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62674220-a110-4e4a-baff-798a32079485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:28.722461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62674220-a110-4e4a-baff-798a32079485 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:28.730944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24915c2b-a69d-4296-bfac-22172c3bfeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:28.731557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24915c2b-a69d-4296-bfac-22172c3bfeff None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:28.731830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24915c2b-a69d-4296-bfac-22172c3bfeff None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:28.732098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24915c2b-a69d-4296-bfac-22172c3bfeff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:28.732848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24915c2b-a69d-4296-bfac-22172c3bfeff None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.domain.id=default, user.id=c84cb4aedf5f40eeb73ee0c384202e9a) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:28.733152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24915c2b-a69d-4296-bfac-22172c3bfeff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:28.734624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24915c2b-a69d-4296-bfac-22172c3bfeff None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:28.740275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 9/20] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:58:28.741196 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 12/21] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Sep 6 00:58:28 2022] GET /identity/v3/role_assignments?user.id=c84cb4aedf5f40eeb73ee0c384202e9a&scope.domain.id=default&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:58:30.770378 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b73a-887f-40cf-852a-d394497d1237 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:30.770904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b73a-887f-40cf-852a-d394497d1237 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:30.770904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b73a-887f-40cf-852a-d394497d1237 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:30.772629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 10/22] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:30.777987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33ee66-6046-41c3-ab55-cdbaa3d39f2a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:30.778403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33ee66-6046-41c3-ab55-cdbaa3d39f2a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:30.778580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33ee66-6046-41c3-ab55-cdbaa3d39f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:30.801284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ef33ee66-6046-41c3-ab55-cdbaa3d39f2a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:30.802511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ef33ee66-6046-41c3-ab55-cdbaa3d39f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:30.886181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 13/23] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:31.005186 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9ee0b-928c-4e33-8a6e-b0f76bd8f414 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:31.005529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9ee0b-928c-4e33-8a6e-b0f76bd8f414 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:31.005752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9ee0b-928c-4e33-8a6e-b0f76bd8f414 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:31.007103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 11/24] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:31.021951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f282c-a8e2-4743-b165-4959f03aab0d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:31.022202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f282c-a8e2-4743-b165-4959f03aab0d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:31.022442 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f282c-a8e2-4743-b165-4959f03aab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:31.046258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ec3f282c-a8e2-4743-b165-4959f03aab0d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:31.047473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ec3f282c-a8e2-4743-b165-4959f03aab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:31.144803 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 14/25] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:31.220579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ce3eb-774e-475d-be97-277a44d27476 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:31.220943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ce3eb-774e-475d-be97-277a44d27476 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:31.221163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ce3eb-774e-475d-be97-277a44d27476 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:31.222522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 12/26] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:31.228020 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4f463-3cb2-4997-a3ce-12dd52b3df65 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:31.228338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4f463-3cb2-4997-a3ce-12dd52b3df65 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:31.228625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4f463-3cb2-4997-a3ce-12dd52b3df65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:31.237368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:31.253382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-55a4f463-3cb2-4997-a3ce-12dd52b3df65 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:31.254602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-55a4f463-3cb2-4997-a3ce-12dd52b3df65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:31.325768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 15/27] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:31.375643 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ce3eb-774e-475d-be97-277a44d27476 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:31.502622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbbf80-1c63-420d-977a-06e7b886fab7 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:31.502996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbbf80-1c63-420d-977a-06e7b886fab7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:31.503281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbbf80-1c63-420d-977a-06e7b886fab7 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:31.504694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 16/28] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 00:58:31.512717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d1d84-2747-4e2b-98eb-781295b22774 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:31.513002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d1d84-2747-4e2b-98eb-781295b22774 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:31.513278 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d1d84-2747-4e2b-98eb-781295b22774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:31.518272 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ce3eb-774e-475d-be97-277a44d27476 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:31.552901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:31.559908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-619d1d84-2747-4e2b-98eb-781295b22774 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:31.561181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-619d1d84-2747-4e2b-98eb-781295b22774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:31.579773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c130bc-bdc3-435c-b326-ccfd1d9797b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:31.580615 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c130bc-bdc3-435c-b326-ccfd1d9797b1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:31.580901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c130bc-bdc3-435c-b326-ccfd1d9797b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:31.581172 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c130bc-bdc3-435c-b326-ccfd1d9797b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:31.599014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c130bc-bdc3-435c-b326-ccfd1d9797b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f0c130bc-bdc3-435c-b326-ccfd1d9797b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:31.617458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:31.618381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:58:31.619626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 13/29] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:58:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:31.624561 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c130bc-bdc3-435c-b326-ccfd1d9797b1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:31.687606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 17/30] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:58:31.688501 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d1d84-2747-4e2b-98eb-781295b22774 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:31.754826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:31.791515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d1d84-2747-4e2b-98eb-781295b22774 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:31.799628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c130bc-bdc3-435c-b326-ccfd1d9797b1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:31.835575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceca0e-32db-4b07-a8d5-a970d41d82b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:31.836150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceca0e-32db-4b07-a8d5-a970d41d82b0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:31.836666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceca0e-32db-4b07-a8d5-a970d41d82b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:31.836945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceca0e-32db-4b07-a8d5-a970d41d82b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:31.857857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceca0e-32db-4b07-a8d5-a970d41d82b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:31.860147 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceca0e-32db-4b07-a8d5-a970d41d82b0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:31.874375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692e28-c5a9-474c-b238-4b89ea32a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:31.875050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692e28-c5a9-474c-b238-4b89ea32a603 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:31.875382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692e28-c5a9-474c-b238-4b89ea32a603 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:31.875661 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692e28-c5a9-474c-b238-4b89ea32a603 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:31.876357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2692e28-c5a9-474c-b238-4b89ea32a603 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:31.876666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2692e28-c5a9-474c-b238-4b89ea32a603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:31.878189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2692e28-c5a9-474c-b238-4b89ea32a603 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2bceca0e-32db-4b07-a8d5-a970d41d82b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:58:31.889209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:31.890221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:58:31.891426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:58:31.891426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:58:31.891426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:58:31.891426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 18/31] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:31.891426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceca0e-32db-4b07-a8d5-a970d41d82b0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:31.903124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 14/32] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:58:31.904092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692e28-c5a9-474c-b238-4b89ea32a603 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:31.990151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:32.068965 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692e28-c5a9-474c-b238-4b89ea32a603 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:32.072790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceca0e-32db-4b07-a8d5-a970d41d82b0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:32.092656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:32.109357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863a4de-b46c-4b2c-94e6-a97d9c70db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:32.110443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863a4de-b46c-4b2c-94e6-a97d9c70db49 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:32.111105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863a4de-b46c-4b2c-94e6-a97d9c70db49 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:32.111925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863a4de-b46c-4b2c-94e6-a97d9c70db49 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:32.112226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705e8fe-8115-4570-abe1-fa1fd838002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:32.112868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e8fe-8115-4570-abe1-fa1fd838002c None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:32.113146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e8fe-8115-4570-abe1-fa1fd838002c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:32.113418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e8fe-8115-4570-abe1-fa1fd838002c None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:32.113662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863a4de-b46c-4b2c-94e6-a97d9c70db49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:32.114096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705e8fe-8115-4570-abe1-fa1fd838002c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:32.114380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863a4de-b46c-4b2c-94e6-a97d9c70db49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:32.115539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705e8fe-8115-4570-abe1-fa1fd838002c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:32.116226 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863a4de-b46c-4b2c-94e6-a97d9c70db49 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:32.129778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 15/33] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:32.131149 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863a4de-b46c-4b2c-94e6-a97d9c70db49 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:32.236903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:32.240543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863a4de-b46c-4b2c-94e6-a97d9c70db49 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:32.255968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 19/34] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Sep 6 00:58:31 2022] POST /identity/v3/roles => generated 219 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:58:32.257438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705e8fe-8115-4570-abe1-fa1fd838002c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:32.281916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471830c2-4b79-4984-acdf-3225ae01e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:32.282573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471830c2-4b79-4984-acdf-3225ae01e70a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:32.282849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471830c2-4b79-4984-acdf-3225ae01e70a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:32.283518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471830c2-4b79-4984-acdf-3225ae01e70a None admin] PATH_INFO: `/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:32.285345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471830c2-4b79-4984-acdf-3225ae01e70a None admin] RBAC: Authorizing `identity:get_user(user_id=c84cb4aedf5f40eeb73ee0c384202e9a)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:32.288033 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471830c2-4b79-4984-acdf-3225ae01e70a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:32.290680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 16/35] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:32 2022] GET /identity/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:32.291250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471830c2-4b79-4984-acdf-3225ae01e70a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:32.451969 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705e8fe-8115-4570-abe1-fa1fd838002c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:32.474179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471830c2-4b79-4984-acdf-3225ae01e70a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:32.499029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399ba28-d55b-4c5e-a046-52528bb0c778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:32.499682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399ba28-d55b-4c5e-a046-52528bb0c778 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:32.499962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399ba28-d55b-4c5e-a046-52528bb0c778 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:32.500236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399ba28-d55b-4c5e-a046-52528bb0c778 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:32.501443 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399ba28-d55b-4c5e-a046-52528bb0c778 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:32.503798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399ba28-d55b-4c5e-a046-52528bb0c778 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:32.517179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb5539-eb2a-4811-af4d-bd516a5b4146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:32.517892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb5539-eb2a-4811-af4d-bd516a5b4146 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:32.518186 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb5539-eb2a-4811-af4d-bd516a5b4146 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:32.518450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb5539-eb2a-4811-af4d-bd516a5b4146 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:32.519172 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb5539-eb2a-4811-af4d-bd516a5b4146 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:32.520895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb5539-eb2a-4811-af4d-bd516a5b4146 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:32.527200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 20/36] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Sep 6 00:58:32 2022] POST /identity/v3/roles => generated 225 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:58:32.528034 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399ba28-d55b-4c5e-a046-52528bb0c778 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:32.569613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:32.649703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399ba28-d55b-4c5e-a046-52528bb0c778 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:32.681157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 17/37] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 00:58:32 2022] POST /identity/v3/projects => generated 301 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:58:32.682819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e56fd-eb5b-4002-addb-04db50a8bf58 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:32.683112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e56fd-eb5b-4002-addb-04db50a8bf58 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:32.683455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e56fd-eb5b-4002-addb-04db50a8bf58 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:32.685249 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 18/38] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:32.690795 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a855c-1493-48fe-93c1-c375989c9716 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:32.691108 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a855c-1493-48fe-93c1-c375989c9716 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:32.691351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a855c-1493-48fe-93c1-c375989c9716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:32.713868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-bc8a855c-1493-48fe-93c1-c375989c9716 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:32.715652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bc8a855c-1493-48fe-93c1-c375989c9716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:32.733935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:32.805878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edad88b-f427-4baf-bf3f-b1cccd9699a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:32.806550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 19/39] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:32.806917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edad88b-f427-4baf-bf3f-b1cccd9699a4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:32.806917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edad88b-f427-4baf-bf3f-b1cccd9699a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:32.807154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edad88b-f427-4baf-bf3f-b1cccd9699a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:32.808422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edad88b-f427-4baf-bf3f-b1cccd9699a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:32.809944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edad88b-f427-4baf-bf3f-b1cccd9699a4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:32.811841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 21/40] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:58:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:32.821485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a855c-1493-48fe-93c1-c375989c9716 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:32.945018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a855c-1493-48fe-93c1-c375989c9716 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:32.968764 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a629b7-7aa2-4c6f-bf8a-ca6d7d578f07 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:32.969038 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a629b7-7aa2-4c6f-bf8a-ca6d7d578f07 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:32.969239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a629b7-7aa2-4c6f-bf8a-ca6d7d578f07 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:32.970957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 22/41] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:32.977970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125187d-5f35-4349-8a85-b999b6a21631 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:32.978286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125187d-5f35-4349-8a85-b999b6a21631 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:32.978527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125187d-5f35-4349-8a85-b999b6a21631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:32.999298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bbba3-866a-4895-88a4-110c420b8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:33.000405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bbba3-866a-4895-88a4-110c420b8795 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:33.000917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bbba3-866a-4895-88a4-110c420b8795 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:33.001404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bbba3-866a-4895-88a4-110c420b8795 None admin] PATH_INFO: `/v3/domains/default/users/c84cb4aedf5f40eeb73ee0c384202e9a/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:33.003631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c125187d-5f35-4349-8a85-b999b6a21631 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:33.005581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c125187d-5f35-4349-8a85-b999b6a21631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:33.005772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bbba3-866a-4895-88a4-110c420b8795 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c84cb4aedf5f40eeb73ee0c384202e9a, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:33.007840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bbba3-866a-4895-88a4-110c420b8795 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:33.031813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 20/42] 10.222.0.25 () {58 vars in 1361 bytes} [Tue Sep 6 00:58:32 2022] PUT /identity/v3/domains/default/users/c84cb4aedf5f40eeb73ee0c384202e9a/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:58:33.114137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 23/43] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:58:33.117345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bbba3-866a-4895-88a4-110c420b8795 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:33.132772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:33.234848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bbba3-866a-4895-88a4-110c420b8795 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:33.270137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4c13c-c10b-4411-8773-d0d7019a15b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:33.270763 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4c13c-c10b-4411-8773-d0d7019a15b9 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:33.271039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4c13c-c10b-4411-8773-d0d7019a15b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:33.271309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4c13c-c10b-4411-8773-d0d7019a15b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:33.271999 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4c13c-c10b-4411-8773-d0d7019a15b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:33.273465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4c13c-c10b-4411-8773-d0d7019a15b9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:33.294711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 21/44] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Sep 6 00:58:33 2022] POST /identity/v3/roles => generated 223 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:58:33.478778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125187d-5f35-4349-8a85-b999b6a21631 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:33.526052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:33.610411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125187d-5f35-4349-8a85-b999b6a21631 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:33.654603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768a62e-b758-4dd5-b3f6-a21ed1ebaff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:33.655249 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768a62e-b758-4dd5-b3f6-a21ed1ebaff6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:33.655529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768a62e-b758-4dd5-b3f6-a21ed1ebaff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:33.655799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768a62e-b758-4dd5-b3f6-a21ed1ebaff6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:33.656941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768a62e-b758-4dd5-b3f6-a21ed1ebaff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:33.658648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768a62e-b758-4dd5-b3f6-a21ed1ebaff6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:33.660608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 24/45] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:58:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:33.667211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4c13c-c10b-4411-8773-d0d7019a15b9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:33.750358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:33.795322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4c13c-c10b-4411-8773-d0d7019a15b9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:33.839606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0844d-c798-46e9-8f08-e0ff59d8c7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:33.840269 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0844d-c798-46e9-8f08-e0ff59d8c7b9 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:33.840520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0844d-c798-46e9-8f08-e0ff59d8c7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:33.840796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0844d-c798-46e9-8f08-e0ff59d8c7b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:33.841467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0844d-c798-46e9-8f08-e0ff59d8c7b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:33.843654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0844d-c798-46e9-8f08-e0ff59d8c7b9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:33.875367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 22/46] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 00:58:33 2022] POST /identity/v3/projects => generated 312 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:58:34.988525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a423a-8c9b-46d0-ac2a-45fe6f11ad97 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:34.989076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a423a-8c9b-46d0-ac2a-45fe6f11ad97 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:34.989076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a423a-8c9b-46d0-ac2a-45fe6f11ad97 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:34.990427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 25/47] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:34.995733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b180bc-6162-4178-b052-4a4af315df79 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:34.996162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b180bc-6162-4178-b052-4a4af315df79 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:34.996330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b180bc-6162-4178-b052-4a4af315df79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:35.015643 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d5b180bc-6162-4178-b052-4a4af315df79 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:35.016879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d5b180bc-6162-4178-b052-4a4af315df79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:35.087078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 23/48] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:35.351527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a423a-8c9b-46d0-ac2a-45fe6f11ad97 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:35.464598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a423a-8c9b-46d0-ac2a-45fe6f11ad97 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:35.466144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:35.503067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069aaf3-12ef-46dc-92a5-5378f6285d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:35.503705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069aaf3-12ef-46dc-92a5-5378f6285d8e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:35.503988 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069aaf3-12ef-46dc-92a5-5378f6285d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:35.504256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069aaf3-12ef-46dc-92a5-5378f6285d8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:35.514912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069aaf3-12ef-46dc-92a5-5378f6285d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9069aaf3-12ef-46dc-92a5-5378f6285d8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:35.519936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:35.520955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:58:35.521769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 26/49] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:58:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:35.528783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b180bc-6162-4178-b052-4a4af315df79 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:35.584200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:35.635282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b180bc-6162-4178-b052-4a4af315df79 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:35.670907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad6091-74bf-4ee0-99b1-90c019d7d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:35.671522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad6091-74bf-4ee0-99b1-90c019d7d3ab None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:35.671765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad6091-74bf-4ee0-99b1-90c019d7d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:35.672087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad6091-74bf-4ee0-99b1-90c019d7d3ab None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:35.672751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad6091-74bf-4ee0-99b1-90c019d7d3ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:35.673055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad6091-74bf-4ee0-99b1-90c019d7d3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:35.674605 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad6091-74bf-4ee0-99b1-90c019d7d3ab None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:35.683191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 24/50] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:35.690163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069aaf3-12ef-46dc-92a5-5378f6285d8e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:35.773043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4952c-f869-451c-a7c9-760cc3350294 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:35.773331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4952c-f869-451c-a7c9-760cc3350294 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:35.773608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4952c-f869-451c-a7c9-760cc3350294 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:35.774978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 25/51] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:35.779756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ed2cf-4046-4f98-a08a-98d15585b0c3 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:35.780050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ed2cf-4046-4f98-a08a-98d15585b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:35.780351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ed2cf-4046-4f98-a08a-98d15585b0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:35.796626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069aaf3-12ef-46dc-92a5-5378f6285d8e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:35.799393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-da5ed2cf-4046-4f98-a08a-98d15585b0c3 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:35.800636 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-da5ed2cf-4046-4f98-a08a-98d15585b0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:35.831231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37986143-9c58-48a7-bd7c-7d3076d55a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:35.831867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37986143-9c58-48a7-bd7c-7d3076d55a7a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:35.832151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37986143-9c58-48a7-bd7c-7d3076d55a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:35.832466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37986143-9c58-48a7-bd7c-7d3076d55a7a None admin] PATH_INFO: `/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:35.833643 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37986143-9c58-48a7-bd7c-7d3076d55a7a None admin] RBAC: Authorizing `identity:get_user(user_id=c84cb4aedf5f40eeb73ee0c384202e9a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:35.835170 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37986143-9c58-48a7-bd7c-7d3076d55a7a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:35.836799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 27/52] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:35 2022] GET /identity/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:35.842377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37986143-9c58-48a7-bd7c-7d3076d55a7a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:35.868449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 26/53] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:35.874912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:35.948889 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37986143-9c58-48a7-bd7c-7d3076d55a7a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:35.984139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413a307-a7b8-4c84-b83c-f38fe2701576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:35.984802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413a307-a7b8-4c84-b83c-f38fe2701576 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:35.985079 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413a307-a7b8-4c84-b83c-f38fe2701576 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:35.985356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413a307-a7b8-4c84-b83c-f38fe2701576 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:35.986721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413a307-a7b8-4c84-b83c-f38fe2701576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:35.988228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413a307-a7b8-4c84-b83c-f38fe2701576 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:35.989849 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 28/54] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:58:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:35.995915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ed2cf-4046-4f98-a08a-98d15585b0c3 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:36.136322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413a307-a7b8-4c84-b83c-f38fe2701576 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:36.156618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:36.221633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ed2cf-4046-4f98-a08a-98d15585b0c3 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:36.238231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:36.242550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413a307-a7b8-4c84-b83c-f38fe2701576 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:36.257623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a497-119b-4e02-b653-eaba6ca8cd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:36.258243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a497-119b-4e02-b653-eaba6ca8cd04 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:36.258522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a497-119b-4e02-b653-eaba6ca8cd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:36.258796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a497-119b-4e02-b653-eaba6ca8cd04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:36.259512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8a497-119b-4e02-b653-eaba6ca8cd04 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.domain.id=default, user.id=c84cb4aedf5f40eeb73ee0c384202e9a) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:36.259826 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8a497-119b-4e02-b653-eaba6ca8cd04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:36.261340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8a497-119b-4e02-b653-eaba6ca8cd04 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:36.269208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Sep 6 00:58:35 2022] GET /identity/v3/role_assignments?user.id=c84cb4aedf5f40eeb73ee0c384202e9a&scope.domain.id=default&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 530 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:36.277901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460521d2-18b8-4368-98ef-92615dced097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:36.278566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460521d2-18b8-4368-98ef-92615dced097 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:36.278841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460521d2-18b8-4368-98ef-92615dced097 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:36.279111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460521d2-18b8-4368-98ef-92615dced097 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:36.280318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460521d2-18b8-4368-98ef-92615dced097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:36.281881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460521d2-18b8-4368-98ef-92615dced097 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:36.283599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 29/56] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:58:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:58:36.290080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a497-119b-4e02-b653-eaba6ca8cd04 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:36.401339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a497-119b-4e02-b653-eaba6ca8cd04 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:36.409235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:36.439836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2243dc0-5ad0-4a22-89de-e2b2f291ca98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:36.440044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2243dc0-5ad0-4a22-89de-e2b2f291ca98 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:36.440316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2243dc0-5ad0-4a22-89de-e2b2f291ca98 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:36.440611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2243dc0-5ad0-4a22-89de-e2b2f291ca98 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:36.441260 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2243dc0-5ad0-4a22-89de-e2b2f291ca98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:36.442750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2243dc0-5ad0-4a22-89de-e2b2f291ca98 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:36.473898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 28/57] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Sep 6 00:58:36 2022] POST /identity/v3/projects => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:58:38.356474 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb466b0-9ab5-4200-bd3f-b6dd9b39ba8c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:38.357256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb466b0-9ab5-4200-bd3f-b6dd9b39ba8c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:38.357256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb466b0-9ab5-4200-bd3f-b6dd9b39ba8c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:38.359509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 30/58] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:38.365772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010dd38-8f26-4c4b-ac75-82506b6775dd None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:38.366528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010dd38-8f26-4c4b-ac75-82506b6775dd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:38.366671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010dd38-8f26-4c4b-ac75-82506b6775dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:38.397543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d010dd38-8f26-4c4b-ac75-82506b6775dd None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:38.399341 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d010dd38-8f26-4c4b-ac75-82506b6775dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:38.475559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 29/59] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:38.750713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb466b0-9ab5-4200-bd3f-b6dd9b39ba8c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:38.871238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb466b0-9ab5-4200-bd3f-b6dd9b39ba8c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:38.905235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ab3da-40b2-40ed-a092-c40bba24c9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:38.905852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab3da-40b2-40ed-a092-c40bba24c9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:38.906128 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab3da-40b2-40ed-a092-c40bba24c9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:38.906399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab3da-40b2-40ed-a092-c40bba24c9b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:38.907556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ab3da-40b2-40ed-a092-c40bba24c9b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:38.909419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ab3da-40b2-40ed-a092-c40bba24c9b4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:38.910967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 31/60] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:58:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:38.917076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010dd38-8f26-4c4b-ac75-82506b6775dd None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:39.010479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:39.024514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010dd38-8f26-4c4b-ac75-82506b6775dd None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:39.064826 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8363b27-3bb5-4cd3-8582-74231dd194c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:39.065461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8363b27-3bb5-4cd3-8582-74231dd194c9 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:39.065739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8363b27-3bb5-4cd3-8582-74231dd194c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:39.066013 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8363b27-3bb5-4cd3-8582-74231dd194c9 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:39.066665 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8363b27-3bb5-4cd3-8582-74231dd194c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:39.068189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8363b27-3bb5-4cd3-8582-74231dd194c9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:39.098407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 30/61] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 00:58:38 2022] POST /identity/v3/users => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:58:42.153747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e9e17-3011-4694-9e58-a9c64c828a2c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:42.154630 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e9e17-3011-4694-9e58-a9c64c828a2c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:42.155051 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e9e17-3011-4694-9e58-a9c64c828a2c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:42.158101 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 32/62] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:42.163619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70e0b-2c8e-4ad3-91f6-4b2194dd9466 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:42.164048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70e0b-2c8e-4ad3-91f6-4b2194dd9466 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:42.164376 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70e0b-2c8e-4ad3-91f6-4b2194dd9466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:42.193383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-60f70e0b-2c8e-4ad3-91f6-4b2194dd9466 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:42.194605 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-60f70e0b-2c8e-4ad3-91f6-4b2194dd9466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:42.288715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 31/63] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:42.340110 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8b676-ab87-4aa4-946e-fb20e3edda16 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:42.340734 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8b676-ab87-4aa4-946e-fb20e3edda16 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:42.341206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8b676-ab87-4aa4-946e-fb20e3edda16 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:42.342799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 33/64] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:42.348447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6d99-5bee-4f18-9338-a4117e19b271 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:42.348990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6d99-5bee-4f18-9338-a4117e19b271 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:42.349454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6d99-5bee-4f18-9338-a4117e19b271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:42.374905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-aeeb6d99-5bee-4f18-9338-a4117e19b271 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:42.376528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-aeeb6d99-5bee-4f18-9338-a4117e19b271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:42.409202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad7615-d427-44c5-a7f0-69805fd82284 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:42.409818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad7615-d427-44c5-a7f0-69805fd82284 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:42.410401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad7615-d427-44c5-a7f0-69805fd82284 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:42.411939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 34/65] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:42.421482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d55f6b-5c84-40ba-9a33-8171779e6c8d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:42.422052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d55f6b-5c84-40ba-9a33-8171779e6c8d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:42.422524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d55f6b-5c84-40ba-9a33-8171779e6c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:42.453149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f0d55f6b-5c84-40ba-9a33-8171779e6c8d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:42.455688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f0d55f6b-5c84-40ba-9a33-8171779e6c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:42.484417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 32/66] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:42.486297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f23961-f445-49c4-b9f7-175c2ead3b0f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:42.486786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f23961-f445-49c4-b9f7-175c2ead3b0f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:42.487266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f23961-f445-49c4-b9f7-175c2ead3b0f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:42.488906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 33/67] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:42.494327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9adf65-2339-415c-8e72-89b73e337090 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:42.494771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9adf65-2339-415c-8e72-89b73e337090 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:42.495214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9adf65-2339-415c-8e72-89b73e337090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:42.497299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:42.510326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:42.530278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ff9adf65-2339-415c-8e72-89b73e337090 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:42.532874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ff9adf65-2339-415c-8e72-89b73e337090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:42.569150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 35/68] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:58:42.630369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d55f6b-5c84-40ba-9a33-8171779e6c8d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:42.641890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 34/69] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:58:42.732377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d55f6b-5c84-40ba-9a33-8171779e6c8d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:42.772002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9ae26-799a-4142-bc07-484458defffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:42.773063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9ae26-799a-4142-bc07-484458defffe None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:42.773532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9ae26-799a-4142-bc07-484458defffe None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:42.773990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9ae26-799a-4142-bc07-484458defffe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:42.801221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9ae26-799a-4142-bc07-484458defffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:42.803533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9adf65-2339-415c-8e72-89b73e337090 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7db9ae26-799a-4142-bc07-484458defffe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:42.806529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:42.807365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:58:42.808139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 36/70] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:58:42.813167 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9ae26-799a-4142-bc07-484458defffe None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:42.850823 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:42.913759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9adf65-2339-415c-8e72-89b73e337090 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:42.951277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8139006-269d-46cc-8dca-90abe836d6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:42.951920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8139006-269d-46cc-8dca-90abe836d6fe None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:42.952199 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8139006-269d-46cc-8dca-90abe836d6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:42.952509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8139006-269d-46cc-8dca-90abe836d6fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:42.954428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:42.964170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8139006-269d-46cc-8dca-90abe836d6fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:42.967005 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9ae26-799a-4142-bc07-484458defffe None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-b8139006-269d-46cc-8dca-90abe836d6fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:42.969130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:42.969980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:58:42.970843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:58:42.972816 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc9952-20f4-4284-be98-08bd17e0a01c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:42.972816 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc9952-20f4-4284-be98-08bd17e0a01c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:42.972816 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc9952-20f4-4284-be98-08bd17e0a01c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:42.973755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 36/72] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:42.978061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc9952-20f4-4284-be98-08bd17e0a01c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:43.012743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8559c81-238d-4cde-8182-375e4018c301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:43.013366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8559c81-238d-4cde-8182-375e4018c301 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:43.013648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8559c81-238d-4cde-8182-375e4018c301 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:43.013930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8559c81-238d-4cde-8182-375e4018c301 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:43.014606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8559c81-238d-4cde-8182-375e4018c301 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:43.014914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8559c81-238d-4cde-8182-375e4018c301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:43.016395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8559c81-238d-4cde-8182-375e4018c301 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:43.024927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 37/73] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:43.025745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8559c81-238d-4cde-8182-375e4018c301 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:43.086099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc9952-20f4-4284-be98-08bd17e0a01c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:43.115084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:43.126212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9f3b2-682d-4143-8036-49b91afebeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:43.127139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9f3b2-682d-4143-8036-49b91afebeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:43.127248 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9f3b2-682d-4143-8036-49b91afebeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:43.127449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9f3b2-682d-4143-8036-49b91afebeb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:43.130249 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8559c81-238d-4cde-8182-375e4018c301 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:43.137547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9f3b2-682d-4143-8036-49b91afebeb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-26a9f3b2-682d-4143-8036-49b91afebeb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:43.142576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:43.143430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:58:43.144204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 37/74] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:58:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:43.145132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efec747-a2e3-455f-8b8c-fa6950c79f8e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:43.145304 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efec747-a2e3-455f-8b8c-fa6950c79f8e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:43.145575 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efec747-a2e3-455f-8b8c-fa6950c79f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:43.163934 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9efec747-a2e3-455f-8b8c-fa6950c79f8e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:43.165123 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9efec747-a2e3-455f-8b8c-fa6950c79f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:43.166467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cd55b-219a-42d8-8b84-c1ca91629a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:43.167093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cd55b-219a-42d8-8b84-c1ca91629a7b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:43.167372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cd55b-219a-42d8-8b84-c1ca91629a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:43.167647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cd55b-219a-42d8-8b84-c1ca91629a7b None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:43.168342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cd55b-219a-42d8-8b84-c1ca91629a7b None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:43.168653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cd55b-219a-42d8-8b84-c1ca91629a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:43.170098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cd55b-219a-42d8-8b84-c1ca91629a7b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:43.178671 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 38/75] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:58:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:43.179470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cd55b-219a-42d8-8b84-c1ca91629a7b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:43.215235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:43.232493 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 38/76] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:43.238444 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efec747-a2e3-455f-8b8c-fa6950c79f8e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:43.290071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cd55b-219a-42d8-8b84-c1ca91629a7b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:43.325413 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d5de7-2e39-4c0f-ae8a-1b378e5ce4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:43.326039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d5de7-2e39-4c0f-ae8a-1b378e5ce4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:43.326321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d5de7-2e39-4c0f-ae8a-1b378e5ce4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:43.326599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d5de7-2e39-4c0f-ae8a-1b378e5ce4d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:43.336426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efec747-a2e3-455f-8b8c-fa6950c79f8e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:43.336803 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d5de7-2e39-4c0f-ae8a-1b378e5ce4d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-a49d5de7-2e39-4c0f-ae8a-1b378e5ce4d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:43.341975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:43.342852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:58:43.343625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 39/77] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:43.348789 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d5de7-2e39-4c0f-ae8a-1b378e5ce4d8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:43.359788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:43.372792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8842cb-8d5b-46c2-906f-cbe1fc8b18df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:43.373431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8842cb-8d5b-46c2-906f-cbe1fc8b18df None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:43.373710 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8842cb-8d5b-46c2-906f-cbe1fc8b18df None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:43.373982 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8842cb-8d5b-46c2-906f-cbe1fc8b18df None admin] PATH_INFO: `/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:43.375107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8842cb-8d5b-46c2-906f-cbe1fc8b18df None admin] RBAC: Authorizing `identity:get_user(user_id=c84cb4aedf5f40eeb73ee0c384202e9a)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:43.377173 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8842cb-8d5b-46c2-906f-cbe1fc8b18df None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:43.383280 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 39/78] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:43 2022] GET /identity/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:43.383280 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8842cb-8d5b-46c2-906f-cbe1fc8b18df None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:43.437472 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:43.469374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d5de7-2e39-4c0f-ae8a-1b378e5ce4d8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:43.492109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8842cb-8d5b-46c2-906f-cbe1fc8b18df None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:43.508956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7692395-c507-48cd-b19f-bacc7b16262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:43.509578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7692395-c507-48cd-b19f-bacc7b16262b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:43.509858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7692395-c507-48cd-b19f-bacc7b16262b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:43.510133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7692395-c507-48cd-b19f-bacc7b16262b None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:43.510802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7692395-c507-48cd-b19f-bacc7b16262b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:43.511107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7692395-c507-48cd-b19f-bacc7b16262b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:43.512563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7692395-c507-48cd-b19f-bacc7b16262b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:43.520640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 40/79] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:58:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:43.521436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7692395-c507-48cd-b19f-bacc7b16262b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:43.525883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac26a5-9873-4aff-874d-7903e28ddb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:43.526593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac26a5-9873-4aff-874d-7903e28ddb61 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:43.526881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac26a5-9873-4aff-874d-7903e28ddb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:43.527160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac26a5-9873-4aff-874d-7903e28ddb61 None admin] PATH_INFO: `/v3/users/cb2704ce6ab6495682d66c927e5856fa` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:43.542385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac26a5-9873-4aff-874d-7903e28ddb61 None admin] RBAC: Authorizing `identity:get_user(user_id=cb2704ce6ab6495682d66c927e5856fa)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:43.543898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac26a5-9873-4aff-874d-7903e28ddb61 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:43.545574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 40/80] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:43 2022] GET /identity/v3/users/cb2704ce6ab6495682d66c927e5856fa => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:43.546337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac26a5-9873-4aff-874d-7903e28ddb61 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:43.595230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:43.628030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7692395-c507-48cd-b19f-bacc7b16262b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:43.649310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac26a5-9873-4aff-874d-7903e28ddb61 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:43.660370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:43.661717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11ca65-01b0-4411-b76f-5e83898f0c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:43.663380 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11ca65-01b0-4411-b76f-5e83898f0c3a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:43.663380 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11ca65-01b0-4411-b76f-5e83898f0c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:43.663380 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11ca65-01b0-4411-b76f-5e83898f0c3a None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:43.663943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11ca65-01b0-4411-b76f-5e83898f0c3a None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:43.664209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11ca65-01b0-4411-b76f-5e83898f0c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:43.665840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11ca65-01b0-4411-b76f-5e83898f0c3a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:43.674079 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 41/81] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:58:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:43.674902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11ca65-01b0-4411-b76f-5e83898f0c3a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:43.685184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cbb00-7ccd-4425-a0f8-a14d40fbe1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:43.685802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cbb00-7ccd-4425-a0f8-a14d40fbe1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:43.686078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cbb00-7ccd-4425-a0f8-a14d40fbe1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:43.686345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cbb00-7ccd-4425-a0f8-a14d40fbe1c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:43.755393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cbb00-7ccd-4425-a0f8-a14d40fbe1c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:43.756964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cbb00-7ccd-4425-a0f8-a14d40fbe1c1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:43.776532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11ca65-01b0-4411-b76f-5e83898f0c3a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:43.805956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:43.811338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89581-8087-4c7c-83a4-4d8944b79f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:43.811979 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89581-8087-4c7c-83a4-4d8944b79f0f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:43.812259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89581-8087-4c7c-83a4-4d8944b79f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:43.812566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89581-8087-4c7c-83a4-4d8944b79f0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:43.813689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f89581-8087-4c7c-83a4-4d8944b79f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:43.815246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f89581-8087-4c7c-83a4-4d8944b79f0f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:43.816856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 42/82] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:58:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:43.817637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89581-8087-4c7c-83a4-4d8944b79f0f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:43.856530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 41/83] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:58:43.857404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cbb00-7ccd-4425-a0f8-a14d40fbe1c1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:43.870988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:43.921213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89581-8087-4c7c-83a4-4d8944b79f0f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:43.955362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55434a32-b56d-41cc-bef2-feeba81fab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:43.956075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434a32-b56d-41cc-bef2-feeba81fab39 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:43.956399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434a32-b56d-41cc-bef2-feeba81fab39 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:43.956680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434a32-b56d-41cc-bef2-feeba81fab39 None admin] PATH_INFO: `/v3/users/cb2704ce6ab6495682d66c927e5856fa` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:43.957888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55434a32-b56d-41cc-bef2-feeba81fab39 None admin] RBAC: Authorizing `identity:get_user(user_id=cb2704ce6ab6495682d66c927e5856fa)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:43.959410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55434a32-b56d-41cc-bef2-feeba81fab39 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:43.959753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cbb00-7ccd-4425-a0f8-a14d40fbe1c1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:43.961184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 43/84] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:43 2022] GET /identity/v3/users/cb2704ce6ab6495682d66c927e5856fa => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:43.961865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55434a32-b56d-41cc-bef2-feeba81fab39 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:43.999134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eaac01-af83-4f29-88dc-7ec4aaf3cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:43.999748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaac01-af83-4f29-88dc-7ec4aaf3cb1e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:44.000028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaac01-af83-4f29-88dc-7ec4aaf3cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:44.000328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaac01-af83-4f29-88dc-7ec4aaf3cb1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:44.030334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:44.066290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55434a32-b56d-41cc-bef2-feeba81fab39 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:44.072202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eaac01-af83-4f29-88dc-7ec4aaf3cb1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:44.073777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eaac01-af83-4f29-88dc-7ec4aaf3cb1e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:44.084799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:44.100614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd2a78-eca9-485a-a761-28633b2f6056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:44.101262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd2a78-eca9-485a-a761-28633b2f6056 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:44.101552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd2a78-eca9-485a-a761-28633b2f6056 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:44.101825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd2a78-eca9-485a-a761-28633b2f6056 None admin] PATH_INFO: `/v3/users/cb2704ce6ab6495682d66c927e5856fa` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:44.102950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd2a78-eca9-485a-a761-28633b2f6056 None admin] RBAC: Authorizing `identity:get_user(user_id=cb2704ce6ab6495682d66c927e5856fa)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:44.104489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd2a78-eca9-485a-a761-28633b2f6056 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:44.106074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 44/85] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:43 2022] GET /identity/v3/users/cb2704ce6ab6495682d66c927e5856fa => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:44.106852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd2a78-eca9-485a-a761-28633b2f6056 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:44.175195 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 42/86] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:58:44.176625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eaac01-af83-4f29-88dc-7ec4aaf3cb1e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:44.217434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd2a78-eca9-485a-a761-28633b2f6056 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:44.250718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae565af0-0d90-4cbd-854b-1c262f0ce5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:44.251367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae565af0-0d90-4cbd-854b-1c262f0ce5fd None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:44.251676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae565af0-0d90-4cbd-854b-1c262f0ce5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:44.251946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae565af0-0d90-4cbd-854b-1c262f0ce5fd None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:44.252644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae565af0-0d90-4cbd-854b-1c262f0ce5fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:44.254158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae565af0-0d90-4cbd-854b-1c262f0ce5fd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:44.266898 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:44.274736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eaac01-af83-4f29-88dc-7ec4aaf3cb1e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:44.285901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:44.286709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 45/87] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 00:58:44 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:58:44.287534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae565af0-0d90-4cbd-854b-1c262f0ce5fd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:44.314678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11ac32-a258-4cc9-bfad-6a0ad94f7e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:44.315344 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11ac32-a258-4cc9-bfad-6a0ad94f7e06 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:44.315621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11ac32-a258-4cc9-bfad-6a0ad94f7e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:44.316004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11ac32-a258-4cc9-bfad-6a0ad94f7e06 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:44.317300 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11ac32-a258-4cc9-bfad-6a0ad94f7e06 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:44.318904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11ac32-a258-4cc9-bfad-6a0ad94f7e06 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:44.320875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 43/88] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:44 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:44.326908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11ac32-a258-4cc9-bfad-6a0ad94f7e06 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:44.402230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae565af0-0d90-4cbd-854b-1c262f0ce5fd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:44.444614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56632ebf-5b9a-4ab0-9ebb-2b0271393406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:44.445847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56632ebf-5b9a-4ab0-9ebb-2b0271393406 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:44.445847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56632ebf-5b9a-4ab0-9ebb-2b0271393406 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:44.445847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56632ebf-5b9a-4ab0-9ebb-2b0271393406 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:44.447535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11ac32-a258-4cc9-bfad-6a0ad94f7e06 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:44.487174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f519c2-b8f2-4621-a910-2563479f178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:44.487788 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f519c2-b8f2-4621-a910-2563479f178b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:44.488061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f519c2-b8f2-4621-a910-2563479f178b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:44.488379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f519c2-b8f2-4621-a910-2563479f178b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:44.514440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:44.526873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56632ebf-5b9a-4ab0-9ebb-2b0271393406 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:44.528541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56632ebf-5b9a-4ab0-9ebb-2b0271393406 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:44.546391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:44.570744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f519c2-b8f2-4621-a910-2563479f178b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:44.572758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f519c2-b8f2-4621-a910-2563479f178b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:44.658292 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 46/89] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:58:44.659179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56632ebf-5b9a-4ab0-9ebb-2b0271393406 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:44.701486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 44/90] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:58:44.702378 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f519c2-b8f2-4621-a910-2563479f178b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:44.778027 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:44.787590 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56632ebf-5b9a-4ab0-9ebb-2b0271393406 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:44.793797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:44.819982 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f519c2-b8f2-4621-a910-2563479f178b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:44.823513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0448c6-8673-4c71-ba2f-5fd1c0d65ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:44.824232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0448c6-8673-4c71-ba2f-5fd1c0d65ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:44.824605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0448c6-8673-4c71-ba2f-5fd1c0d65ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:44.824943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0448c6-8673-4c71-ba2f-5fd1c0d65ec8 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:44.826151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0448c6-8673-4c71-ba2f-5fd1c0d65ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:44.827732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0448c6-8673-4c71-ba2f-5fd1c0d65ec8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:44.829557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 47/91] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:44 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:44.830592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0448c6-8673-4c71-ba2f-5fd1c0d65ec8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:44.859398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378461d-dabe-425d-9fc4-f7299ee32ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:44.860023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378461d-dabe-425d-9fc4-f7299ee32ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:44.860324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378461d-dabe-425d-9fc4-f7299ee32ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:44.860613 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378461d-dabe-425d-9fc4-f7299ee32ea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:44.861602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378461d-dabe-425d-9fc4-f7299ee32ea1 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=df4081668f8c44e3a8072b71f9f14168, user.id=c84cb4aedf5f40eeb73ee0c384202e9a) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:44.862130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378461d-dabe-425d-9fc4-f7299ee32ea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:44.863662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378461d-dabe-425d-9fc4-f7299ee32ea1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:44.869935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 45/92] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:58:44 2022] GET /identity/v3/role_assignments?user.id=c84cb4aedf5f40eeb73ee0c384202e9a&scope.project.id=df4081668f8c44e3a8072b71f9f14168&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:44.870840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378461d-dabe-425d-9fc4-f7299ee32ea1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:44.940932 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0448c6-8673-4c71-ba2f-5fd1c0d65ec8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:44.977461 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fb3cf-f1d3-45d1-b6bb-bd36f63d91c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:44.978147 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fb3cf-f1d3-45d1-b6bb-bd36f63d91c2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:44.978427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fb3cf-f1d3-45d1-b6bb-bd36f63d91c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:44.978702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fb3cf-f1d3-45d1-b6bb-bd36f63d91c2 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:44.979927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fb3cf-f1d3-45d1-b6bb-bd36f63d91c2 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:44.982195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fb3cf-f1d3-45d1-b6bb-bd36f63d91c2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:44.983941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 48/93] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:44 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:44.984829 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fb3cf-f1d3-45d1-b6bb-bd36f63d91c2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:44.993975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378461d-dabe-425d-9fc4-f7299ee32ea1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:45.015912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:45.049623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3834eb4-39be-4229-ba33-adf38b90f3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:45.050391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3834eb4-39be-4229-ba33-adf38b90f3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:45.050774 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3834eb4-39be-4229-ba33-adf38b90f3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:45.051057 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3834eb4-39be-4229-ba33-adf38b90f3a6 None admin] PATH_INFO: `/v3/projects/8e420c512b844521bc6389ef1db25c0d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:45.052318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3834eb4-39be-4229-ba33-adf38b90f3a6 None admin] RBAC: Authorizing `identity:get_project(project_id=8e420c512b844521bc6389ef1db25c0d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:45.054116 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3834eb4-39be-4229-ba33-adf38b90f3a6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:45.055945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 46/94] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:44 2022] GET /identity/v3/projects/8e420c512b844521bc6389ef1db25c0d => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:45.056970 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3834eb4-39be-4229-ba33-adf38b90f3a6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:45.071590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:45.098976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fb3cf-f1d3-45d1-b6bb-bd36f63d91c2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:45.136268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d927381-aa8c-44b7-b537-fae581c6e5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:45.136922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d927381-aa8c-44b7-b537-fae581c6e5fd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:45.137199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d927381-aa8c-44b7-b537-fae581c6e5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:45.137466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d927381-aa8c-44b7-b537-fae581c6e5fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:45.138205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d927381-aa8c-44b7-b537-fae581c6e5fd None admin] RBAC: Adding query filter params (role.id=948a63d9dffa4bdb815a397570a1d381, scope.project.id=df4081668f8c44e3a8072b71f9f14168, user.id=cb2704ce6ab6495682d66c927e5856fa) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:45.138515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d927381-aa8c-44b7-b537-fae581c6e5fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:45.140023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d927381-aa8c-44b7-b537-fae581c6e5fd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:45.145966 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 49/95] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:58:44 2022] GET /identity/v3/role_assignments?user.id=cb2704ce6ab6495682d66c927e5856fa&scope.project.id=df4081668f8c44e3a8072b71f9f14168&role.id=948a63d9dffa4bdb815a397570a1d381 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:45.146771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d927381-aa8c-44b7-b537-fae581c6e5fd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:45.175855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3834eb4-39be-4229-ba33-adf38b90f3a6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:45.216520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5037c-f340-4d68-b72d-d42d581da673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:45.217159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5037c-f340-4d68-b72d-d42d581da673 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:45.217497 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5037c-f340-4d68-b72d-d42d581da673 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:45.217780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5037c-f340-4d68-b72d-d42d581da673 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:45.218562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5037c-f340-4d68-b72d-d42d581da673 None admin] RBAC: Adding query filter params (role.id=5f42b81ce88a4943902b63aaaffc1bc2, scope.project.id=df4081668f8c44e3a8072b71f9f14168, user.id=cb2704ce6ab6495682d66c927e5856fa) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:45.218936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5037c-f340-4d68-b72d-d42d581da673 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:45.220805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5037c-f340-4d68-b72d-d42d581da673 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:45.227396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 47/96] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:58:45 2022] GET /identity/v3/role_assignments?user.id=cb2704ce6ab6495682d66c927e5856fa&scope.project.id=df4081668f8c44e3a8072b71f9f14168&role.id=5f42b81ce88a4943902b63aaaffc1bc2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:45.249189 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:45.263286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d927381-aa8c-44b7-b537-fae581c6e5fd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:45.321828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c3186-9c21-486f-a091-6692fe924e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:45.322388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3186-9c21-486f-a091-6692fe924e7b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:45.322677 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3186-9c21-486f-a091-6692fe924e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:45.322956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3186-9c21-486f-a091-6692fe924e7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:45.323728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c3186-9c21-486f-a091-6692fe924e7b None admin] RBAC: Adding query filter params (role.id=948a63d9dffa4bdb815a397570a1d381, scope.project.id=8e420c512b844521bc6389ef1db25c0d, user.id=cb2704ce6ab6495682d66c927e5856fa) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:45.324048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c3186-9c21-486f-a091-6692fe924e7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:45.325723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c3186-9c21-486f-a091-6692fe924e7b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:45.332619 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 50/97] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:58:45 2022] GET /identity/v3/role_assignments?user.id=cb2704ce6ab6495682d66c927e5856fa&scope.project.id=8e420c512b844521bc6389ef1db25c0d&role.id=948a63d9dffa4bdb815a397570a1d381 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:46.686898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48450de-7b02-40dc-a8e2-c7efac50f393 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:46.687991 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48450de-7b02-40dc-a8e2-c7efac50f393 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:46.688536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48450de-7b02-40dc-a8e2-c7efac50f393 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:46.691104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 48/98] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:46.696603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810db498-090d-4770-84c4-f990d337d76a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:46.697390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810db498-090d-4770-84c4-f990d337d76a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:46.697852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810db498-090d-4770-84c4-f990d337d76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:46.716691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-810db498-090d-4770-84c4-f990d337d76a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:46.718180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-810db498-090d-4770-84c4-f990d337d76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:46.804007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 51/99] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:47.335649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48450de-7b02-40dc-a8e2-c7efac50f393 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:47.363666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bcf5d-5338-4189-bdfd-2cbaf96c874d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:47.364327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bcf5d-5338-4189-bdfd-2cbaf96c874d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:47.364788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bcf5d-5338-4189-bdfd-2cbaf96c874d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:47.366551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 52/100] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:47.371860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd750ed9-702f-48ac-b4cc-e5550a0faf5b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:47.372434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd750ed9-702f-48ac-b4cc-e5550a0faf5b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:47.372928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd750ed9-702f-48ac-b4cc-e5550a0faf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:47.392218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-dd750ed9-702f-48ac-b4cc-e5550a0faf5b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:47.393755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dd750ed9-702f-48ac-b4cc-e5550a0faf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:47.452657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:47.503481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48450de-7b02-40dc-a8e2-c7efac50f393 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:47.521487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 53/101] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:58:47.561904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d22444-4639-43be-9e4f-b08ac0880332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:47.562562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22444-4639-43be-9e4f-b08ac0880332 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:47.562843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22444-4639-43be-9e4f-b08ac0880332 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:47.563119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22444-4639-43be-9e4f-b08ac0880332 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:47.583154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d22444-4639-43be-9e4f-b08ac0880332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f9d22444-4639-43be-9e4f-b08ac0880332 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:47.588522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:47.589354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:58:47.590812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 49/102] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:47.596246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd750ed9-702f-48ac-b4cc-e5550a0faf5b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:47.625947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:47.733949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd750ed9-702f-48ac-b4cc-e5550a0faf5b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:47.780139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543c12d-95e2-4238-9fe1-b99353c8bc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:47.780795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543c12d-95e2-4238-9fe1-b99353c8bc9a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:47.781079 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543c12d-95e2-4238-9fe1-b99353c8bc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:47.781350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543c12d-95e2-4238-9fe1-b99353c8bc9a None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:47.782029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543c12d-95e2-4238-9fe1-b99353c8bc9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:47.782332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543c12d-95e2-4238-9fe1-b99353c8bc9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:47.784571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543c12d-95e2-4238-9fe1-b99353c8bc9a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:47.800348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 54/103] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:58:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:47.806351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d22444-4639-43be-9e4f-b08ac0880332 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:47.945383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d22444-4639-43be-9e4f-b08ac0880332 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:47.975705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543c12d-95e2-4238-9fe1-b99353c8bc9a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:47.984281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1d9d5-a5d6-4833-a6d2-f06ad1954d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:47.984954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1d9d5-a5d6-4833-a6d2-f06ad1954d8a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:47.985246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1d9d5-a5d6-4833-a6d2-f06ad1954d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:47.985542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1d9d5-a5d6-4833-a6d2-f06ad1954d8a None admin] PATH_INFO: `/v3/users/90a395c291e4411d9de6fb61b3938bb6` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:47.988583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:48.002272 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1d9d5-a5d6-4833-a6d2-f06ad1954d8a None admin] RBAC: Authorizing `identity:get_user(user_id=90a395c291e4411d9de6fb61b3938bb6)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:48.004166 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1d9d5-a5d6-4833-a6d2-f06ad1954d8a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:48.006081 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 50/104] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:47 2022] GET /identity/v3/users/90a395c291e4411d9de6fb61b3938bb6 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:48.007370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd537b-caf1-4012-8863-074814d4a9f9 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.007662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd537b-caf1-4012-8863-074814d4a9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.007941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd537b-caf1-4012-8863-074814d4a9f9 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.009180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 51/105] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:48.014898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd537b-caf1-4012-8863-074814d4a9f9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:48.128424 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd537b-caf1-4012-8863-074814d4a9f9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:48.144619 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:48.167187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543c12d-95e2-4238-9fe1-b99353c8bc9a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:48.169528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19878e13-9498-4d48-bbec-5b1494fca27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:48.170343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19878e13-9498-4d48-bbec-5b1494fca27a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.170760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19878e13-9498-4d48-bbec-5b1494fca27a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.171169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19878e13-9498-4d48-bbec-5b1494fca27a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.202114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b82fb-bef2-4917-840f-2e9524129026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:48.202673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b82fb-bef2-4917-840f-2e9524129026 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.202951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b82fb-bef2-4917-840f-2e9524129026 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.203225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b82fb-bef2-4917-840f-2e9524129026 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.204451 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b82fb-bef2-4917-840f-2e9524129026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:48.206373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b82fb-bef2-4917-840f-2e9524129026 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:48.207999 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 55/106] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:58:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:48.209138 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8152b0-9271-4729-bc9a-cd7cf61bd45c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.209414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8152b0-9271-4729-bc9a-cd7cf61bd45c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.209685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8152b0-9271-4729-bc9a-cd7cf61bd45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.228856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4a8152b0-9271-4729-bc9a-cd7cf61bd45c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:48.230049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4a8152b0-9271-4729-bc9a-cd7cf61bd45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:48.251233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:48.262198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19878e13-9498-4d48-bbec-5b1494fca27a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:48.263726 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19878e13-9498-4d48-bbec-5b1494fca27a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:48.299581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 56/107] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:48.300928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ff753-7868-4be4-86d4-a2c7eddb6523 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.301212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ff753-7868-4be4-86d4-a2c7eddb6523 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.301483 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ff753-7868-4be4-86d4-a2c7eddb6523 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.302720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 57/108] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:48.303714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4d200-e5b2-40a4-b0cd-50ad7d320b04 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.303986 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4d200-e5b2-40a4-b0cd-50ad7d320b04 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.304255 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4d200-e5b2-40a4-b0cd-50ad7d320b04 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.309581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 58/109] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:48.310122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4d200-e5b2-40a4-b0cd-50ad7d320b04 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:48.377538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 52/110] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 00:58:48.378992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d436ca-b266-4b82-b0b1-6bfa32536b5c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.379242 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d436ca-b266-4b82-b0b1-6bfa32536b5c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.379513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d436ca-b266-4b82-b0b1-6bfa32536b5c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.380967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 53/111] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:48.381805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310d4d6-9d36-4480-944a-3ed5892ff42c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.382391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310d4d6-9d36-4480-944a-3ed5892ff42c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.382668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310d4d6-9d36-4480-944a-3ed5892ff42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.397066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:48.401099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c310d4d6-9d36-4480-944a-3ed5892ff42c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:48.402451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c310d4d6-9d36-4480-944a-3ed5892ff42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:48.425914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4d200-e5b2-40a4-b0cd-50ad7d320b04 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:48.461309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b75a4-76af-47c8-8206-be16c9ad429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:48.461853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b75a4-76af-47c8-8206-be16c9ad429b None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.462136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b75a4-76af-47c8-8206-be16c9ad429b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.462413 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b75a4-76af-47c8-8206-be16c9ad429b None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.463075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b75a4-76af-47c8-8206-be16c9ad429b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:48.464608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b75a4-76af-47c8-8206-be16c9ad429b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:48.480317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 54/112] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:48.480317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d21b-181c-440a-a056-d7001ed88cdb None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.480317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d21b-181c-440a-a056-d7001ed88cdb None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.480317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d21b-181c-440a-a056-d7001ed88cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.495978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-88e6d21b-181c-440a-a056-d7001ed88cdb None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:48.497201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-88e6d21b-181c-440a-a056-d7001ed88cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:48.505821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 59/113] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 00:58:48 2022] POST /identity/v3/projects => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:58:48.507227 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b75a4-76af-47c8-8206-be16c9ad429b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:48.515353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:48.597489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 55/114] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:48.598967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0a2bc-a3c3-4dda-b03b-b88d5453af7a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.599263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0a2bc-a3c3-4dda-b03b-b88d5453af7a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.599550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0a2bc-a3c3-4dda-b03b-b88d5453af7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.624235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b9f0a2bc-a3c3-4dda-b03b-b88d5453af7a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:48.625505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b9f0a2bc-a3c3-4dda-b03b-b88d5453af7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:48.663669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b75a4-76af-47c8-8206-be16c9ad429b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:48.698865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:48.710476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c733e55-00e5-4ed3-87bd-2c3b8005b044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:48.711727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733e55-00e5-4ed3-87bd-2c3b8005b044 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.712507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733e55-00e5-4ed3-87bd-2c3b8005b044 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.712803 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733e55-00e5-4ed3-87bd-2c3b8005b044 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.714042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c733e55-00e5-4ed3-87bd-2c3b8005b044 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:48.715848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 56/115] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:48.717117 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c733e55-00e5-4ed3-87bd-2c3b8005b044 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:48.719115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 60/116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:48 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:48.720087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0a2bc-a3c3-4dda-b03b-b88d5453af7a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:48.724567 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c733e55-00e5-4ed3-87bd-2c3b8005b044 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:48.841268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c733e55-00e5-4ed3-87bd-2c3b8005b044 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:48.871680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:48.883861 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc15e7-f3ad-4e42-92a7-f6490e473a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:48.884433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc15e7-f3ad-4e42-92a7-f6490e473a2b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.884717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc15e7-f3ad-4e42-92a7-f6490e473a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.884992 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc15e7-f3ad-4e42-92a7-f6490e473a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.885733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc15e7-f3ad-4e42-92a7-f6490e473a2b None admin] RBAC: Adding query filter params (role.id=4cae4d2a35654718bfccd726a5588ba1, scope.project.id=df4081668f8c44e3a8072b71f9f14168, user.id=90a395c291e4411d9de6fb61b3938bb6) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:48.886043 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc15e7-f3ad-4e42-92a7-f6490e473a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:48.887575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc15e7-f3ad-4e42-92a7-f6490e473a2b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:48.893848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 61/117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:58:48 2022] GET /identity/v3/role_assignments?user.id=90a395c291e4411d9de6fb61b3938bb6&scope.project.id=df4081668f8c44e3a8072b71f9f14168&role.id=4cae4d2a35654718bfccd726a5588ba1 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:58:48.894659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc15e7-f3ad-4e42-92a7-f6490e473a2b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:48.895332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0a2bc-a3c3-4dda-b03b-b88d5453af7a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:48.942185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85381237-880a-4005-b67c-9f44dc334e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:48.942896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85381237-880a-4005-b67c-9f44dc334e68 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:48.943173 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85381237-880a-4005-b67c-9f44dc334e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:48.943673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85381237-880a-4005-b67c-9f44dc334e68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:48.960891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85381237-880a-4005-b67c-9f44dc334e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-85381237-880a-4005-b67c-9f44dc334e68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:48.968325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:48.969255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:58:48.970109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 57/118] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:48.970741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85381237-880a-4005-b67c-9f44dc334e68 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:49.004757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:49.053552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc15e7-f3ad-4e42-92a7-f6490e473a2b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:49.097991 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85381237-880a-4005-b67c-9f44dc334e68 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:49.100471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3cdb-1d66-419a-9c19-1169b0569251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:49.101152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3cdb-1d66-419a-9c19-1169b0569251 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:49.101431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3cdb-1d66-419a-9c19-1169b0569251 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:49.103085 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3cdb-1d66-419a-9c19-1169b0569251 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:49.118681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae3cdb-1d66-419a-9c19-1169b0569251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d6ae3cdb-1d66-419a-9c19-1169b0569251 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:49.125188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:49.126059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:49.126901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:49.126901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:49.126901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:49.126901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:49.126901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:49.126901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:49.126901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:49.126901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:49.126901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:49.126901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:49.126901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:58:49.126901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:58:49.127507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 62/119] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:49.128334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3cdb-1d66-419a-9c19-1169b0569251 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:49.143297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e422b-36e2-4fc3-be09-2151239364b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:49.143999 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e422b-36e2-4fc3-be09-2151239364b5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:49.144318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e422b-36e2-4fc3-be09-2151239364b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:49.144579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e422b-36e2-4fc3-be09-2151239364b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:49.166241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e422b-36e2-4fc3-be09-2151239364b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e85e422b-36e2-4fc3-be09-2151239364b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:49.171754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:49.172657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:58:49.173574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 58/120] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:49.174415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e422b-36e2-4fc3-be09-2151239364b5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:49.179017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:49.268693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3cdb-1d66-419a-9c19-1169b0569251 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:49.290898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e422b-36e2-4fc3-be09-2151239364b5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:49.295693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:49.313127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb2708-8d87-41ef-bc67-381b52e4f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:49.314308 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb2708-8d87-41ef-bc67-381b52e4f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:49.314768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb2708-8d87-41ef-bc67-381b52e4f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:49.315055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb2708-8d87-41ef-bc67-381b52e4f5c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:49.315739 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb2708-8d87-41ef-bc67-381b52e4f5c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:49.316046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb2708-8d87-41ef-bc67-381b52e4f5c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:49.317544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb2708-8d87-41ef-bc67-381b52e4f5c5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:49.329820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 63/121] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:49.330918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb2708-8d87-41ef-bc67-381b52e4f5c5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:49.334783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bb59d-f65d-4a19-b6ea-4593c47d2e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:49.335697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bb59d-f65d-4a19-b6ea-4593c47d2e29 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:49.336175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bb59d-f65d-4a19-b6ea-4593c47d2e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:49.336702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bb59d-f65d-4a19-b6ea-4593c47d2e29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:49.348990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bb59d-f65d-4a19-b6ea-4593c47d2e29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-378bb59d-f65d-4a19-b6ea-4593c47d2e29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:49.354650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:49.355519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:49.356332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:49.356332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:49.356332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:49.356332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:49.356332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:49.356332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:49.356332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:49.356332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:49.356332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:49.356332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:49.356332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:58:49.356332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:58:49.363848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 59/122] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:58:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:49.365211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bb59d-f65d-4a19-b6ea-4593c47d2e29 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:49.438916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:49.455580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb2708-8d87-41ef-bc67-381b52e4f5c5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:49.482844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bb59d-f65d-4a19-b6ea-4593c47d2e29 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:49.491309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bfeaa-a46f-4798-a47a-39271017e8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:49.492080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bfeaa-a46f-4798-a47a-39271017e8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:49.492281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bfeaa-a46f-4798-a47a-39271017e8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:49.492575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bfeaa-a46f-4798-a47a-39271017e8c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:49.493246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bfeaa-a46f-4798-a47a-39271017e8c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:49.493548 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bfeaa-a46f-4798-a47a-39271017e8c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:49.495176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bfeaa-a46f-4798-a47a-39271017e8c5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:49.504789 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 64/123] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:58:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:49.505417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bfeaa-a46f-4798-a47a-39271017e8c5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:49.523864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9c991-ecfe-47a7-a4f8-0d889d80419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:49.524981 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9c991-ecfe-47a7-a4f8-0d889d80419a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:49.525527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9c991-ecfe-47a7-a4f8-0d889d80419a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:49.526091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9c991-ecfe-47a7-a4f8-0d889d80419a None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:49.526951 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9c991-ecfe-47a7-a4f8-0d889d80419a None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:49.527448 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9c991-ecfe-47a7-a4f8-0d889d80419a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:49.529266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9c991-ecfe-47a7-a4f8-0d889d80419a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:49.539497 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 60/124] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:58:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:49.540696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9c991-ecfe-47a7-a4f8-0d889d80419a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:49.553539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:49.610580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bfeaa-a46f-4798-a47a-39271017e8c5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:49.651112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8dd15-cbe2-48bd-93e1-3a9811289c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:49.651754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8dd15-cbe2-48bd-93e1-3a9811289c45 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:49.652033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8dd15-cbe2-48bd-93e1-3a9811289c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:49.652314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9c991-ecfe-47a7-a4f8-0d889d80419a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:49.652419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8dd15-cbe2-48bd-93e1-3a9811289c45 None admin] PATH_INFO: `/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:49.653432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8dd15-cbe2-48bd-93e1-3a9811289c45 None admin] RBAC: Authorizing `identity:get_user(user_id=c84cb4aedf5f40eeb73ee0c384202e9a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:49.655795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8dd15-cbe2-48bd-93e1-3a9811289c45 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:49.656735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 65/125] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:49 2022] GET /identity/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:49.657587 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8dd15-cbe2-48bd-93e1-3a9811289c45 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:49.679583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:49.692411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574872ae-c1f8-423f-b7e8-a575545201a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:49.693152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574872ae-c1f8-423f-b7e8-a575545201a4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:49.693539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574872ae-c1f8-423f-b7e8-a575545201a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:49.693925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574872ae-c1f8-423f-b7e8-a575545201a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:49.694755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574872ae-c1f8-423f-b7e8-a575545201a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:49.695157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574872ae-c1f8-423f-b7e8-a575545201a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:49.697244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574872ae-c1f8-423f-b7e8-a575545201a4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:49.706508 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 61/126] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:58:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:49.711900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574872ae-c1f8-423f-b7e8-a575545201a4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:49.765023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8dd15-cbe2-48bd-93e1-3a9811289c45 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:49.779278 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:49.802592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31c6c0-12b2-4b3a-b9cf-bde7f2cbd72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:49.803567 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31c6c0-12b2-4b3a-b9cf-bde7f2cbd72d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:49.803982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31c6c0-12b2-4b3a-b9cf-bde7f2cbd72d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:49.804453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31c6c0-12b2-4b3a-b9cf-bde7f2cbd72d None admin] PATH_INFO: `/v3/users/cb2704ce6ab6495682d66c927e5856fa` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:49.805852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31c6c0-12b2-4b3a-b9cf-bde7f2cbd72d None admin] RBAC: Authorizing `identity:get_user(user_id=cb2704ce6ab6495682d66c927e5856fa)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:49.807618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31c6c0-12b2-4b3a-b9cf-bde7f2cbd72d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:49.809446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 66/127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:49 2022] GET /identity/v3/users/cb2704ce6ab6495682d66c927e5856fa => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:49.810482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31c6c0-12b2-4b3a-b9cf-bde7f2cbd72d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:49.823262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574872ae-c1f8-423f-b7e8-a575545201a4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:49.860865 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74587718-a0b0-4454-8f77-90d67794e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:49.861867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587718-a0b0-4454-8f77-90d67794e13f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:49.862208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587718-a0b0-4454-8f77-90d67794e13f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:49.862543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587718-a0b0-4454-8f77-90d67794e13f None admin] PATH_INFO: `/v3/users/cb2704ce6ab6495682d66c927e5856fa` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:49.863830 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74587718-a0b0-4454-8f77-90d67794e13f None admin] RBAC: Authorizing `identity:get_user(user_id=cb2704ce6ab6495682d66c927e5856fa)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:49.865504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74587718-a0b0-4454-8f77-90d67794e13f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:49.867317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 62/128] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:49 2022] GET /identity/v3/users/cb2704ce6ab6495682d66c927e5856fa => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:49.868168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74587718-a0b0-4454-8f77-90d67794e13f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:49.919521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31c6c0-12b2-4b3a-b9cf-bde7f2cbd72d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:49.930228 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:49.960883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d863f99-6bf4-4799-8537-f12ce45c51bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:49.961935 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d863f99-6bf4-4799-8537-f12ce45c51bf None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:49.962401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d863f99-6bf4-4799-8537-f12ce45c51bf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:49.962882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d863f99-6bf4-4799-8537-f12ce45c51bf None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:49.964282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d863f99-6bf4-4799-8537-f12ce45c51bf None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:49.966119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d863f99-6bf4-4799-8537-f12ce45c51bf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:49.968045 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 67/129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:49 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:49.969006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d863f99-6bf4-4799-8537-f12ce45c51bf None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:49.981352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74587718-a0b0-4454-8f77-90d67794e13f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:50.020252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72147aff-0671-4893-871c-4efec088bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:50.021000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72147aff-0671-4893-871c-4efec088bc73 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:50.021287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72147aff-0671-4893-871c-4efec088bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:50.021570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72147aff-0671-4893-871c-4efec088bc73 None admin] PATH_INFO: `/v3/users/cb2704ce6ab6495682d66c927e5856fa` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:50.023032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:50.023140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72147aff-0671-4893-871c-4efec088bc73 None admin] RBAC: Authorizing `identity:get_user(user_id=cb2704ce6ab6495682d66c927e5856fa)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:50.025518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72147aff-0671-4893-871c-4efec088bc73 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:50.027171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 63/130] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:49 2022] GET /identity/v3/users/cb2704ce6ab6495682d66c927e5856fa => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:50.027976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72147aff-0671-4893-871c-4efec088bc73 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:50.084313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d863f99-6bf4-4799-8537-f12ce45c51bf None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:50.120477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9dd71-ef54-45a0-997d-bf6b845c2024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:50.121514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9dd71-ef54-45a0-997d-bf6b845c2024 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:50.121982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9dd71-ef54-45a0-997d-bf6b845c2024 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:50.122468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9dd71-ef54-45a0-997d-bf6b845c2024 None admin] PATH_INFO: `/v3/projects/8e420c512b844521bc6389ef1db25c0d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:50.123869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9dd71-ef54-45a0-997d-bf6b845c2024 None admin] RBAC: Authorizing `identity:get_project(project_id=8e420c512b844521bc6389ef1db25c0d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:50.125709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9dd71-ef54-45a0-997d-bf6b845c2024 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:50.128022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 68/131] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:49 2022] GET /identity/v3/projects/8e420c512b844521bc6389ef1db25c0d => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:50.129099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9dd71-ef54-45a0-997d-bf6b845c2024 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:50.144696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72147aff-0671-4893-871c-4efec088bc73 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:50.169470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:50.182053 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e311c-d1d1-4fcd-80c4-39703d5af033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:50.182751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e311c-d1d1-4fcd-80c4-39703d5af033 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:50.183033 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e311c-d1d1-4fcd-80c4-39703d5af033 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:50.183313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e311c-d1d1-4fcd-80c4-39703d5af033 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:50.184845 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e311c-d1d1-4fcd-80c4-39703d5af033 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:50.186309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e311c-d1d1-4fcd-80c4-39703d5af033 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:50.188176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 64/132] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:50 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:50.189661 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e311c-d1d1-4fcd-80c4-39703d5af033 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:50.237752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9dd71-ef54-45a0-997d-bf6b845c2024 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:50.255507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:50.274638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09f9c6-3647-475a-bd9f-6e7807ec2b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:50.275682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09f9c6-3647-475a-bd9f-6e7807ec2b1e None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:50.276149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09f9c6-3647-475a-bd9f-6e7807ec2b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:50.276849 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09f9c6-3647-475a-bd9f-6e7807ec2b1e None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168/users/c84cb4aedf5f40eeb73ee0c384202e9a/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:50.279073 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09f9c6-3647-475a-bd9f-6e7807ec2b1e None admin] RBAC: Authorizing `identity:create_grant(project_id=df4081668f8c44e3a8072b71f9f14168, user_id=c84cb4aedf5f40eeb73ee0c384202e9a, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:50.280892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09f9c6-3647-475a-bd9f-6e7807ec2b1e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:50.297690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 69/133] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:58:50 2022] PUT /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168/users/c84cb4aedf5f40eeb73ee0c384202e9a/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:58:50.298876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09f9c6-3647-475a-bd9f-6e7807ec2b1e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:50.300631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e311c-d1d1-4fcd-80c4-39703d5af033 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:50.339295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e502e51-2030-41df-87d1-fba9451549a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:50.339970 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e502e51-2030-41df-87d1-fba9451549a6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:50.340254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e502e51-2030-41df-87d1-fba9451549a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:50.340625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e502e51-2030-41df-87d1-fba9451549a6 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:50.341837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e502e51-2030-41df-87d1-fba9451549a6 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:50.343470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e502e51-2030-41df-87d1-fba9451549a6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:50.345683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 65/134] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:50 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:50.350410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e502e51-2030-41df-87d1-fba9451549a6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:50.414204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09f9c6-3647-475a-bd9f-6e7807ec2b1e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:50.424440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:50.468990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e502e51-2030-41df-87d1-fba9451549a6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:50.507759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd97216-db14-4d67-91fd-8c59fe9f229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:50.508486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97216-db14-4d67-91fd-8c59fe9f229f None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:50.508823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97216-db14-4d67-91fd-8c59fe9f229f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:50.509112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97216-db14-4d67-91fd-8c59fe9f229f None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168/users/cb2704ce6ab6495682d66c927e5856fa/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:50.511071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd97216-db14-4d67-91fd-8c59fe9f229f None admin] RBAC: Authorizing `identity:create_grant(project_id=df4081668f8c44e3a8072b71f9f14168, user_id=cb2704ce6ab6495682d66c927e5856fa, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:50.512691 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd97216-db14-4d67-91fd-8c59fe9f229f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:50.521897 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11a1a-c2f8-4605-aa11-45267c97c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:50.522771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11a1a-c2f8-4605-aa11-45267c97c37b None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:50.522980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11a1a-c2f8-4605-aa11-45267c97c37b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:50.523264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11a1a-c2f8-4605-aa11-45267c97c37b None admin] PATH_INFO: `/v3/projects/8e420c512b844521bc6389ef1db25c0d/users/cb2704ce6ab6495682d66c927e5856fa/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:50.525395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e11a1a-c2f8-4605-aa11-45267c97c37b None admin] RBAC: Authorizing `identity:create_grant(project_id=8e420c512b844521bc6389ef1db25c0d, user_id=cb2704ce6ab6495682d66c927e5856fa, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:50.527200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e11a1a-c2f8-4605-aa11-45267c97c37b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:50.531124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 66/135] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:58:50 2022] PUT /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168/users/cb2704ce6ab6495682d66c927e5856fa/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:58:50.532383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd97216-db14-4d67-91fd-8c59fe9f229f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:50.563264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 70/136] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:58:50 2022] PUT /identity/v3/projects/8e420c512b844521bc6389ef1db25c0d/users/cb2704ce6ab6495682d66c927e5856fa/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:58:50.653496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd97216-db14-4d67-91fd-8c59fe9f229f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:50.674890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:50.695325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e453a4-15f2-459e-93c5-8dc46467c3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:50.696028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e453a4-15f2-459e-93c5-8dc46467c3fb None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:50.696339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e453a4-15f2-459e-93c5-8dc46467c3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:50.696628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e453a4-15f2-459e-93c5-8dc46467c3fb None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168/users/cb2704ce6ab6495682d66c927e5856fa/roles/5f42b81ce88a4943902b63aaaffc1bc2` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:50.698935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e453a4-15f2-459e-93c5-8dc46467c3fb None admin] RBAC: Authorizing `identity:create_grant(project_id=df4081668f8c44e3a8072b71f9f14168, user_id=cb2704ce6ab6495682d66c927e5856fa, role_id=5f42b81ce88a4943902b63aaaffc1bc2)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:50.700621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e453a4-15f2-459e-93c5-8dc46467c3fb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:50.727827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 67/137] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:58:50 2022] PUT /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168/users/cb2704ce6ab6495682d66c927e5856fa/roles/5f42b81ce88a4943902b63aaaffc1bc2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:58:50.865327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de002797-4bdc-4a2a-89c8-de196f423180 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:50.865581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de002797-4bdc-4a2a-89c8-de196f423180 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:50.865866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de002797-4bdc-4a2a-89c8-de196f423180 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:50.867482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 71/138] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:50.873562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08523834-98a6-47bf-8dbe-6960cf5658a2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:50.873938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08523834-98a6-47bf-8dbe-6960cf5658a2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:50.874297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08523834-98a6-47bf-8dbe-6960cf5658a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:50.898599 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-08523834-98a6-47bf-8dbe-6960cf5658a2 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:50.900148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-08523834-98a6-47bf-8dbe-6960cf5658a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:50.981801 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 68/139] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:51.321304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112cba3-ba88-4280-abf1-44a06ee596c0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:51.322346 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112cba3-ba88-4280-abf1-44a06ee596c0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:51.322828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112cba3-ba88-4280-abf1-44a06ee596c0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:51.324417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 72/140] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:51.329896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e8c2-4ff6-4417-802d-69cf0315403c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:51.330398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e8c2-4ff6-4417-802d-69cf0315403c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:51.330866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e8c2-4ff6-4417-802d-69cf0315403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:51.351882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b500e8c2-4ff6-4417-802d-69cf0315403c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:51.353428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b500e8c2-4ff6-4417-802d-69cf0315403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:51.434310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 69/141] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:51.514558 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112cba3-ba88-4280-abf1-44a06ee596c0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:51.556367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:51.624557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112cba3-ba88-4280-abf1-44a06ee596c0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:51.660876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75313559-d867-4d46-be7b-d953b6d6bae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:51.661909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75313559-d867-4d46-be7b-d953b6d6bae4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:51.662412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75313559-d867-4d46-be7b-d953b6d6bae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:51.663209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75313559-d867-4d46-be7b-d953b6d6bae4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:51.664522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75313559-d867-4d46-be7b-d953b6d6bae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:51.666199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75313559-d867-4d46-be7b-d953b6d6bae4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:51.668265 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 73/142] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:58:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:51.673526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500e8c2-4ff6-4417-802d-69cf0315403c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:51.718361 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:51.791291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500e8c2-4ff6-4417-802d-69cf0315403c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:51.834555 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e6b25-1fe6-4594-81cb-ab8a4bece237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:51.835171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e6b25-1fe6-4594-81cb-ab8a4bece237 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:51.835496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e6b25-1fe6-4594-81cb-ab8a4bece237 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:51.835779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e6b25-1fe6-4594-81cb-ab8a4bece237 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:51.836482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e6b25-1fe6-4594-81cb-ab8a4bece237 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:51.838011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e6b25-1fe6-4594-81cb-ab8a4bece237 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:51.863885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75313559-d867-4d46-be7b-d953b6d6bae4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:51.890081 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 70/143] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 00:58:51 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 00:58:51.979986 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75313559-d867-4d46-be7b-d953b6d6bae4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:51.983182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:52.023580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194d77d-1cb2-48dc-8ecf-d2432904a6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:52.024273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194d77d-1cb2-48dc-8ecf-d2432904a6db None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:52.024578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194d77d-1cb2-48dc-8ecf-d2432904a6db None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:52.024843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194d77d-1cb2-48dc-8ecf-d2432904a6db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:52.036646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194d77d-1cb2-48dc-8ecf-d2432904a6db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3194d77d-1cb2-48dc-8ecf-d2432904a6db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:52.047187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:52.048113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:58:52.049624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 74/144] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:58:52.054821 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e6b25-1fe6-4594-81cb-ab8a4bece237 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:52.174710 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:52.181147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e6b25-1fe6-4594-81cb-ab8a4bece237 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:52.223038 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0710ce-dc5b-43fa-9b58-e32e52be3c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:52.223667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0710ce-dc5b-43fa-9b58-e32e52be3c5e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:52.224010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0710ce-dc5b-43fa-9b58-e32e52be3c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:52.224216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0710ce-dc5b-43fa-9b58-e32e52be3c5e None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:52.224932 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0710ce-dc5b-43fa-9b58-e32e52be3c5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:52.225288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0710ce-dc5b-43fa-9b58-e32e52be3c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:52.226761 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0710ce-dc5b-43fa-9b58-e32e52be3c5e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:52.236650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 71/145] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:58:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:52.243192 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194d77d-1cb2-48dc-8ecf-d2432904a6db None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:52.390214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194d77d-1cb2-48dc-8ecf-d2432904a6db None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:52.445778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba227219-9bc0-4502-b281-70d4497b2ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:52.446760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba227219-9bc0-4502-b281-70d4497b2ffa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:52.447298 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba227219-9bc0-4502-b281-70d4497b2ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:52.447774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba227219-9bc0-4502-b281-70d4497b2ffa None admin] PATH_INFO: `/v3/users/90a395c291e4411d9de6fb61b3938bb6` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:52.454347 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba227219-9bc0-4502-b281-70d4497b2ffa None admin] RBAC: Authorizing `identity:get_user(user_id=90a395c291e4411d9de6fb61b3938bb6)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:52.456652 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba227219-9bc0-4502-b281-70d4497b2ffa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:52.458541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 75/146] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:52 2022] GET /identity/v3/users/90a395c291e4411d9de6fb61b3938bb6 => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:52.464087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0710ce-dc5b-43fa-9b58-e32e52be3c5e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:52.620650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0710ce-dc5b-43fa-9b58-e32e52be3c5e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:52.663690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c74f0-90b3-4764-afa0-0584c355e257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:52.664369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c74f0-90b3-4764-afa0-0584c355e257 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:52.664662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c74f0-90b3-4764-afa0-0584c355e257 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:52.664938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c74f0-90b3-4764-afa0-0584c355e257 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:52.668973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c74f0-90b3-4764-afa0-0584c355e257 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:52.670538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c74f0-90b3-4764-afa0-0584c355e257 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:52.672353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 72/147] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:52 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:52.678305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba227219-9bc0-4502-b281-70d4497b2ffa None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:52.725801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:52.810745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba227219-9bc0-4502-b281-70d4497b2ffa None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:52.849625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b692537-345e-42f4-b220-03426fbfddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:52.850293 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b692537-345e-42f4-b220-03426fbfddcf None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:52.850572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b692537-345e-42f4-b220-03426fbfddcf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:52.850842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b692537-345e-42f4-b220-03426fbfddcf None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168/users/90a395c291e4411d9de6fb61b3938bb6/roles/4cae4d2a35654718bfccd726a5588ba1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:52.852774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b692537-345e-42f4-b220-03426fbfddcf None admin] RBAC: Authorizing `identity:create_grant(project_id=df4081668f8c44e3a8072b71f9f14168, user_id=90a395c291e4411d9de6fb61b3938bb6, role_id=4cae4d2a35654718bfccd726a5588ba1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:52.854280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b692537-345e-42f4-b220-03426fbfddcf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:52.872847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 76/148] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:58:52 2022] PUT /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168/users/90a395c291e4411d9de6fb61b3938bb6/roles/4cae4d2a35654718bfccd726a5588ba1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:58:53.178793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9123bd8-2bb3-4ba2-b7f4-f00f4be049cd None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:53.179326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9123bd8-2bb3-4ba2-b7f4-f00f4be049cd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:53.179326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9123bd8-2bb3-4ba2-b7f4-f00f4be049cd None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:53.180711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 73/149] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:53.186268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bc63e-5356-427b-9586-2423221f1b2a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:53.186549 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bc63e-5356-427b-9586-2423221f1b2a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:53.186822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bc63e-5356-427b-9586-2423221f1b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:53.210128 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-881bc63e-5356-427b-9586-2423221f1b2a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:53.211331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-881bc63e-5356-427b-9586-2423221f1b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:53.294653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 77/150] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:53.526111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7a7ab-6fa6-4204-b215-0bda298cafa1 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:53.526404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7a7ab-6fa6-4204-b215-0bda298cafa1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:53.526678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7a7ab-6fa6-4204-b215-0bda298cafa1 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:53.528193 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 74/151] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:53.533845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea524a1-981d-47f6-a3d3-85995cb2ea83 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:53.534418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea524a1-981d-47f6-a3d3-85995cb2ea83 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:53.534418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea524a1-981d-47f6-a3d3-85995cb2ea83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:53.557490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2ea524a1-981d-47f6-a3d3-85995cb2ea83 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:53.558606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2ea524a1-981d-47f6-a3d3-85995cb2ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:53.577649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:53.638502 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 78/152] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:53.674838 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7a7ab-6fa6-4204-b215-0bda298cafa1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:53.689571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d7c4a-a0fe-43c3-9906-4f0c7e75a57e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:53.689890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d7c4a-a0fe-43c3-9906-4f0c7e75a57e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:53.690139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d7c4a-a0fe-43c3-9906-4f0c7e75a57e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:53.691500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 79/153] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 00:58:53.698787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc397576-9c4d-4fc2-8404-d149a3b36f92 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:53.699057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc397576-9c4d-4fc2-8404-d149a3b36f92 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:53.699328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc397576-9c4d-4fc2-8404-d149a3b36f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:53.718354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:53.730948 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-cc397576-9c4d-4fc2-8404-d149a3b36f92 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:53.732160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cc397576-9c4d-4fc2-8404-d149a3b36f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:53.841066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 80/154] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:53.845538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7a7ab-6fa6-4204-b215-0bda298cafa1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:53.894008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d3c6e-216d-4442-9b08-5a3641ceca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:53.894659 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d3c6e-216d-4442-9b08-5a3641ceca30 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:53.894934 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d3c6e-216d-4442-9b08-5a3641ceca30 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:53.895214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d3c6e-216d-4442-9b08-5a3641ceca30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:53.912314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d3c6e-216d-4442-9b08-5a3641ceca30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-909d3c6e-216d-4442-9b08-5a3641ceca30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:53.917998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:53.918894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:58:53.919714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 75/155] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:53.925413 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc397576-9c4d-4fc2-8404-d149a3b36f92 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:54.014738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83f62f-c280-48cc-bcca-f0a5a314ac4b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:54.015079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83f62f-c280-48cc-bcca-f0a5a314ac4b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:54.015288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83f62f-c280-48cc-bcca-f0a5a314ac4b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:54.016761 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 76/156] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:54.022342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1608e-a237-496f-8303-d130c1dafe5d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:54.022622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1608e-a237-496f-8303-d130c1dafe5d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:54.022903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1608e-a237-496f-8303-d130c1dafe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:54.059205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-23b1608e-a237-496f-8303-d130c1dafe5d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:54.064254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-23b1608e-a237-496f-8303-d130c1dafe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:54.064827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:54.099290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc397576-9c4d-4fc2-8404-d149a3b36f92 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:54.177212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05936dad-2d8b-4452-aafc-992a093414a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:54.177836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05936dad-2d8b-4452-aafc-992a093414a9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:54.178113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05936dad-2d8b-4452-aafc-992a093414a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:54.178383 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05936dad-2d8b-4452-aafc-992a093414a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:54.179064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05936dad-2d8b-4452-aafc-992a093414a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:54.179363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05936dad-2d8b-4452-aafc-992a093414a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:54.180856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05936dad-2d8b-4452-aafc-992a093414a9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:54.204416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 81/157] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:58:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:54.205486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05936dad-2d8b-4452-aafc-992a093414a9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:54.206006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 77/158] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:58:54.207362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1608e-a237-496f-8303-d130c1dafe5d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:54.235187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:54.386510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1608e-a237-496f-8303-d130c1dafe5d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:54.445097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a6e29-ef62-407e-9cb5-30488dde33a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:54.445758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a6e29-ef62-407e-9cb5-30488dde33a3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:54.446038 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a6e29-ef62-407e-9cb5-30488dde33a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:54.446309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a6e29-ef62-407e-9cb5-30488dde33a3 None admin] PATH_INFO: `/v3/users/cb2704ce6ab6495682d66c927e5856fa` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:54.447567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a6e29-ef62-407e-9cb5-30488dde33a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cb2704ce6ab6495682d66c927e5856fa)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:54.449141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a6e29-ef62-407e-9cb5-30488dde33a3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:54.450089 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05936dad-2d8b-4452-aafc-992a093414a9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:54.450744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 78/159] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:54 2022] GET /identity/v3/users/cb2704ce6ab6495682d66c927e5856fa => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:54.456252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a6e29-ef62-407e-9cb5-30488dde33a3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:54.502353 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a425b83-1f12-415b-aa8a-86b9c8e0f9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:54.502994 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a425b83-1f12-415b-aa8a-86b9c8e0f9af None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:54.503271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a425b83-1f12-415b-aa8a-86b9c8e0f9af None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:54.503541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a425b83-1f12-415b-aa8a-86b9c8e0f9af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:54.521644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a425b83-1f12-415b-aa8a-86b9c8e0f9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6a425b83-1f12-415b-aa8a-86b9c8e0f9af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:54.526943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:54.527930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:58:54.528770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 82/160] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:58:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:54.541200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a425b83-1f12-415b-aa8a-86b9c8e0f9af None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:54.546696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:54.625422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:54.675973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a6e29-ef62-407e-9cb5-30488dde33a3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:54.677436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a425b83-1f12-415b-aa8a-86b9c8e0f9af None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:54.727863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d912c-8a7d-4366-a127-a57cf4d79b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:54.728511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d912c-8a7d-4366-a127-a57cf4d79b97 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:54.728892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d912c-8a7d-4366-a127-a57cf4d79b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:54.729162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d912c-8a7d-4366-a127-a57cf4d79b97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:54.738355 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2f53-6fa3-4fce-8db7-b3779fb5d2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:54.739010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2f53-6fa3-4fce-8db7-b3779fb5d2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:54.739287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2f53-6fa3-4fce-8db7-b3779fb5d2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:54.739558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2f53-6fa3-4fce-8db7-b3779fb5d2c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:54.758177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af2f53-6fa3-4fce-8db7-b3779fb5d2c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-80af2f53-6fa3-4fce-8db7-b3779fb5d2c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:54.765077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:54.766029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:54.766866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:54.766866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:54.766866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:54.766866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:54.766866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:54.766866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:54.766866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:54.766866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:54.766866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:54.766866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:54.766866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:54.766866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:58:54.770506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 79/161] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:54.771307 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2f53-6fa3-4fce-8db7-b3779fb5d2c1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:54.850316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d912c-8a7d-4366-a127-a57cf4d79b97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:54.852246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d912c-8a7d-4366-a127-a57cf4d79b97 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:54.858071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:54.944775 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2f53-6fa3-4fce-8db7-b3779fb5d2c1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:54.989639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786e83b-d067-4eb5-80c1-cd0a0a4271d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:54.990445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786e83b-d067-4eb5-80c1-cd0a0a4271d5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:54.990724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786e83b-d067-4eb5-80c1-cd0a0a4271d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:54.991105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786e83b-d067-4eb5-80c1-cd0a0a4271d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:54.991791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786e83b-d067-4eb5-80c1-cd0a0a4271d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:54.992089 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786e83b-d067-4eb5-80c1-cd0a0a4271d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:54.993724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786e83b-d067-4eb5-80c1-cd0a0a4271d5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:55.008468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 80/162] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:58:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:55.011545 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786e83b-d067-4eb5-80c1-cd0a0a4271d5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:55.016143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:55.021766 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 83/163] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:58:55.022968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d912c-8a7d-4366-a127-a57cf4d79b97 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:55.135297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d912c-8a7d-4366-a127-a57cf4d79b97 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:55.137894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:55.174852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bc4bb-482a-401a-84cc-525641c533e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:55.175518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bc4bb-482a-401a-84cc-525641c533e2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:55.175796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bc4bb-482a-401a-84cc-525641c533e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:55.176065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bc4bb-482a-401a-84cc-525641c533e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:55.188650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bc4bb-482a-401a-84cc-525641c533e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-1c1bc4bb-482a-401a-84cc-525641c533e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:55.194431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:55.195654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:58:55.196525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 84/164] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:55.197197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bc4bb-482a-401a-84cc-525641c533e2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:55.203512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786e83b-d067-4eb5-80c1-cd0a0a4271d5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:55.273592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201fe8-cbf3-438d-bc6d-3d954199e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:55.274416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201fe8-cbf3-438d-bc6d-3d954199e587 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:55.274640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201fe8-cbf3-438d-bc6d-3d954199e587 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:55.274797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201fe8-cbf3-438d-bc6d-3d954199e587 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:55.275458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201fe8-cbf3-438d-bc6d-3d954199e587 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:55.275760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201fe8-cbf3-438d-bc6d-3d954199e587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:55.277335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201fe8-cbf3-438d-bc6d-3d954199e587 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:55.298512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 81/165] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:55.299450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201fe8-cbf3-438d-bc6d-3d954199e587 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:55.310860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bc4bb-482a-401a-84cc-525641c533e2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:55.348594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac847cf-c5cc-4eec-9d24-a6141d5d274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:55.349232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac847cf-c5cc-4eec-9d24-a6141d5d274e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:55.349507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac847cf-c5cc-4eec-9d24-a6141d5d274e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:55.349776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac847cf-c5cc-4eec-9d24-a6141d5d274e None admin] PATH_INFO: `/v3/users/cb2704ce6ab6495682d66c927e5856fa` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:55.350907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac847cf-c5cc-4eec-9d24-a6141d5d274e None admin] RBAC: Authorizing `identity:get_user(user_id=cb2704ce6ab6495682d66c927e5856fa)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:55.353386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac847cf-c5cc-4eec-9d24-a6141d5d274e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:55.354975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 85/166] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:55 2022] GET /identity/v3/users/cb2704ce6ab6495682d66c927e5856fa => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:55.355995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac847cf-c5cc-4eec-9d24-a6141d5d274e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:55.418666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:55.437355 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:55.484219 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201fe8-cbf3-438d-bc6d-3d954199e587 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:55.549575 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de152ce-e4de-443d-ba2d-d6280491b326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:55.550221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de152ce-e4de-443d-ba2d-d6280491b326 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:55.550494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de152ce-e4de-443d-ba2d-d6280491b326 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:55.550762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de152ce-e4de-443d-ba2d-d6280491b326 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:55.552106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de152ce-e4de-443d-ba2d-d6280491b326 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:55.553650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de152ce-e4de-443d-ba2d-d6280491b326 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:55.556592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 82/167] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:55 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:55.559343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de152ce-e4de-443d-ba2d-d6280491b326 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:55.562374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac847cf-c5cc-4eec-9d24-a6141d5d274e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:55.619886 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29441f0-a74f-41d9-b5af-1bc44057a5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:55.620528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29441f0-a74f-41d9-b5af-1bc44057a5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:55.620805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29441f0-a74f-41d9-b5af-1bc44057a5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:55.621070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29441f0-a74f-41d9-b5af-1bc44057a5a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:55.621738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29441f0-a74f-41d9-b5af-1bc44057a5a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:55.622033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29441f0-a74f-41d9-b5af-1bc44057a5a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:55.623448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29441f0-a74f-41d9-b5af-1bc44057a5a2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:55.640087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 86/168] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:58:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:55.640974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29441f0-a74f-41d9-b5af-1bc44057a5a2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:55.709624 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de152ce-e4de-443d-ba2d-d6280491b326 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:55.757116 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:55.766094 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24a6f7-653b-4b3a-952e-822149885e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:55.767708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24a6f7-653b-4b3a-952e-822149885e1b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:55.768464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24a6f7-653b-4b3a-952e-822149885e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:55.769127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24a6f7-653b-4b3a-952e-822149885e1b None admin] PATH_INFO: `/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:55.771140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29441f0-a74f-41d9-b5af-1bc44057a5a2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:55.773853 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24a6f7-653b-4b3a-952e-822149885e1b None admin] RBAC: Authorizing `identity:get_user(user_id=c84cb4aedf5f40eeb73ee0c384202e9a)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:55.775603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24a6f7-653b-4b3a-952e-822149885e1b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:55.778877 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 83/169] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:55 2022] GET /identity/v3/users/c84cb4aedf5f40eeb73ee0c384202e9a => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:55.779879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24a6f7-653b-4b3a-952e-822149885e1b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:55.808664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:55.850982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9eceb-33b4-492d-bc9b-9684666b37be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:55.851616 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9eceb-33b4-492d-bc9b-9684666b37be None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:55.851899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9eceb-33b4-492d-bc9b-9684666b37be None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:55.852165 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9eceb-33b4-492d-bc9b-9684666b37be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:55.997351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24a6f7-653b-4b3a-952e-822149885e1b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:55.998173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9eceb-33b4-492d-bc9b-9684666b37be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:56.000335 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9eceb-33b4-492d-bc9b-9684666b37be None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:56.074036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd85064-6143-48fb-a2d2-43fc041a3558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:56.074665 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd85064-6143-48fb-a2d2-43fc041a3558 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:56.074943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd85064-6143-48fb-a2d2-43fc041a3558 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:56.075214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd85064-6143-48fb-a2d2-43fc041a3558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:56.075955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd85064-6143-48fb-a2d2-43fc041a3558 None admin] RBAC: Adding query filter params (role.id=948a63d9dffa4bdb815a397570a1d381, scope.project.id=df4081668f8c44e3a8072b71f9f14168, user.id=cb2704ce6ab6495682d66c927e5856fa) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:56.076264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd85064-6143-48fb-a2d2-43fc041a3558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:56.077784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd85064-6143-48fb-a2d2-43fc041a3558 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:56.098486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 84/170] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:58:55 2022] GET /identity/v3/role_assignments?user.id=cb2704ce6ab6495682d66c927e5856fa&scope.project.id=df4081668f8c44e3a8072b71f9f14168&role.id=948a63d9dffa4bdb815a397570a1d381 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:56.099421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd85064-6143-48fb-a2d2-43fc041a3558 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:56.170910 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:56.184085 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 87/171] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:58:56.185028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9eceb-33b4-492d-bc9b-9684666b37be None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:56.243796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:56.306345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd85064-6143-48fb-a2d2-43fc041a3558 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:56.341226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9eceb-33b4-492d-bc9b-9684666b37be None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:56.366648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7947b3-aed3-4381-bbc4-0541888607dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:56.367308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7947b3-aed3-4381-bbc4-0541888607dc None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:56.367585 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7947b3-aed3-4381-bbc4-0541888607dc None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:56.367856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7947b3-aed3-4381-bbc4-0541888607dc None admin] PATH_INFO: `/v3/users/cb2704ce6ab6495682d66c927e5856fa` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:56.369211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7947b3-aed3-4381-bbc4-0541888607dc None admin] RBAC: Authorizing `identity:get_user(user_id=cb2704ce6ab6495682d66c927e5856fa)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:56.370868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7947b3-aed3-4381-bbc4-0541888607dc None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:56.376670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 85/172] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:56 2022] GET /identity/v3/users/cb2704ce6ab6495682d66c927e5856fa => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:56.378602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7947b3-aed3-4381-bbc4-0541888607dc None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:56.386153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4b37d-8f79-4cfd-82e2-6bf5fea2eeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:56.387044 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4b37d-8f79-4cfd-82e2-6bf5fea2eeee None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:56.389735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4b37d-8f79-4cfd-82e2-6bf5fea2eeee None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:56.390193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4b37d-8f79-4cfd-82e2-6bf5fea2eeee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:56.481423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:56.493185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4b37d-8f79-4cfd-82e2-6bf5fea2eeee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:56.495445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4b37d-8f79-4cfd-82e2-6bf5fea2eeee None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:56.504699 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7947b3-aed3-4381-bbc4-0541888607dc None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:56.551091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17db2d-bf17-4f69-82d2-469366cd1d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:56.551743 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17db2d-bf17-4f69-82d2-469366cd1d99 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:56.552021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17db2d-bf17-4f69-82d2-469366cd1d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:56.552317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17db2d-bf17-4f69-82d2-469366cd1d99 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:56.553654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17db2d-bf17-4f69-82d2-469366cd1d99 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:56.555174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17db2d-bf17-4f69-82d2-469366cd1d99 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:56.556948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 86/173] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:56 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:56.558058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a098-4058-459b-a05c-3aff6a659106 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:56.558522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a098-4058-459b-a05c-3aff6a659106 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:56.558630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a098-4058-459b-a05c-3aff6a659106 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:56.560004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 87/174] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:56.564979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a098-4058-459b-a05c-3aff6a659106 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:56.569797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:56.647236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 88/175] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:58:56.647236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766c2fa-6271-4124-ad41-caa3c0789e7a None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:56.647236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766c2fa-6271-4124-ad41-caa3c0789e7a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:56.647236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766c2fa-6271-4124-ad41-caa3c0789e7a None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:56.647236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 89/176] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:56.648337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a251f1-fcac-403d-8392-966f78339169 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:56.648599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a251f1-fcac-403d-8392-966f78339169 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:56.649000 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a251f1-fcac-403d-8392-966f78339169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:56.670931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e7a251f1-fcac-403d-8392-966f78339169 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:56.672277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e7a251f1-fcac-403d-8392-966f78339169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:56.699214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a098-4058-459b-a05c-3aff6a659106 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:56.736622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5bdf0-5529-4a2e-af49-77b57e7a3b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:56.737247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5bdf0-5529-4a2e-af49-77b57e7a3b92 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:56.737530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5bdf0-5529-4a2e-af49-77b57e7a3b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:56.737812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5bdf0-5529-4a2e-af49-77b57e7a3b92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:56.748384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 90/177] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:56.753302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a251f1-fcac-403d-8392-966f78339169 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:56.786684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:56.818372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5bdf0-5529-4a2e-af49-77b57e7a3b92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:56.820742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5bdf0-5529-4a2e-af49-77b57e7a3b92 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:56.823724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:56.875560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a251f1-fcac-403d-8392-966f78339169 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:56.920450 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d0a60-5b4b-4326-81eb-2935df3765a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:56.921594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d0a60-5b4b-4326-81eb-2935df3765a2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:56.922112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d0a60-5b4b-4326-81eb-2935df3765a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:56.922723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d0a60-5b4b-4326-81eb-2935df3765a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:56.923991 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d0a60-5b4b-4326-81eb-2935df3765a2 None admin] RBAC: Adding query filter params (role.id=5f42b81ce88a4943902b63aaaffc1bc2, scope.project.id=df4081668f8c44e3a8072b71f9f14168, user.id=cb2704ce6ab6495682d66c927e5856fa) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:56.924512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d0a60-5b4b-4326-81eb-2935df3765a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:56.926253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d0a60-5b4b-4326-81eb-2935df3765a2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:56.935028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 91/178] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:58:56 2022] GET /identity/v3/role_assignments?user.id=cb2704ce6ab6495682d66c927e5856fa&scope.project.id=df4081668f8c44e3a8072b71f9f14168&role.id=5f42b81ce88a4943902b63aaaffc1bc2 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:56.937132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31f22e-9c29-4abf-8593-4bb2d85d0eed None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:56.937653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31f22e-9c29-4abf-8593-4bb2d85d0eed None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:56.938145 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31f22e-9c29-4abf-8593-4bb2d85d0eed None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:56.939734 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 92/179] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:56.940143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 88/180] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:58:56.941268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5bdf0-5529-4a2e-af49-77b57e7a3b92 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:56.941508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23551e17-248a-4fb6-b1be-b8ca2e5f6153 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:56.941950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23551e17-248a-4fb6-b1be-b8ca2e5f6153 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:56.942387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23551e17-248a-4fb6-b1be-b8ca2e5f6153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:56.965999 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-23551e17-248a-4fb6-b1be-b8ca2e5f6153 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:56.968015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-23551e17-248a-4fb6-b1be-b8ca2e5f6153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:57.069573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5bdf0-5529-4a2e-af49-77b57e7a3b92 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:57.071682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:57.077640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 93/181] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:57.085247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23551e17-248a-4fb6-b1be-b8ca2e5f6153 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:57.102845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:57.119006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2b683-b9a8-432d-9554-6fe186f92f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:57.119652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2b683-b9a8-432d-9554-6fe186f92f1d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:57.119924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2b683-b9a8-432d-9554-6fe186f92f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:57.120189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2b683-b9a8-432d-9554-6fe186f92f1d None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:57.121566 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2b683-b9a8-432d-9554-6fe186f92f1d None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:57.123257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2b683-b9a8-432d-9554-6fe186f92f1d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:57.129488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 89/182] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:56 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:57.129488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c9da-c919-4b40-ac55-846e86636eba None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:57.129488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c9da-c919-4b40-ac55-846e86636eba None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:57.129488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c9da-c919-4b40-ac55-846e86636eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:57.147391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a565c9da-c919-4b40-ac55-846e86636eba None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:57.149177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a565c9da-c919-4b40-ac55-846e86636eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:57.195398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23551e17-248a-4fb6-b1be-b8ca2e5f6153 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:57.232966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 90/183] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:57.234850 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d08a8-d98a-4725-a5e2-937f31e9f49a None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:57.235425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d08a8-d98a-4725-a5e2-937f31e9f49a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:57.235891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d08a8-d98a-4725-a5e2-937f31e9f49a None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:57.237465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 91/184] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:58:57.238425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d08a8-d98a-4725-a5e2-937f31e9f49a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:57.243769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0091c86-1f05-4303-b9a5-904ee62ab72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:57.245181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0091c86-1f05-4303-b9a5-904ee62ab72c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:57.245181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0091c86-1f05-4303-b9a5-904ee62ab72c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:57.245181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0091c86-1f05-4303-b9a5-904ee62ab72c None admin] PATH_INFO: `/v3/projects/8e420c512b844521bc6389ef1db25c0d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:57.246226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0091c86-1f05-4303-b9a5-904ee62ab72c None admin] RBAC: Authorizing `identity:get_project(project_id=8e420c512b844521bc6389ef1db25c0d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:57.247791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0091c86-1f05-4303-b9a5-904ee62ab72c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:57.249683 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 94/185] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:57 2022] GET /identity/v3/projects/8e420c512b844521bc6389ef1db25c0d => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:57.250273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0091c86-1f05-4303-b9a5-904ee62ab72c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:57.342808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:57.360384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0091c86-1f05-4303-b9a5-904ee62ab72c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:57.371639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:57.377416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d08a8-d98a-4725-a5e2-937f31e9f49a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:57.396982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f06966-33f4-4edf-bac4-9b40ef465490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:57.397599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f06966-33f4-4edf-bac4-9b40ef465490 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:57.397878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f06966-33f4-4edf-bac4-9b40ef465490 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:57.398147 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f06966-33f4-4edf-bac4-9b40ef465490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:57.398881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f06966-33f4-4edf-bac4-9b40ef465490 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=df4081668f8c44e3a8072b71f9f14168, user.id=c84cb4aedf5f40eeb73ee0c384202e9a) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:57.399189 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f06966-33f4-4edf-bac4-9b40ef465490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:57.400721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f06966-33f4-4edf-bac4-9b40ef465490 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:57.407222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 95/186] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:58:57 2022] GET /identity/v3/role_assignments?user.id=c84cb4aedf5f40eeb73ee0c384202e9a&scope.project.id=df4081668f8c44e3a8072b71f9f14168&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:57.408506 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1549ac-d8f7-4231-b090-6b35adf16991 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:57.408792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1549ac-d8f7-4231-b090-6b35adf16991 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:57.409066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1549ac-d8f7-4231-b090-6b35adf16991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:57.420963 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32213027-ed9e-4f04-a1e0-d7740bbdb5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:57.422118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32213027-ed9e-4f04-a1e0-d7740bbdb5bb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:57.422829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32213027-ed9e-4f04-a1e0-d7740bbdb5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:57.424360 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32213027-ed9e-4f04-a1e0-d7740bbdb5bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:57.430844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-af1549ac-d8f7-4231-b090-6b35adf16991 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:58:57.432449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-af1549ac-d8f7-4231-b090-6b35adf16991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:58:57.441243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32213027-ed9e-4f04-a1e0-d7740bbdb5bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-32213027-ed9e-4f04-a1e0-d7740bbdb5bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:57.449011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:57.450010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:57.450833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:57.450833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:57.450833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:57.450833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:57.450833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:57.450833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:57.450833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:57.450833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:57.450833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:57.450833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:57.450833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:58:57.450833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:58:57.453896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 92/187] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:57.455104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32213027-ed9e-4f04-a1e0-d7740bbdb5bb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:57.518848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 96/188] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:58:57.520007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1549ac-d8f7-4231-b090-6b35adf16991 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:57.592408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32213027-ed9e-4f04-a1e0-d7740bbdb5bb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:57.624062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:57.638776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e334b6-bba4-4ced-aebf-aa3bac2867e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:57.639648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e334b6-bba4-4ced-aebf-aa3bac2867e8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:57.639930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e334b6-bba4-4ced-aebf-aa3bac2867e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:57.640636 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e334b6-bba4-4ced-aebf-aa3bac2867e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:57.641594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e334b6-bba4-4ced-aebf-aa3bac2867e8 None admin] RBAC: Adding query filter params (role.id=948a63d9dffa4bdb815a397570a1d381, scope.project.id=8e420c512b844521bc6389ef1db25c0d, user.id=cb2704ce6ab6495682d66c927e5856fa) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:57.641940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e334b6-bba4-4ced-aebf-aa3bac2867e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:57.643471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e334b6-bba4-4ced-aebf-aa3bac2867e8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:57.650757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 93/189] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:58:57 2022] GET /identity/v3/role_assignments?user.id=cb2704ce6ab6495682d66c927e5856fa&scope.project.id=8e420c512b844521bc6389ef1db25c0d&role.id=948a63d9dffa4bdb815a397570a1d381 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:57.651487 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e334b6-bba4-4ced-aebf-aa3bac2867e8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:57.658756 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1549ac-d8f7-4231-b090-6b35adf16991 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:57.694576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:57.713541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d09f5-a211-40df-9709-bfe378da57b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:57.714714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d09f5-a211-40df-9709-bfe378da57b4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:57.715238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d09f5-a211-40df-9709-bfe378da57b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:57.715699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d09f5-a211-40df-9709-bfe378da57b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:57.728887 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d09f5-a211-40df-9709-bfe378da57b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-994d09f5-a211-40df-9709-bfe378da57b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:57.734691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:57.735719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:57.736561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:57.736561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:57.736561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:57.736561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:57.736561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:57.736561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:57.736561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:57.736561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:57.736561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:57.736561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:57.736561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:58:57.736561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:58:57.739101 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 97/190] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:58:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:57.740264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d09f5-a211-40df-9709-bfe378da57b4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:57.783837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e334b6-bba4-4ced-aebf-aa3bac2867e8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:57.822764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf548a7-0498-40f9-9b37-82b7f5165f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:57.823388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf548a7-0498-40f9-9b37-82b7f5165f49 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:57.823667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf548a7-0498-40f9-9b37-82b7f5165f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:57.823941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf548a7-0498-40f9-9b37-82b7f5165f49 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:57.824647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf548a7-0498-40f9-9b37-82b7f5165f49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:57.824950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf548a7-0498-40f9-9b37-82b7f5165f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:57.826960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf548a7-0498-40f9-9b37-82b7f5165f49 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:57.837888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 94/191] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:58:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:57.838641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf548a7-0498-40f9-9b37-82b7f5165f49 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:57.859130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d09f5-a211-40df-9709-bfe378da57b4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:57.901527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fdf61-4bb0-4b75-b83e-4e4124deb751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:57.902088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fdf61-4bb0-4b75-b83e-4e4124deb751 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:57.902365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fdf61-4bb0-4b75-b83e-4e4124deb751 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:57.902636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fdf61-4bb0-4b75-b83e-4e4124deb751 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:57.911629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:57.916920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fdf61-4bb0-4b75-b83e-4e4124deb751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-631fdf61-4bb0-4b75-b83e-4e4124deb751 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:58:57.921828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:58:57.922950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 98/192] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:58:57.925218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fdf61-4bb0-4b75-b83e-4e4124deb751 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:57.941955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:57.957979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf548a7-0498-40f9-9b37-82b7f5165f49 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:57.991298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0a071-0be0-4d3f-832c-a14dc0c169d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:57.991912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0a071-0be0-4d3f-832c-a14dc0c169d6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:57.992191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0a071-0be0-4d3f-832c-a14dc0c169d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:57.992486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0a071-0be0-4d3f-832c-a14dc0c169d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:57.993150 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0a071-0be0-4d3f-832c-a14dc0c169d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:57.993454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0a071-0be0-4d3f-832c-a14dc0c169d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:57.994931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0a071-0be0-4d3f-832c-a14dc0c169d6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:58.002918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 95/193] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:58:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:58.003716 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0a071-0be0-4d3f-832c-a14dc0c169d6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:58.029287 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fdf61-4bb0-4b75-b83e-4e4124deb751 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:58.066173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42191b-488f-4970-a444-8fc1b7fedbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:58.066807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42191b-488f-4970-a444-8fc1b7fedbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:58.067083 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42191b-488f-4970-a444-8fc1b7fedbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:58.067354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42191b-488f-4970-a444-8fc1b7fedbb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:58.068489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42191b-488f-4970-a444-8fc1b7fedbb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:58.069995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42191b-488f-4970-a444-8fc1b7fedbb7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:58.071563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 99/194] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:58:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:58.072343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42191b-488f-4970-a444-8fc1b7fedbb7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:58.107298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0a071-0be0-4d3f-832c-a14dc0c169d6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:58.137653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:58.141025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6f34c-60c8-49c7-b365-cad3ef6703a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:58.141966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6f34c-60c8-49c7-b365-cad3ef6703a6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:58.142250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6f34c-60c8-49c7-b365-cad3ef6703a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:58.142533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6f34c-60c8-49c7-b365-cad3ef6703a6 None admin] PATH_INFO: `/v3/users/90a395c291e4411d9de6fb61b3938bb6` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:58.143681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6f34c-60c8-49c7-b365-cad3ef6703a6 None admin] RBAC: Authorizing `identity:get_user(user_id=90a395c291e4411d9de6fb61b3938bb6)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:58.145213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6f34c-60c8-49c7-b365-cad3ef6703a6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:58.146813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 96/195] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:58 2022] GET /identity/v3/users/90a395c291e4411d9de6fb61b3938bb6 => generated 289 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:58.147570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6f34c-60c8-49c7-b365-cad3ef6703a6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:58.169244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:58.172834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42191b-488f-4970-a444-8fc1b7fedbb7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:58.208966 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38634c04-62f6-45ea-85c7-8fbdde336903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:58.209577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38634c04-62f6-45ea-85c7-8fbdde336903 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:58.209849 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38634c04-62f6-45ea-85c7-8fbdde336903 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:58.210127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38634c04-62f6-45ea-85c7-8fbdde336903 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:58.210791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38634c04-62f6-45ea-85c7-8fbdde336903 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:58.211094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38634c04-62f6-45ea-85c7-8fbdde336903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:58.212549 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38634c04-62f6-45ea-85c7-8fbdde336903 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:58.225182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 100/196] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:58.225182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38634c04-62f6-45ea-85c7-8fbdde336903 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:58.253870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6f34c-60c8-49c7-b365-cad3ef6703a6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:58.287233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0108e-d126-43ce-905d-7bbe668518a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:58.288207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0108e-d126-43ce-905d-7bbe668518a6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:58.288510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0108e-d126-43ce-905d-7bbe668518a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:58.288780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0108e-d126-43ce-905d-7bbe668518a6 None admin] PATH_INFO: `/v3/users/522d276b21e94fa6be93252d513810f8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:58.302291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0108e-d126-43ce-905d-7bbe668518a6 None admin] RBAC: Authorizing `identity:get_user(user_id=522d276b21e94fa6be93252d513810f8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:58.303800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0108e-d126-43ce-905d-7bbe668518a6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:58.305451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 97/197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:58 2022] GET /identity/v3/users/522d276b21e94fa6be93252d513810f8 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:58.306210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0108e-d126-43ce-905d-7bbe668518a6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:58.330875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38634c04-62f6-45ea-85c7-8fbdde336903 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:58.359428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:58.366403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b73ef5-c803-4989-a4f0-aba3b9d49688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:58.367016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b73ef5-c803-4989-a4f0-aba3b9d49688 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:58.367292 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b73ef5-c803-4989-a4f0-aba3b9d49688 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:58.367571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b73ef5-c803-4989-a4f0-aba3b9d49688 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:58.368224 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b73ef5-c803-4989-a4f0-aba3b9d49688 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:58.369771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b73ef5-c803-4989-a4f0-aba3b9d49688 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:58.383964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:58.391416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 101/198] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 00:58:58 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:58:58.392885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b73ef5-c803-4989-a4f0-aba3b9d49688 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:58.419997 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0108e-d126-43ce-905d-7bbe668518a6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:58.462387 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4e970-d5a6-4a26-972e-a8da455a8362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:58.463017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e970-d5a6-4a26-972e-a8da455a8362 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:58.463294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e970-d5a6-4a26-972e-a8da455a8362 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:58.463558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e970-d5a6-4a26-972e-a8da455a8362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:58.513456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b73ef5-c803-4989-a4f0-aba3b9d49688 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:58.542224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4e970-d5a6-4a26-972e-a8da455a8362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:58.543912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4e970-d5a6-4a26-972e-a8da455a8362 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:58.557303 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892744f-7a70-4f5c-af35-e7c9ba3367ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:58.557900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892744f-7a70-4f5c-af35-e7c9ba3367ba None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:58.558176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892744f-7a70-4f5c-af35-e7c9ba3367ba None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:58.558446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892744f-7a70-4f5c-af35-e7c9ba3367ba None admin] PATH_INFO: `/v3/users/522d276b21e94fa6be93252d513810f8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:58.559657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892744f-7a70-4f5c-af35-e7c9ba3367ba None admin] RBAC: Authorizing `identity:get_user(user_id=522d276b21e94fa6be93252d513810f8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:58.561188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892744f-7a70-4f5c-af35-e7c9ba3367ba None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:58.562767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 102/199] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:58:58 2022] GET /identity/v3/users/522d276b21e94fa6be93252d513810f8 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:58.563759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892744f-7a70-4f5c-af35-e7c9ba3367ba None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:58.636124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:58.658527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:58.689518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 98/200] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:58:58.689843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892744f-7a70-4f5c-af35-e7c9ba3367ba None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:58.690757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4e970-d5a6-4a26-972e-a8da455a8362 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:58.730824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c191e-5f3f-4661-8f15-de2306e67646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:58.731837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c191e-5f3f-4661-8f15-de2306e67646 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:58.731837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c191e-5f3f-4661-8f15-de2306e67646 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:58.732222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c191e-5f3f-4661-8f15-de2306e67646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:58.811502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4e970-d5a6-4a26-972e-a8da455a8362 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:58.815011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c191e-5f3f-4661-8f15-de2306e67646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:58.816818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c191e-5f3f-4661-8f15-de2306e67646 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:58.849313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cd2cb-466d-4a74-9bd0-9d536a2f2285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:58.850126 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cd2cb-466d-4a74-9bd0-9d536a2f2285 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:58.850496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cd2cb-466d-4a74-9bd0-9d536a2f2285 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:58.850867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cd2cb-466d-4a74-9bd0-9d536a2f2285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:58.884454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:58.900531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:58.942267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 103/201] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:58:58.943372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c191e-5f3f-4661-8f15-de2306e67646 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:58.950053 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cd2cb-466d-4a74-9bd0-9d536a2f2285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:58.952509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cd2cb-466d-4a74-9bd0-9d536a2f2285 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:59.090023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c191e-5f3f-4661-8f15-de2306e67646 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:59.121923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 99/202] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:58:59.122773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cd2cb-466d-4a74-9bd0-9d536a2f2285 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:59.132358 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113f8e6-bbc1-4be7-8ad5-7c4eece76e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:59.133324 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113f8e6-bbc1-4be7-8ad5-7c4eece76e8d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:59.133829 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113f8e6-bbc1-4be7-8ad5-7c4eece76e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:59.134345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113f8e6-bbc1-4be7-8ad5-7c4eece76e8d None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:59.135682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113f8e6-bbc1-4be7-8ad5-7c4eece76e8d None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:59.137533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113f8e6-bbc1-4be7-8ad5-7c4eece76e8d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:59.139397 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 104/203] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:58 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:59.140398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113f8e6-bbc1-4be7-8ad5-7c4eece76e8d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:59.168007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:59.251903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113f8e6-bbc1-4be7-8ad5-7c4eece76e8d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:59.270866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:59.291846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491a632-c92a-44b5-b4d0-c342743742fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:59.292943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491a632-c92a-44b5-b4d0-c342743742fa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:59.293441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491a632-c92a-44b5-b4d0-c342743742fa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:59.294005 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491a632-c92a-44b5-b4d0-c342743742fa None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:59.295701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491a632-c92a-44b5-b4d0-c342743742fa None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:59.297643 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491a632-c92a-44b5-b4d0-c342743742fa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:59.299911 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 105/204] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:59 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:59.301352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491a632-c92a-44b5-b4d0-c342743742fa None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:59.319515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cd2cb-466d-4a74-9bd0-9d536a2f2285 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:59.397770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:58:59.410042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491a632-c92a-44b5-b4d0-c342743742fa None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:59.427898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252a33-e32a-41a3-8018-9919e935276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:59.429768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252a33-e32a-41a3-8018-9919e935276b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:59.429768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252a33-e32a-41a3-8018-9919e935276b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:59.430693 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252a33-e32a-41a3-8018-9919e935276b None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:59.435592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4252a33-e32a-41a3-8018-9919e935276b None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:59.437188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4252a33-e32a-41a3-8018-9919e935276b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:59.439147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 100/205] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:58:59 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:59.440026 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252a33-e32a-41a3-8018-9919e935276b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:59.459875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dca5f-7a27-428f-8512-c8ab0ef7c94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:59.460891 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dca5f-7a27-428f-8512-c8ab0ef7c94b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:59.461387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dca5f-7a27-428f-8512-c8ab0ef7c94b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:59.462142 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dca5f-7a27-428f-8512-c8ab0ef7c94b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:59.463131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dca5f-7a27-428f-8512-c8ab0ef7c94b None admin] RBAC: Adding query filter params (role.id=4cae4d2a35654718bfccd726a5588ba1, scope.project.id=df4081668f8c44e3a8072b71f9f14168, user.id=90a395c291e4411d9de6fb61b3938bb6) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:59.463672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dca5f-7a27-428f-8512-c8ab0ef7c94b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:59.465532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dca5f-7a27-428f-8512-c8ab0ef7c94b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:59.473442 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 106/206] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:58:59 2022] GET /identity/v3/role_assignments?user.id=90a395c291e4411d9de6fb61b3938bb6&scope.project.id=df4081668f8c44e3a8072b71f9f14168&role.id=4cae4d2a35654718bfccd726a5588ba1 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:59.474685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dca5f-7a27-428f-8512-c8ab0ef7c94b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:58:59.592046 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252a33-e32a-41a3-8018-9919e935276b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:59.636657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33cb05-77d7-4f94-a3ab-df2b71fc29e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:59.637294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33cb05-77d7-4f94-a3ab-df2b71fc29e9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:59.637568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33cb05-77d7-4f94-a3ab-df2b71fc29e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:59.637839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33cb05-77d7-4f94-a3ab-df2b71fc29e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:59.638591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33cb05-77d7-4f94-a3ab-df2b71fc29e9 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1, user.id=522d276b21e94fa6be93252d513810f8) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:59.638903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33cb05-77d7-4f94-a3ab-df2b71fc29e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:59.646032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33cb05-77d7-4f94-a3ab-df2b71fc29e9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:59.656064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dca5f-7a27-428f-8512-c8ab0ef7c94b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:58:59.656225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 101/207] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:58:59 2022] GET /identity/v3/role_assignments?user.id=522d276b21e94fa6be93252d513810f8&scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:58:59.701863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bab272-d083-4cd1-bf04-4f21d0a0546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:58:59.703183 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bab272-d083-4cd1-bf04-4f21d0a0546a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:58:59.703597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bab272-d083-4cd1-bf04-4f21d0a0546a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:58:59.704084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bab272-d083-4cd1-bf04-4f21d0a0546a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:58:59.705034 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bab272-d083-4cd1-bf04-4f21d0a0546a None admin] RBAC: Adding query filter params (role.id=5f42b81ce88a4943902b63aaaffc1bc2, scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1, user.id=522d276b21e94fa6be93252d513810f8) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:58:59.705483 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bab272-d083-4cd1-bf04-4f21d0a0546a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:58:59.707204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bab272-d083-4cd1-bf04-4f21d0a0546a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:58:59.714564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 107/208] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:58:59 2022] GET /identity/v3/role_assignments?user.id=522d276b21e94fa6be93252d513810f8&scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1&role.id=5f42b81ce88a4943902b63aaaffc1bc2 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:00.577401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf810f-d61b-4692-961d-b95eda07283e None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:00.577931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf810f-d61b-4692-961d-b95eda07283e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:00.578228 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf810f-d61b-4692-961d-b95eda07283e None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:00.579810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 102/209] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:00.585198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42c1b6-239d-4425-ab23-176e50f9f7a4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:00.585482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42c1b6-239d-4425-ab23-176e50f9f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:00.585753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42c1b6-239d-4425-ab23-176e50f9f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:00.604950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4e42c1b6-239d-4425-ab23-176e50f9f7a4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:00.606228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4e42c1b6-239d-4425-ab23-176e50f9f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:00.607015 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8369e-3b43-47ac-b13e-395b5911147a None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:00.607295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8369e-3b43-47ac-b13e-395b5911147a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:00.607568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8369e-3b43-47ac-b13e-395b5911147a None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:00.609208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 103/210] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 00:59:00.614399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8babc0-57d4-461b-89d2-64bb3446acc9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:00.614680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8babc0-57d4-461b-89d2-64bb3446acc9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:00.614950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8babc0-57d4-461b-89d2-64bb3446acc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:00.621198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:00.629392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:00.638572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0a8babc0-57d4-461b-89d2-64bb3446acc9 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:00.640731 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0a8babc0-57d4-461b-89d2-64bb3446acc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:00.684403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 108/211] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:00.724396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 104/212] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:00.947628 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42c1b6-239d-4425-ab23-176e50f9f7a4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:00.996384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8babc0-57d4-461b-89d2-64bb3446acc9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:01.069344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42c1b6-239d-4425-ab23-176e50f9f7a4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:01.107715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2495c8c-42cd-4fb8-9bdc-9e98665865aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:01.108633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2495c8c-42cd-4fb8-9bdc-9e98665865aa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:01.108932 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2495c8c-42cd-4fb8-9bdc-9e98665865aa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:01.109248 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2495c8c-42cd-4fb8-9bdc-9e98665865aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:01.115346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8babc0-57d4-461b-89d2-64bb3446acc9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:01.122972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2495c8c-42cd-4fb8-9bdc-9e98665865aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c2495c8c-42cd-4fb8-9bdc-9e98665865aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:01.129538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:01.130418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:01.131243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 109/213] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:01.137621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2495c8c-42cd-4fb8-9bdc-9e98665865aa None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:01.149740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:01.164211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73b1b1-033e-4164-a65c-80222ee19784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:01.165218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73b1b1-033e-4164-a65c-80222ee19784 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:01.165681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73b1b1-033e-4164-a65c-80222ee19784 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:01.166140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73b1b1-033e-4164-a65c-80222ee19784 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:01.167522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73b1b1-033e-4164-a65c-80222ee19784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:01.169225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73b1b1-033e-4164-a65c-80222ee19784 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:01.171306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 105/214] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:01.178637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73b1b1-033e-4164-a65c-80222ee19784 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:01.183747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:01.271612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2495c8c-42cd-4fb8-9bdc-9e98665865aa None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:01.295320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73b1b1-033e-4164-a65c-80222ee19784 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:01.307976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1ffd-9131-45f8-af57-3ab7930731c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:01.308618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1ffd-9131-45f8-af57-3ab7930731c3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:01.308890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1ffd-9131-45f8-af57-3ab7930731c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:01.309159 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1ffd-9131-45f8-af57-3ab7930731c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:01.309826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d1ffd-9131-45f8-af57-3ab7930731c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:01.310120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d1ffd-9131-45f8-af57-3ab7930731c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:01.311562 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d1ffd-9131-45f8-af57-3ab7930731c3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:01.320396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 110/215] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:01.326274 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1ffd-9131-45f8-af57-3ab7930731c3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:01.341374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06e537-a6c2-466c-90cc-208cbdba07e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:01.342517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06e537-a6c2-466c-90cc-208cbdba07e8 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:01.343412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06e537-a6c2-466c-90cc-208cbdba07e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:01.344129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06e537-a6c2-466c-90cc-208cbdba07e8 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:01.345442 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06e537-a6c2-466c-90cc-208cbdba07e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:01.347508 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06e537-a6c2-466c-90cc-208cbdba07e8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:01.379858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 106/216] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 00:59:01 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 00:59:01.423487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:01.462166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1ffd-9131-45f8-af57-3ab7930731c3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:01.499954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa284ba-20c6-4843-8942-71ae7659682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:01.500802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa284ba-20c6-4843-8942-71ae7659682a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:01.501160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa284ba-20c6-4843-8942-71ae7659682a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:01.501476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa284ba-20c6-4843-8942-71ae7659682a None admin] PATH_INFO: `/v3/users/9f9f0aa5557b4db399f56ba85ae5c44f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:01.521466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa284ba-20c6-4843-8942-71ae7659682a None admin] RBAC: Authorizing `identity:get_user(user_id=9f9f0aa5557b4db399f56ba85ae5c44f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:01.523089 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa284ba-20c6-4843-8942-71ae7659682a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:01.525120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 111/217] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:01 2022] GET /identity/v3/users/9f9f0aa5557b4db399f56ba85ae5c44f => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:01.533628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06e537-a6c2-466c-90cc-208cbdba07e8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:01.595324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:01.642806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06e537-a6c2-466c-90cc-208cbdba07e8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:01.658233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eeccd-7e04-49ee-9b09-175cc8d9bede None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:01.658550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eeccd-7e04-49ee-9b09-175cc8d9bede None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:01.658768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eeccd-7e04-49ee-9b09-175cc8d9bede None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:01.660279 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 112/218] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 00:59:01.666867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d389a-dcbb-4eef-b34c-7a7a60e3e210 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:01.667144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d389a-dcbb-4eef-b34c-7a7a60e3e210 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:01.667413 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d389a-dcbb-4eef-b34c-7a7a60e3e210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:01.686889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d53bc-a56b-4e4b-b6ed-fc234d6e8c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:01.687555 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d53bc-a56b-4e4b-b6ed-fc234d6e8c72 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:01.690247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d53bc-a56b-4e4b-b6ed-fc234d6e8c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:01.690247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d53bc-a56b-4e4b-b6ed-fc234d6e8c72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:01.699698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ab0d389a-dcbb-4eef-b34c-7a7a60e3e210 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:01.701346 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ab0d389a-dcbb-4eef-b34c-7a7a60e3e210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:01.775276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d53bc-a56b-4e4b-b6ed-fc234d6e8c72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:01.776885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d53bc-a56b-4e4b-b6ed-fc234d6e8c72 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:01.784400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 113/219] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:01.785895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ffdc7-100d-485c-bf84-3212490289fd None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:01.786175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ffdc7-100d-485c-bf84-3212490289fd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:01.786444 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ffdc7-100d-485c-bf84-3212490289fd None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:01.788178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 114/220] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:01.793502 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589aa51-2d32-420a-bace-7ee180c5551d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:01.793892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589aa51-2d32-420a-bace-7ee180c5551d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:01.794166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589aa51-2d32-420a-bace-7ee180c5551d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:01.815233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1589aa51-2d32-420a-bace-7ee180c5551d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:01.816441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1589aa51-2d32-420a-bace-7ee180c5551d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:01.842107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:01.894458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:01.906004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 107/221] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:01.911305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d53bc-a56b-4e4b-b6ed-fc234d6e8c72 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:01.913678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 115/222] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:02.023727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d53bc-a56b-4e4b-b6ed-fc234d6e8c72 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:02.061066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24955c4-2bf9-4462-8508-1eaee2fe1d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:02.061720 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24955c4-2bf9-4462-8508-1eaee2fe1d79 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:02.061996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24955c4-2bf9-4462-8508-1eaee2fe1d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:02.062269 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24955c4-2bf9-4462-8508-1eaee2fe1d79 None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:02.063573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24955c4-2bf9-4462-8508-1eaee2fe1d79 None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:02.065248 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24955c4-2bf9-4462-8508-1eaee2fe1d79 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:02.067224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 108/223] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:01 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:02.073041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589aa51-2d32-420a-bace-7ee180c5551d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:02.183540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24955c4-2bf9-4462-8508-1eaee2fe1d79 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:02.226395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589aa51-2d32-420a-bace-7ee180c5551d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:02.250726 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:02.266633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47601dd8-88d9-436c-8a0c-f937ce089921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:02.267346 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47601dd8-88d9-436c-8a0c-f937ce089921 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:02.267622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47601dd8-88d9-436c-8a0c-f937ce089921 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:02.267891 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47601dd8-88d9-436c-8a0c-f937ce089921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:02.268658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47601dd8-88d9-436c-8a0c-f937ce089921 None admin] RBAC: Adding query filter params (role.id=948a63d9dffa4bdb815a397570a1d381, scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1, user.id=9f9f0aa5557b4db399f56ba85ae5c44f) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:02.268963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47601dd8-88d9-436c-8a0c-f937ce089921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:02.270462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47601dd8-88d9-436c-8a0c-f937ce089921 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:02.285280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 116/224] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:02 2022] GET /identity/v3/role_assignments?user.id=9f9f0aa5557b4db399f56ba85ae5c44f&scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1&role.id=948a63d9dffa4bdb815a397570a1d381 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:02.286128 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47601dd8-88d9-436c-8a0c-f937ce089921 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:02.396787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:02.411724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24955c4-2bf9-4462-8508-1eaee2fe1d79 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:02.462030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447ad6e-761d-4dc9-8728-5d63add5c57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:02.462689 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447ad6e-761d-4dc9-8728-5d63add5c57f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:02.462964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447ad6e-761d-4dc9-8728-5d63add5c57f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:02.463230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447ad6e-761d-4dc9-8728-5d63add5c57f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:02.475163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447ad6e-761d-4dc9-8728-5d63add5c57f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1447ad6e-761d-4dc9-8728-5d63add5c57f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:02.492446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:02.493386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:02.494205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 109/225] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:59:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:59:02.501686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447ad6e-761d-4dc9-8728-5d63add5c57f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:02.513090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47601dd8-88d9-436c-8a0c-f937ce089921 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:02.608999 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9be1f-7dfb-4db4-aba3-8eb5c6757c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:02.610093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9be1f-7dfb-4db4-aba3-8eb5c6757c09 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:02.610568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9be1f-7dfb-4db4-aba3-8eb5c6757c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:02.611025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9be1f-7dfb-4db4-aba3-8eb5c6757c09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:02.626559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:02.639956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447ad6e-761d-4dc9-8728-5d63add5c57f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:02.643050 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9be1f-7dfb-4db4-aba3-8eb5c6757c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-87d9be1f-7dfb-4db4-aba3-8eb5c6757c09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:02.648853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:02.649778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:02.650583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:02.650583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:02.650583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:02.650583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:02.650583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:02.650583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:02.650583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:02.650583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:02.650583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:02.650583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:02.650583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:02.650583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:02.656825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 117/226] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:59:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:02.663035 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9be1f-7dfb-4db4-aba3-8eb5c6757c09 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:02.682223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124c862-8f7a-4605-8b17-6f14a3e684ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:02.683178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124c862-8f7a-4605-8b17-6f14a3e684ee None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:02.683652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124c862-8f7a-4605-8b17-6f14a3e684ee None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:02.684137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124c862-8f7a-4605-8b17-6f14a3e684ee None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:02.685185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124c862-8f7a-4605-8b17-6f14a3e684ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:02.685683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124c862-8f7a-4605-8b17-6f14a3e684ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:02.687821 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124c862-8f7a-4605-8b17-6f14a3e684ee None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:02.698694 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 110/227] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:02.704521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124c862-8f7a-4605-8b17-6f14a3e684ee None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:02.858681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124c862-8f7a-4605-8b17-6f14a3e684ee None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:02.884436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9be1f-7dfb-4db4-aba3-8eb5c6757c09 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:02.906305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:02.927355 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353750a-cffe-4e71-858b-d0cea529a21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:02.927997 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353750a-cffe-4e71-858b-d0cea529a21f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:02.928268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353750a-cffe-4e71-858b-d0cea529a21f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:02.928572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353750a-cffe-4e71-858b-d0cea529a21f None admin] PATH_INFO: `/v3/users/522d276b21e94fa6be93252d513810f8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:02.930565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353750a-cffe-4e71-858b-d0cea529a21f None admin] RBAC: Authorizing `identity:get_user(user_id=522d276b21e94fa6be93252d513810f8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:02.932067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353750a-cffe-4e71-858b-d0cea529a21f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:02.933894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 111/228] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:02 2022] GET /identity/v3/users/522d276b21e94fa6be93252d513810f8 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:02.943813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353750a-cffe-4e71-858b-d0cea529a21f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:02.954798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfdcd3-2426-4f37-a8a7-a973c73706a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:02.955423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfdcd3-2426-4f37-a8a7-a973c73706a3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:02.955695 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfdcd3-2426-4f37-a8a7-a973c73706a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:02.955959 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfdcd3-2426-4f37-a8a7-a973c73706a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:02.956656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfdcd3-2426-4f37-a8a7-a973c73706a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:02.956954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfdcd3-2426-4f37-a8a7-a973c73706a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:02.958392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfdcd3-2426-4f37-a8a7-a973c73706a3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:02.971364 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 118/229] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:02.977786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfdcd3-2426-4f37-a8a7-a973c73706a3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:02.993837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:03.132168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfdcd3-2426-4f37-a8a7-a973c73706a3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:03.163688 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353750a-cffe-4e71-858b-d0cea529a21f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:03.191423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d590e0f-d3e7-4c04-8ce1-796eb29cbef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:03.193148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d590e0f-d3e7-4c04-8ce1-796eb29cbef5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:03.194250 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d590e0f-d3e7-4c04-8ce1-796eb29cbef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:03.194722 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d590e0f-d3e7-4c04-8ce1-796eb29cbef5 None admin] PATH_INFO: `/v3/users/522d276b21e94fa6be93252d513810f8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:03.197342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d590e0f-d3e7-4c04-8ce1-796eb29cbef5 None admin] RBAC: Authorizing `identity:get_user(user_id=522d276b21e94fa6be93252d513810f8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:03.200623 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d590e0f-d3e7-4c04-8ce1-796eb29cbef5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:03.204727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 119/230] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:02 2022] GET /identity/v3/users/522d276b21e94fa6be93252d513810f8 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:03.206969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789a8fe-be98-4569-9146-132058724895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:03.208787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d590e0f-d3e7-4c04-8ce1-796eb29cbef5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:03.209664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789a8fe-be98-4569-9146-132058724895 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:03.210492 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789a8fe-be98-4569-9146-132058724895 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:03.212741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789a8fe-be98-4569-9146-132058724895 None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:03.214184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789a8fe-be98-4569-9146-132058724895 None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:03.216023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789a8fe-be98-4569-9146-132058724895 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:03.222246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 112/231] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:02 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:03.224434 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789a8fe-be98-4569-9146-132058724895 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:03.292232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:03.343559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:03.360336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789a8fe-be98-4569-9146-132058724895 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:03.407288 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d590e0f-d3e7-4c04-8ce1-796eb29cbef5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:03.421943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672f79e-2675-4f3b-aed9-58051bf20fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:03.423059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672f79e-2675-4f3b-aed9-58051bf20fa1 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:03.424011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672f79e-2675-4f3b-aed9-58051bf20fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:03.424553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672f79e-2675-4f3b-aed9-58051bf20fa1 None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1/users/522d276b21e94fa6be93252d513810f8/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:03.427758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672f79e-2675-4f3b-aed9-58051bf20fa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=51dad9b4ad744f4d8da5d8d177684aa1, user_id=522d276b21e94fa6be93252d513810f8, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:03.429917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672f79e-2675-4f3b-aed9-58051bf20fa1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:03.447552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 113/232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:59:03 2022] PUT /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1/users/522d276b21e94fa6be93252d513810f8/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:03.469831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194440e4-c5f4-42a7-bfb0-89412c78c46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:03.470972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194440e4-c5f4-42a7-bfb0-89412c78c46c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:03.471447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194440e4-c5f4-42a7-bfb0-89412c78c46c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:03.471912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194440e4-c5f4-42a7-bfb0-89412c78c46c None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:03.473385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194440e4-c5f4-42a7-bfb0-89412c78c46c None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:03.475225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194440e4-c5f4-42a7-bfb0-89412c78c46c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:03.477516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 120/233] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:03 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:03.484485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672f79e-2675-4f3b-aed9-58051bf20fa1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:03.631808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672f79e-2675-4f3b-aed9-58051bf20fa1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:03.684091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e7838-cb5e-4d92-8364-f2c7517050b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:03.684728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e7838-cb5e-4d92-8364-f2c7517050b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:03.685001 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e7838-cb5e-4d92-8364-f2c7517050b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:03.685267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e7838-cb5e-4d92-8364-f2c7517050b4 None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1/users/522d276b21e94fa6be93252d513810f8/roles/5f42b81ce88a4943902b63aaaffc1bc2` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:03.693306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e7838-cb5e-4d92-8364-f2c7517050b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=51dad9b4ad744f4d8da5d8d177684aa1, user_id=522d276b21e94fa6be93252d513810f8, role_id=5f42b81ce88a4943902b63aaaffc1bc2)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:03.694938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e7838-cb5e-4d92-8364-f2c7517050b4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:03.720232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 114/234] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:59:03 2022] PUT /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1/users/522d276b21e94fa6be93252d513810f8/roles/5f42b81ce88a4943902b63aaaffc1bc2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:03.800331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee676c-50d0-45b0-83f2-ffa54eefe3b5 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:03.800659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee676c-50d0-45b0-83f2-ffa54eefe3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:03.800882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee676c-50d0-45b0-83f2-ffa54eefe3b5 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:03.802263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 121/235] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:03.810041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cf464-a62c-45fe-bf57-43b799c2f702 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:03.810337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cf464-a62c-45fe-bf57-43b799c2f702 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:03.810615 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cf464-a62c-45fe-bf57-43b799c2f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:03.827422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:03.834417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ed3cf464-a62c-45fe-bf57-43b799c2f702 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:03.836281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ed3cf464-a62c-45fe-bf57-43b799c2f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:03.938855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 115/236] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:04.030141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d99c2-1ca1-4be3-86c0-e1206302fbe7 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:04.030461 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d99c2-1ca1-4be3-86c0-e1206302fbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:04.030674 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d99c2-1ca1-4be3-86c0-e1206302fbe7 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:04.032156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 122/237] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:04.038334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48c1a7-48e8-4f4a-a5b1-e7a26ae4f88d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:04.038612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48c1a7-48e8-4f4a-a5b1-e7a26ae4f88d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:04.038884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48c1a7-48e8-4f4a-a5b1-e7a26ae4f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:04.065002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2f48c1a7-48e8-4f4a-a5b1-e7a26ae4f88d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:04.066218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2f48c1a7-48e8-4f4a-a5b1-e7a26ae4f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:04.161905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 116/238] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:04.251776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d99c2-1ca1-4be3-86c0-e1206302fbe7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:04.397920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d99c2-1ca1-4be3-86c0-e1206302fbe7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:04.409131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:04.433061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48c1a7-48e8-4f4a-a5b1-e7a26ae4f88d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:04.449796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05b394-e4b7-4e2f-b87e-5ad1741372fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:04.450787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05b394-e4b7-4e2f-b87e-5ad1741372fb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:04.451261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05b394-e4b7-4e2f-b87e-5ad1741372fb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:04.452646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05b394-e4b7-4e2f-b87e-5ad1741372fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:04.485028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05b394-e4b7-4e2f-b87e-5ad1741372fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-1e05b394-e4b7-4e2f-b87e-5ad1741372fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:04.490412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:04.491299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:04.492130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:04.492130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:04.492130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:04.492130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:04.492130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:04.492130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:04.492130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:04.492130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:04.492130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:04.492130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:04.492130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:59:04.492130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:04.494496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 123/239] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:04.500721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05b394-e4b7-4e2f-b87e-5ad1741372fb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:04.523872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:04.573235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48c1a7-48e8-4f4a-a5b1-e7a26ae4f88d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:04.619112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c1c15-e4d5-47cc-a621-7e411541c02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:04.620443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c1c15-e4d5-47cc-a621-7e411541c02b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:04.620919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c1c15-e4d5-47cc-a621-7e411541c02b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:04.621508 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c1c15-e4d5-47cc-a621-7e411541c02b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:04.623506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c1c15-e4d5-47cc-a621-7e411541c02b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:04.624901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05b394-e4b7-4e2f-b87e-5ad1741372fb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:04.625621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c1c15-e4d5-47cc-a621-7e411541c02b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:04.632858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 117/240] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:04.632858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467f8d3-5bec-4b68-880b-3ba6e5b85763 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:04.632858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467f8d3-5bec-4b68-880b-3ba6e5b85763 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:04.633589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467f8d3-5bec-4b68-880b-3ba6e5b85763 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:04.634662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 118/241] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:04.636209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467f8d3-5bec-4b68-880b-3ba6e5b85763 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:04.679783 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b4f33-20be-40b7-a007-45d85515e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:04.680822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b4f33-20be-40b7-a007-45d85515e691 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:04.681299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b4f33-20be-40b7-a007-45d85515e691 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:04.681763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b4f33-20be-40b7-a007-45d85515e691 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:04.683187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b4f33-20be-40b7-a007-45d85515e691 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:04.683688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b4f33-20be-40b7-a007-45d85515e691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:04.685882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b4f33-20be-40b7-a007-45d85515e691 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:04.698299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 124/242] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:04.699916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2e978-3013-4d81-84dd-e23ac494f76c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:04.700422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2e978-3013-4d81-84dd-e23ac494f76c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:04.700890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2e978-3013-4d81-84dd-e23ac494f76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:04.723286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-63d2e978-3013-4d81-84dd-e23ac494f76c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:04.724497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-63d2e978-3013-4d81-84dd-e23ac494f76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:04.751479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:04.766868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467f8d3-5bec-4b68-880b-3ba6e5b85763 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:04.803822 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd7063-ca83-406a-828e-f4f1f7b2c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:04.804367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd7063-ca83-406a-828e-f4f1f7b2c2c2 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:04.804685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd7063-ca83-406a-828e-f4f1f7b2c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:04.804955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd7063-ca83-406a-828e-f4f1f7b2c2c2 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:04.805607 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd7063-ca83-406a-828e-f4f1f7b2c2c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:04.806315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 125/243] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:04.807281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd7063-ca83-406a-828e-f4f1f7b2c2c2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:04.807629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2e978-3013-4d81-84dd-e23ac494f76c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:04.816052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:04.835397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 119/244] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 00:59:04 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:59:04.955113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2e978-3013-4d81-84dd-e23ac494f76c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:05.004538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850735d-f5c4-4943-8ec6-cb5c243098fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:05.005462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850735d-f5c4-4943-8ec6-cb5c243098fb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:05.005878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850735d-f5c4-4943-8ec6-cb5c243098fb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:05.006284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850735d-f5c4-4943-8ec6-cb5c243098fb None admin] PATH_INFO: `/v3/users/80a09e3cfd444033967edb4b3fd5e978` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:05.029183 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850735d-f5c4-4943-8ec6-cb5c243098fb None admin] RBAC: Authorizing `identity:get_user(user_id=80a09e3cfd444033967edb4b3fd5e978)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:05.031002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850735d-f5c4-4943-8ec6-cb5c243098fb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:05.033376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 126/245] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:04 2022] GET /identity/v3/users/80a09e3cfd444033967edb4b3fd5e978 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:05.042325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd7063-ca83-406a-828e-f4f1f7b2c2c2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:05.110115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850735d-f5c4-4943-8ec6-cb5c243098fb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:05.144473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:05.189954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd7063-ca83-406a-828e-f4f1f7b2c2c2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:05.231564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf4eb5-de75-45e1-b84d-b05728954871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:05.232491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf4eb5-de75-45e1-b84d-b05728954871 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:05.232767 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf4eb5-de75-45e1-b84d-b05728954871 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:05.233037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf4eb5-de75-45e1-b84d-b05728954871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:05.243524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850735d-f5c4-4943-8ec6-cb5c243098fb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:05.283541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b0eb5-a05b-4f50-b832-edc7c816ae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:05.284174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b0eb5-a05b-4f50-b832-edc7c816ae76 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:05.284488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b0eb5-a05b-4f50-b832-edc7c816ae76 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:05.284758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b0eb5-a05b-4f50-b832-edc7c816ae76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:05.298621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b0eb5-a05b-4f50-b832-edc7c816ae76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e44b0eb5-a05b-4f50-b832-edc7c816ae76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:05.303912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:05.304813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:05.305612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:05.305612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:05.305612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:05.305612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:05.305612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:05.305612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:05.305612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:05.305612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:05.305612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:05.305612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:05.305612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:05.305612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:05.306212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:05.306701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 127/246] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:05.311211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b0eb5-a05b-4f50-b832-edc7c816ae76 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:05.321329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf4eb5-de75-45e1-b84d-b05728954871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:05.322842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf4eb5-de75-45e1-b84d-b05728954871 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:05.399602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:05.424309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b0eb5-a05b-4f50-b832-edc7c816ae76 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:05.461684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0c7aa-1ebd-45bf-90e0-4df9160a85d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:05.462304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0c7aa-1ebd-45bf-90e0-4df9160a85d8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:05.462614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0c7aa-1ebd-45bf-90e0-4df9160a85d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:05.462884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0c7aa-1ebd-45bf-90e0-4df9160a85d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:05.463552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0c7aa-1ebd-45bf-90e0-4df9160a85d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:05.463851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0c7aa-1ebd-45bf-90e0-4df9160a85d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:05.465194 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 120/247] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:05.465421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0c7aa-1ebd-45bf-90e0-4df9160a85d8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:05.474316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 128/248] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:05.475614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf4eb5-de75-45e1-b84d-b05728954871 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:05.484374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0c7aa-1ebd-45bf-90e0-4df9160a85d8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:05.619047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0c7aa-1ebd-45bf-90e0-4df9160a85d8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:05.642905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:05.658664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d0217-b670-42af-a7be-8c83a5fc1d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:05.659232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0217-b670-42af-a7be-8c83a5fc1d9e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:05.659514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0217-b670-42af-a7be-8c83a5fc1d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:05.659791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0217-b670-42af-a7be-8c83a5fc1d9e None admin] PATH_INFO: `/v3/users/9f9f0aa5557b4db399f56ba85ae5c44f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:05.660150 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf4eb5-de75-45e1-b84d-b05728954871 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:05.661687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d0217-b670-42af-a7be-8c83a5fc1d9e None admin] RBAC: Authorizing `identity:get_user(user_id=9f9f0aa5557b4db399f56ba85ae5c44f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:05.664231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d0217-b670-42af-a7be-8c83a5fc1d9e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:05.668406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 129/249] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:05 2022] GET /identity/v3/users/9f9f0aa5557b4db399f56ba85ae5c44f => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:05.671098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d0217-b670-42af-a7be-8c83a5fc1d9e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:05.686402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:05.714603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6ec41-5504-4639-8e56-51131d08385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:05.715264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6ec41-5504-4639-8e56-51131d08385f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:05.715540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6ec41-5504-4639-8e56-51131d08385f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:05.715813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6ec41-5504-4639-8e56-51131d08385f None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:05.718506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6ec41-5504-4639-8e56-51131d08385f None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:05.720127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6ec41-5504-4639-8e56-51131d08385f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:05.721878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 121/250] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:05 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:05.732729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6ec41-5504-4639-8e56-51131d08385f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:05.843862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d0217-b670-42af-a7be-8c83a5fc1d9e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:05.885663 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16cf5d-85dd-41c4-816c-b40de5a24cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:05.886319 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16cf5d-85dd-41c4-816c-b40de5a24cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:05.886599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16cf5d-85dd-41c4-816c-b40de5a24cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:05.886868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16cf5d-85dd-41c4-816c-b40de5a24cf8 None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:05.887998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16cf5d-85dd-41c4-816c-b40de5a24cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:05.888556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6ec41-5504-4639-8e56-51131d08385f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:05.889551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16cf5d-85dd-41c4-816c-b40de5a24cf8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:05.892811 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 130/251] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:05 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:05.896963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f06d0f-d640-43c3-8570-2f6329c682a5 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:05.897245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f06d0f-d640-43c3-8570-2f6329c682a5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:05.897558 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f06d0f-d640-43c3-8570-2f6329c682a5 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:05.899133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 131/252] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:05.899740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f06d0f-d640-43c3-8570-2f6329c682a5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:05.945234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad5ab5-7d26-45ae-9fc7-a65dbbf88e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:05.946225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5ab5-7d26-45ae-9fc7-a65dbbf88e17 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:05.946750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5ab5-7d26-45ae-9fc7-a65dbbf88e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:05.947235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5ab5-7d26-45ae-9fc7-a65dbbf88e17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:05.948201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad5ab5-7d26-45ae-9fc7-a65dbbf88e17 None admin] RBAC: Adding query filter params (role.id=4cae4d2a35654718bfccd726a5588ba1, scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1, user.id=80a09e3cfd444033967edb4b3fd5e978) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:05.948747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad5ab5-7d26-45ae-9fc7-a65dbbf88e17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:05.950604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad5ab5-7d26-45ae-9fc7-a65dbbf88e17 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:05.957563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 122/253] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:05 2022] GET /identity/v3/role_assignments?user.id=80a09e3cfd444033967edb4b3fd5e978&scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1&role.id=4cae4d2a35654718bfccd726a5588ba1 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:05.959166 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8397f55-c55d-4337-beaa-fc8220e995ce None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:05.959643 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8397f55-c55d-4337-beaa-fc8220e995ce None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:05.960112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8397f55-c55d-4337-beaa-fc8220e995ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:05.981071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d8397f55-c55d-4337-beaa-fc8220e995ce None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:05.982949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d8397f55-c55d-4337-beaa-fc8220e995ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:06.011972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:06.083147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 123/254] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:06.144639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:06.180974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f06d0f-d640-43c3-8570-2f6329c682a5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:06.231431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40e516-f3d3-4b1e-8286-dd6a4a7b92b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:06.232461 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40e516-f3d3-4b1e-8286-dd6a4a7b92b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:06.232928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40e516-f3d3-4b1e-8286-dd6a4a7b92b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:06.233407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40e516-f3d3-4b1e-8286-dd6a4a7b92b2 None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1/users/9f9f0aa5557b4db399f56ba85ae5c44f/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:06.235960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40e516-f3d3-4b1e-8286-dd6a4a7b92b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=51dad9b4ad744f4d8da5d8d177684aa1, user_id=9f9f0aa5557b4db399f56ba85ae5c44f, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:06.237682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40e516-f3d3-4b1e-8286-dd6a4a7b92b2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:06.270735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 132/255] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:59:05 2022] PUT /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1/users/9f9f0aa5557b4db399f56ba85ae5c44f/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:06.280752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c25c71-1481-4579-9e4a-ac5c74158e24 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:06.281412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c25c71-1481-4579-9e4a-ac5c74158e24 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:06.281970 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c25c71-1481-4579-9e4a-ac5c74158e24 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:06.284021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 124/256] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:06.290546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b662e34-885a-4ab3-81a3-3aec5ce95f1c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:06.291463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b662e34-885a-4ab3-81a3-3aec5ce95f1c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:06.291938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b662e34-885a-4ab3-81a3-3aec5ce95f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:06.316351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4b662e34-885a-4ab3-81a3-3aec5ce95f1c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:06.317922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4b662e34-885a-4ab3-81a3-3aec5ce95f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:06.410477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 133/257] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:06.442415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c25c71-1481-4579-9e4a-ac5c74158e24 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:06.577004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c25c71-1481-4579-9e4a-ac5c74158e24 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:06.613005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc425119-690f-47ad-a606-3cc98184e998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:06.613650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc425119-690f-47ad-a606-3cc98184e998 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:06.613928 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc425119-690f-47ad-a606-3cc98184e998 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:06.614200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc425119-690f-47ad-a606-3cc98184e998 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:06.629344 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc425119-690f-47ad-a606-3cc98184e998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-cc425119-690f-47ad-a606-3cc98184e998 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:06.634255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:06.635133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:06.635950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:06.635950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:06.635950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:06.635950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:06.635950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:06.635950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:06.635950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:06.635950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:06.635950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:06.635950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:06.635950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:59:06.635950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:06.639853 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 125/258] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:59:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:06.641329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b662e34-885a-4ab3-81a3-3aec5ce95f1c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:06.749750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:06.792706 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b662e34-885a-4ab3-81a3-3aec5ce95f1c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:06.834720 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc425119-690f-47ad-a606-3cc98184e998 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:06.846091 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779b32d-3947-4799-9acc-28f2e000d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:06.846722 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779b32d-3947-4799-9acc-28f2e000d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:06.846997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779b32d-3947-4799-9acc-28f2e000d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:06.847261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779b32d-3947-4799-9acc-28f2e000d7d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:06.847996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779b32d-3947-4799-9acc-28f2e000d7d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:06.848320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779b32d-3947-4799-9acc-28f2e000d7d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:06.849814 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779b32d-3947-4799-9acc-28f2e000d7d7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:06.866068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 134/259] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:06.871625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779b32d-3947-4799-9acc-28f2e000d7d7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:06.874523 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:07.001112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc425119-690f-47ad-a606-3cc98184e998 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:07.041259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e67e7-f112-4ee0-9f14-0558f8571bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:07.041259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e67e7-f112-4ee0-9f14-0558f8571bbe None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:07.041259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e67e7-f112-4ee0-9f14-0558f8571bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:07.041259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e67e7-f112-4ee0-9f14-0558f8571bbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:07.053248 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e67e7-f112-4ee0-9f14-0558f8571bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-2d3e67e7-f112-4ee0-9f14-0558f8571bbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:07.068088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:07.069227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:07.070034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 126/260] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:59:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:07.075403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e67e7-f112-4ee0-9f14-0558f8571bbe None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:07.194280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779b32d-3947-4799-9acc-28f2e000d7d7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:07.241297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:07.246653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:07.261482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54aac5-c2c3-441d-9c15-b272cc66e7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:07.262129 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54aac5-c2c3-441d-9c15-b272cc66e7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:07.262405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54aac5-c2c3-441d-9c15-b272cc66e7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:07.262670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54aac5-c2c3-441d-9c15-b272cc66e7d6 None admin] PATH_INFO: `/v3/users/522d276b21e94fa6be93252d513810f8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:07.264951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54aac5-c2c3-441d-9c15-b272cc66e7d6 None admin] RBAC: Authorizing `identity:get_user(user_id=522d276b21e94fa6be93252d513810f8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:07.266786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54aac5-c2c3-441d-9c15-b272cc66e7d6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:07.268681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 135/261] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:06 2022] GET /identity/v3/users/522d276b21e94fa6be93252d513810f8 => generated 283 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:07.274118 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54aac5-c2c3-441d-9c15-b272cc66e7d6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:07.322253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e67e7-f112-4ee0-9f14-0558f8571bbe None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:07.411770 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e14bf-788c-41ba-b8d1-25814158de54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:07.412760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e14bf-788c-41ba-b8d1-25814158de54 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:07.413040 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e14bf-788c-41ba-b8d1-25814158de54 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:07.413314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e14bf-788c-41ba-b8d1-25814158de54 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:07.413986 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e14bf-788c-41ba-b8d1-25814158de54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:07.414286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e14bf-788c-41ba-b8d1-25814158de54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:07.415721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e14bf-788c-41ba-b8d1-25814158de54 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:07.435864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 127/262] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:07.441517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e14bf-788c-41ba-b8d1-25814158de54 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:07.511997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54aac5-c2c3-441d-9c15-b272cc66e7d6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:07.603286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095419f-77a2-4717-94ee-526ea5b73d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:07.603286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095419f-77a2-4717-94ee-526ea5b73d7c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:07.603286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095419f-77a2-4717-94ee-526ea5b73d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:07.603286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095419f-77a2-4717-94ee-526ea5b73d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:07.624890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e14bf-788c-41ba-b8d1-25814158de54 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:07.692229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e3a99-421f-496e-b876-71b312aba196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:07.693257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e3a99-421f-496e-b876-71b312aba196 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:07.693765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e3a99-421f-496e-b876-71b312aba196 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:07.694223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e3a99-421f-496e-b876-71b312aba196 None admin] PATH_INFO: `/v3/users/522d276b21e94fa6be93252d513810f8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:07.701047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e3a99-421f-496e-b876-71b312aba196 None admin] RBAC: Authorizing `identity:get_user(user_id=522d276b21e94fa6be93252d513810f8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:07.702778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e3a99-421f-496e-b876-71b312aba196 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:07.705008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 128/263] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:07 2022] GET /identity/v3/users/522d276b21e94fa6be93252d513810f8 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:07.711051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e3a99-421f-496e-b876-71b312aba196 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:07.717022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:07.734872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:07.738679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095419f-77a2-4717-94ee-526ea5b73d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:07.740653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095419f-77a2-4717-94ee-526ea5b73d7c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:07.907411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 136/264] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 00:59:07.915034 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095419f-77a2-4717-94ee-526ea5b73d7c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:07.929196 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e3a99-421f-496e-b876-71b312aba196 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:07.964167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae619d-7399-45bc-a6c5-2469e7a09ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:07.965154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae619d-7399-45bc-a6c5-2469e7a09ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:07.965618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae619d-7399-45bc-a6c5-2469e7a09ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:07.966100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae619d-7399-45bc-a6c5-2469e7a09ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:08.026508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:08.031610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095419f-77a2-4717-94ee-526ea5b73d7c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:08.056385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae619d-7399-45bc-a6c5-2469e7a09ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:08.057907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae619d-7399-45bc-a6c5-2469e7a09ab5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:08.060097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:08.084187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e0e18-8fb2-40e6-b2aa-5d177209144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:08.085853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e0e18-8fb2-40e6-b2aa-5d177209144c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:08.086468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e0e18-8fb2-40e6-b2aa-5d177209144c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:08.087016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e0e18-8fb2-40e6-b2aa-5d177209144c None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:08.088940 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e0e18-8fb2-40e6-b2aa-5d177209144c None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:08.091912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e0e18-8fb2-40e6-b2aa-5d177209144c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:08.094120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 137/265] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:07 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:08.101668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e0e18-8fb2-40e6-b2aa-5d177209144c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:08.172409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 129/266] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:08.172409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d304d8-4b8e-4a43-a303-1a9ae956a4d6 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:08.172409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d304d8-4b8e-4a43-a303-1a9ae956a4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:08.172409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d304d8-4b8e-4a43-a303-1a9ae956a4d6 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:08.172895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 130/267] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:08.177744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d17fd-2eab-4f78-ac13-63ed84ffe40f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:08.178080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d17fd-2eab-4f78-ac13-63ed84ffe40f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:08.178412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d17fd-2eab-4f78-ac13-63ed84ffe40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:08.197695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-929d17fd-2eab-4f78-ac13-63ed84ffe40f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:08.199024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-929d17fd-2eab-4f78-ac13-63ed84ffe40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:08.239414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e0e18-8fb2-40e6-b2aa-5d177209144c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:08.270703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 131/268] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:08.271719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d17fd-2eab-4f78-ac13-63ed84ffe40f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:08.283707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4429ad8-e157-43dd-a86b-47b54c76eb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:08.284904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4429ad8-e157-43dd-a86b-47b54c76eb59 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:08.285182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4429ad8-e157-43dd-a86b-47b54c76eb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:08.285448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4429ad8-e157-43dd-a86b-47b54c76eb59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:08.286174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4429ad8-e157-43dd-a86b-47b54c76eb59 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1, user.id=522d276b21e94fa6be93252d513810f8) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:08.286501 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4429ad8-e157-43dd-a86b-47b54c76eb59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:08.288371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4429ad8-e157-43dd-a86b-47b54c76eb59 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:08.300369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 138/269] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:08 2022] GET /identity/v3/role_assignments?user.id=522d276b21e94fa6be93252d513810f8&scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:08.313390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b9c65-50ec-4f73-ab7c-c9b9bebe3f1f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:08.313708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b9c65-50ec-4f73-ab7c-c9b9bebe3f1f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:08.313928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b9c65-50ec-4f73-ab7c-c9b9bebe3f1f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:08.315598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 139/270] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 00:59:08.321137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07246cd6-fdac-44c4-8cd3-2843d975b21e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:08.321457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07246cd6-fdac-44c4-8cd3-2843d975b21e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:08.321670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07246cd6-fdac-44c4-8cd3-2843d975b21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:08.330592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:08.351481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-07246cd6-fdac-44c4-8cd3-2843d975b21e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:08.352707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-07246cd6-fdac-44c4-8cd3-2843d975b21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:08.412616 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:08.461195 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d17fd-2eab-4f78-ac13-63ed84ffe40f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:08.497833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 140/271] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:08.514037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba6ba9-3eea-4323-9fde-ee7d98fab6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:08.514688 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6ba9-3eea-4323-9fde-ee7d98fab6fa None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:08.514961 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6ba9-3eea-4323-9fde-ee7d98fab6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:08.515233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6ba9-3eea-4323-9fde-ee7d98fab6fa None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:08.517142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba6ba9-3eea-4323-9fde-ee7d98fab6fa None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:08.518730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba6ba9-3eea-4323-9fde-ee7d98fab6fa None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:08.520675 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 132/272] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:08 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:08.529785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07246cd6-fdac-44c4-8cd3-2843d975b21e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:08.585967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba6ba9-3eea-4323-9fde-ee7d98fab6fa None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:08.681267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07246cd6-fdac-44c4-8cd3-2843d975b21e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:08.723927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe09e06-b095-4949-8ccc-f33b756d1a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:08.724551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe09e06-b095-4949-8ccc-f33b756d1a76 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:08.724849 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe09e06-b095-4949-8ccc-f33b756d1a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:08.725188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe09e06-b095-4949-8ccc-f33b756d1a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:08.725940 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe09e06-b095-4949-8ccc-f33b756d1a76 None admin] RBAC: Adding query filter params (role.id=5f42b81ce88a4943902b63aaaffc1bc2, scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1, user.id=522d276b21e94fa6be93252d513810f8) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:08.726244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe09e06-b095-4949-8ccc-f33b756d1a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:08.727752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe09e06-b095-4949-8ccc-f33b756d1a76 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:08.740524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 141/273] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:08 2022] GET /identity/v3/role_assignments?user.id=522d276b21e94fa6be93252d513810f8&scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1&role.id=5f42b81ce88a4943902b63aaaffc1bc2 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:08.752535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:08.755835 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba6ba9-3eea-4323-9fde-ee7d98fab6fa None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:08.799936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d087c6-7be7-4b07-b5ea-303c3a6664d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:08.800646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d087c6-7be7-4b07-b5ea-303c3a6664d6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:08.800966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d087c6-7be7-4b07-b5ea-303c3a6664d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:08.801195 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d087c6-7be7-4b07-b5ea-303c3a6664d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:08.802327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d087c6-7be7-4b07-b5ea-303c3a6664d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:08.803855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d087c6-7be7-4b07-b5ea-303c3a6664d6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:08.805816 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 133/274] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:08.812859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe09e06-b095-4949-8ccc-f33b756d1a76 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:08.851921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:08.959188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe09e06-b095-4949-8ccc-f33b756d1a76 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:08.992370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d087c6-7be7-4b07-b5ea-303c3a6664d6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:08.994949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5045e91-06ff-4250-9a2f-770416da0827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:08.995585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5045e91-06ff-4250-9a2f-770416da0827 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:08.995862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5045e91-06ff-4250-9a2f-770416da0827 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:08.996136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5045e91-06ff-4250-9a2f-770416da0827 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:08.996844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5045e91-06ff-4250-9a2f-770416da0827 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:08.998352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5045e91-06ff-4250-9a2f-770416da0827 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:09.027001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 142/275] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 00:59:08 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:59:09.033821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48b233-a3c8-437a-bdb1-0eb7e375b62d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:09.034140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48b233-a3c8-437a-bdb1-0eb7e375b62d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:09.034371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48b233-a3c8-437a-bdb1-0eb7e375b62d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:09.035857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 143/276] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:09.044685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ce5f1-b7d0-4b8c-942b-fbb533abe729 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:09.044685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ce5f1-b7d0-4b8c-942b-fbb533abe729 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:09.044685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ce5f1-b7d0-4b8c-942b-fbb533abe729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:09.069221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3c3ce5f1-b7d0-4b8c-942b-fbb533abe729 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:09.071140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3c3ce5f1-b7d0-4b8c-942b-fbb533abe729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:09.170373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d087c6-7be7-4b07-b5ea-303c3a6664d6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:09.173909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 144/277] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:09.215619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8eac1-efec-460d-9336-07abb1d31652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:09.216272 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8eac1-efec-460d-9336-07abb1d31652 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:09.216627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8eac1-efec-460d-9336-07abb1d31652 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:09.216897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8eac1-efec-460d-9336-07abb1d31652 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:09.229908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8eac1-efec-460d-9336-07abb1d31652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1fd8eac1-efec-460d-9336-07abb1d31652 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:09.234832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:09.235868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:09.237334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 134/278] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:09.241845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ce5f1-b7d0-4b8c-942b-fbb533abe729 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:09.255793 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:09.353516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ce5f1-b7d0-4b8c-942b-fbb533abe729 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:09.374640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8096674-d10a-4c53-9d90-f79baa30b628 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:09.374945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8096674-d10a-4c53-9d90-f79baa30b628 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:09.375222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8096674-d10a-4c53-9d90-f79baa30b628 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:09.377758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 135/279] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 00:59:09.383416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514bdc1-3749-472c-a07a-ff6f57ef98d0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:09.383698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514bdc1-3749-472c-a07a-ff6f57ef98d0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:09.383977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514bdc1-3749-472c-a07a-ff6f57ef98d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:09.398708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c3184-e007-48a5-8adb-f67c15d647a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:09.399668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c3184-e007-48a5-8adb-f67c15d647a6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:09.400151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c3184-e007-48a5-8adb-f67c15d647a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:09.400695 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c3184-e007-48a5-8adb-f67c15d647a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:09.401553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c3184-e007-48a5-8adb-f67c15d647a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:09.402040 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c3184-e007-48a5-8adb-f67c15d647a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:09.403672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c3184-e007-48a5-8adb-f67c15d647a6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:09.409372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c514bdc1-3749-472c-a07a-ff6f57ef98d0 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:09.410567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c514bdc1-3749-472c-a07a-ff6f57ef98d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:09.413678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 145/280] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:09.419969 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c3184-e007-48a5-8adb-f67c15d647a6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:09.443922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:09.498848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 136/281] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:09.499709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514bdc1-3749-472c-a07a-ff6f57ef98d0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:09.527888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:09.554706 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c3184-e007-48a5-8adb-f67c15d647a6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:09.629698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514bdc1-3749-472c-a07a-ff6f57ef98d0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:09.633105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e7ab4-5250-484f-beff-f5ece240d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:09.633760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e7ab4-5250-484f-beff-f5ece240d349 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:09.634033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e7ab4-5250-484f-beff-f5ece240d349 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:09.634299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e7ab4-5250-484f-beff-f5ece240d349 None admin] PATH_INFO: `/v3/users/09c77b42ffcd438b9c53af6356cf9c14` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:09.659734 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e7ab4-5250-484f-beff-f5ece240d349 None admin] RBAC: Authorizing `identity:get_user(user_id=09c77b42ffcd438b9c53af6356cf9c14)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:09.661298 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e7ab4-5250-484f-beff-f5ece240d349 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:09.663367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 146/282] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:09 2022] GET /identity/v3/users/09c77b42ffcd438b9c53af6356cf9c14 => generated 293 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:09.671606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e7ab4-5250-484f-beff-f5ece240d349 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:09.701593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9942195-86db-443a-96c4-29102cb63fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:09.702245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9942195-86db-443a-96c4-29102cb63fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:09.702522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9942195-86db-443a-96c4-29102cb63fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:09.702797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9942195-86db-443a-96c4-29102cb63fe1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:09.721436 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9942195-86db-443a-96c4-29102cb63fe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-b9942195-86db-443a-96c4-29102cb63fe1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:09.726321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:09.727190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:09.728011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:09.728011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:09.728011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:09.728011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:09.728011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:09.728011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:09.728011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:09.728011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:09.728011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:09.728011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:09.728011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:59:09.728011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:09.736358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 137/283] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:09.743316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9942195-86db-443a-96c4-29102cb63fe1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:09.779154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:09.829965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e7ab4-5250-484f-beff-f5ece240d349 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:09.860151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:09.866825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824722a4-b724-4234-996d-6404d21cec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:09.867449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824722a4-b724-4234-996d-6404d21cec36 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:09.867727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824722a4-b724-4234-996d-6404d21cec36 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:09.867995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824722a4-b724-4234-996d-6404d21cec36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:09.868837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824722a4-b724-4234-996d-6404d21cec36 None admin] RBAC: Adding query filter params (role.id=948a63d9dffa4bdb815a397570a1d381, user.id=09c77b42ffcd438b9c53af6356cf9c14, scope.system=all) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:09.869142 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824722a4-b724-4234-996d-6404d21cec36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:09.870818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824722a4-b724-4234-996d-6404d21cec36 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:09.876596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 147/284] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Sep 6 00:59:09 2022] GET /identity/v3/role_assignments?user.id=09c77b42ffcd438b9c53af6356cf9c14&scope.system=all&role.id=948a63d9dffa4bdb815a397570a1d381 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:09.877497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824722a4-b724-4234-996d-6404d21cec36 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:09.888246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9942195-86db-443a-96c4-29102cb63fe1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:09.929526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfee83-1f69-4d18-902b-3db81d63e185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:09.930645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfee83-1f69-4d18-902b-3db81d63e185 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:09.931212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfee83-1f69-4d18-902b-3db81d63e185 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:09.931672 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfee83-1f69-4d18-902b-3db81d63e185 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:09.932566 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfee83-1f69-4d18-902b-3db81d63e185 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:09.933058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfee83-1f69-4d18-902b-3db81d63e185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:09.934906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfee83-1f69-4d18-902b-3db81d63e185 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:09.944595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 138/285] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:09.950684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfee83-1f69-4d18-902b-3db81d63e185 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:09.997055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824722a4-b724-4234-996d-6404d21cec36 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:10.045255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:10.067408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfee83-1f69-4d18-902b-3db81d63e185 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:10.073066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52157f29-a74f-4194-aa19-4f2d76110072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:10.073736 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157f29-a74f-4194-aa19-4f2d76110072 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:10.074011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157f29-a74f-4194-aa19-4f2d76110072 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:10.074278 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157f29-a74f-4194-aa19-4f2d76110072 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:10.091548 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52157f29-a74f-4194-aa19-4f2d76110072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-52157f29-a74f-4194-aa19-4f2d76110072 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:10.097741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:10.098625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:10.099438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 148/286] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:10.104919 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52157f29-a74f-4194-aa19-4f2d76110072 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:10.111380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0edd3e-38ec-4f43-b7d6-1af20856e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:10.112335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0edd3e-38ec-4f43-b7d6-1af20856e80e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:10.112892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0edd3e-38ec-4f43-b7d6-1af20856e80e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:10.113451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0edd3e-38ec-4f43-b7d6-1af20856e80e None admin] PATH_INFO: `/v3/users/80a09e3cfd444033967edb4b3fd5e978` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:10.115422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0edd3e-38ec-4f43-b7d6-1af20856e80e None admin] RBAC: Authorizing `identity:get_user(user_id=80a09e3cfd444033967edb4b3fd5e978)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:10.117507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0edd3e-38ec-4f43-b7d6-1af20856e80e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:10.119951 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 139/287] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:09 2022] GET /identity/v3/users/80a09e3cfd444033967edb4b3fd5e978 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:10.128351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0edd3e-38ec-4f43-b7d6-1af20856e80e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:10.237721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0edd3e-38ec-4f43-b7d6-1af20856e80e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:10.254572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:10.300370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd0a79-6852-4c6e-bcc0-2792521a6dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:10.301253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd0a79-6852-4c6e-bcc0-2792521a6dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:10.304470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd0a79-6852-4c6e-bcc0-2792521a6dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:10.304886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd0a79-6852-4c6e-bcc0-2792521a6dc3 None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:10.306203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd0a79-6852-4c6e-bcc0-2792521a6dc3 None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:10.307951 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd0a79-6852-4c6e-bcc0-2792521a6dc3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:10.310748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 140/288] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:10 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:10.317577 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd0a79-6852-4c6e-bcc0-2792521a6dc3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:10.334426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52157f29-a74f-4194-aa19-4f2d76110072 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:10.351314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:10.399018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec5394-e251-4382-8963-e1a661442d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:10.400982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec5394-e251-4382-8963-e1a661442d2d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:10.401581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec5394-e251-4382-8963-e1a661442d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:10.402656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec5394-e251-4382-8963-e1a661442d2d None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:10.403660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec5394-e251-4382-8963-e1a661442d2d None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:10.407179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec5394-e251-4382-8963-e1a661442d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:10.408881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec5394-e251-4382-8963-e1a661442d2d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:10.429278 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 149/289] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:10.431603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec5394-e251-4382-8963-e1a661442d2d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:10.513884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd0a79-6852-4c6e-bcc0-2792521a6dc3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:10.586915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaac8c6-f9b4-4b4f-8189-dd904631ea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:10.587841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaac8c6-f9b4-4b4f-8189-dd904631ea2b None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:10.588259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaac8c6-f9b4-4b4f-8189-dd904631ea2b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:10.588690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaac8c6-f9b4-4b4f-8189-dd904631ea2b None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1/users/80a09e3cfd444033967edb4b3fd5e978/roles/4cae4d2a35654718bfccd726a5588ba1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:10.592271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaac8c6-f9b4-4b4f-8189-dd904631ea2b None admin] RBAC: Authorizing `identity:create_grant(project_id=51dad9b4ad744f4d8da5d8d177684aa1, user_id=80a09e3cfd444033967edb4b3fd5e978, role_id=4cae4d2a35654718bfccd726a5588ba1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:10.594164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaac8c6-f9b4-4b4f-8189-dd904631ea2b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:10.615584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 141/290] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:59:10 2022] PUT /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1/users/80a09e3cfd444033967edb4b3fd5e978/roles/4cae4d2a35654718bfccd726a5588ba1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 00:59:10.626565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec5394-e251-4382-8963-e1a661442d2d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:10.652018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:10.668581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742ad0c-aade-4742-a961-692ddae489bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:10.669704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742ad0c-aade-4742-a961-692ddae489bd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:10.670204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742ad0c-aade-4742-a961-692ddae489bd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:10.670673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742ad0c-aade-4742-a961-692ddae489bd None admin] PATH_INFO: `/v3/users/9f9f0aa5557b4db399f56ba85ae5c44f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:10.673089 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742ad0c-aade-4742-a961-692ddae489bd None admin] RBAC: Authorizing `identity:get_user(user_id=9f9f0aa5557b4db399f56ba85ae5c44f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:10.674830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742ad0c-aade-4742-a961-692ddae489bd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:10.680667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 150/291] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:10 2022] GET /identity/v3/users/9f9f0aa5557b4db399f56ba85ae5c44f => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:10.683225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaac8c6-f9b4-4b4f-8189-dd904631ea2b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:10.790551 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:10.824375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaac8c6-f9b4-4b4f-8189-dd904631ea2b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:10.865510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2b7f-48c8-4c29-a7be-ed9c53592d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:10.866507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2b7f-48c8-4c29-a7be-ed9c53592d7a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:10.866997 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2b7f-48c8-4c29-a7be-ed9c53592d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:10.867462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2b7f-48c8-4c29-a7be-ed9c53592d7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:10.956927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a2b7f-48c8-4c29-a7be-ed9c53592d7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:10.958813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a2b7f-48c8-4c29-a7be-ed9c53592d7a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:11.064724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:11.093096 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 142/292] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:11.099848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742ad0c-aade-4742-a961-692ddae489bd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:11.234292 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742ad0c-aade-4742-a961-692ddae489bd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:11.283621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4da49-a99d-42af-883c-76005c620dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:11.284696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4da49-a99d-42af-883c-76005c620dfa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:11.285172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4da49-a99d-42af-883c-76005c620dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:11.285699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4da49-a99d-42af-883c-76005c620dfa None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:11.287081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4da49-a99d-42af-883c-76005c620dfa None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:11.289172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4da49-a99d-42af-883c-76005c620dfa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:11.291033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 151/293] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:11 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:11.297446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2b7f-48c8-4c29-a7be-ed9c53592d7a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:11.420649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2b7f-48c8-4c29-a7be-ed9c53592d7a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:11.457697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e127d0-f88b-4d51-9d25-8076150e76b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:11.458313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e127d0-f88b-4d51-9d25-8076150e76b4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:11.458585 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e127d0-f88b-4d51-9d25-8076150e76b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:11.458852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e127d0-f88b-4d51-9d25-8076150e76b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:11.459573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e127d0-f88b-4d51-9d25-8076150e76b4 None admin] RBAC: Adding query filter params (role.id=948a63d9dffa4bdb815a397570a1d381, scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1, user.id=9f9f0aa5557b4db399f56ba85ae5c44f) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:11.459876 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e127d0-f88b-4d51-9d25-8076150e76b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:11.461389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e127d0-f88b-4d51-9d25-8076150e76b4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:11.466795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10fe6b-d924-41a6-9c81-0467199e0d80 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:11.467081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10fe6b-d924-41a6-9c81-0467199e0d80 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:11.467364 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10fe6b-d924-41a6-9c81-0467199e0d80 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:11.467666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 143/294] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:11 2022] GET /identity/v3/role_assignments?user.id=9f9f0aa5557b4db399f56ba85ae5c44f&scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1&role.id=948a63d9dffa4bdb815a397570a1d381 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:11.469207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 152/295] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:11.474383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6cc09-3d4e-419f-bce0-93a2e78f3c64 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:11.474669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6cc09-3d4e-419f-bce0-93a2e78f3c64 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:11.474947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6cc09-3d4e-419f-bce0-93a2e78f3c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:11.494888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-49a6cc09-3d4e-419f-bce0-93a2e78f3c64 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:11.496035 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-49a6cc09-3d4e-419f-bce0-93a2e78f3c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:11.542224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:11.598818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 144/296] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:11.654721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131101ed-6457-40b1-ac92-ad5734033bb0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:11.655228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131101ed-6457-40b1-ac92-ad5734033bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:11.655228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131101ed-6457-40b1-ac92-ad5734033bb0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:11.657482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 153/297] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:11.662808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26ae5c-6993-40ad-a410-0835de51a51c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:11.663091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26ae5c-6993-40ad-a410-0835de51a51c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:11.663360 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26ae5c-6993-40ad-a410-0835de51a51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:11.683456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-eb26ae5c-6993-40ad-a410-0835de51a51c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:11.685036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-eb26ae5c-6993-40ad-a410-0835de51a51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:11.761719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 145/298] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:11.917135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131101ed-6457-40b1-ac92-ad5734033bb0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:11.979037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:12.029555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131101ed-6457-40b1-ac92-ad5734033bb0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:12.066473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26ae5c-6993-40ad-a410-0835de51a51c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:12.067491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bc448-64f1-40af-800b-673bd15a98ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:12.068136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bc448-64f1-40af-800b-673bd15a98ee None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:12.068471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bc448-64f1-40af-800b-673bd15a98ee None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:12.068744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bc448-64f1-40af-800b-673bd15a98ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:12.079953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bc448-64f1-40af-800b-673bd15a98ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9c7bc448-64f1-40af-800b-673bd15a98ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:12.085851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:12.086718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:12.087524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 154/299] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:12.092930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bc448-64f1-40af-800b-673bd15a98ee None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:12.189832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:12.194188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26ae5c-6993-40ad-a410-0835de51a51c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:12.204764 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bc448-64f1-40af-800b-673bd15a98ee None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:12.218369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:12.234209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d70a3-36bd-4c2e-ba30-59f503fe4531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:12.235301 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d70a3-36bd-4c2e-ba30-59f503fe4531 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:12.235773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d70a3-36bd-4c2e-ba30-59f503fe4531 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:12.236250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d70a3-36bd-4c2e-ba30-59f503fe4531 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:12.237776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d70a3-36bd-4c2e-ba30-59f503fe4531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:12.239455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d70a3-36bd-4c2e-ba30-59f503fe4531 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:12.241248 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 146/300] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:12.245776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439f0c7-c3f0-40b7-b1c5-9e40a9ee29f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:12.245776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439f0c7-c3f0-40b7-b1c5-9e40a9ee29f7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:12.245776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439f0c7-c3f0-40b7-b1c5-9e40a9ee29f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:12.245776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439f0c7-c3f0-40b7-b1c5-9e40a9ee29f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:12.246097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439f0c7-c3f0-40b7-b1c5-9e40a9ee29f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:12.246097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439f0c7-c3f0-40b7-b1c5-9e40a9ee29f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:12.246509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439f0c7-c3f0-40b7-b1c5-9e40a9ee29f7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:12.247393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d70a3-36bd-4c2e-ba30-59f503fe4531 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:12.255604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 155/301] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:12.261331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439f0c7-c3f0-40b7-b1c5-9e40a9ee29f7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:12.355811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d70a3-36bd-4c2e-ba30-59f503fe4531 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:12.363271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439f0c7-c3f0-40b7-b1c5-9e40a9ee29f7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:12.394141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18909453-e35f-4ec4-9c06-35a08d615a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:12.395121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18909453-e35f-4ec4-9c06-35a08d615a34 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:12.395490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18909453-e35f-4ec4-9c06-35a08d615a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:12.395779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18909453-e35f-4ec4-9c06-35a08d615a34 None admin] PATH_INFO: `/v3/groups` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:12.396430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18909453-e35f-4ec4-9c06-35a08d615a34 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:12.396895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447f85f-6e2e-4514-b172-ab46e8b4f385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:12.397530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447f85f-6e2e-4514-b172-ab46e8b4f385 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:12.397808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447f85f-6e2e-4514-b172-ab46e8b4f385 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:12.397926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18909453-e35f-4ec4-9c06-35a08d615a34 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:12.398091 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447f85f-6e2e-4514-b172-ab46e8b4f385 None admin] PATH_INFO: `/v3/users/c7bc34c6cf47418393a8f4acfc2ae975` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:12.413605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447f85f-6e2e-4514-b172-ab46e8b4f385 None admin] RBAC: Authorizing `identity:get_user(user_id=c7bc34c6cf47418393a8f4acfc2ae975)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:12.415344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447f85f-6e2e-4514-b172-ab46e8b4f385 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:12.421983 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 156/303] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:12 2022] GET /identity/v3/users/c7bc34c6cf47418393a8f4acfc2ae975 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:12.422234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 147/303] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Sep 6 00:59:12 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:59:12.423632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369bfc4-8d86-4fa1-80a8-f6f193cbc5aa None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:12.423754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18909453-e35f-4ec4-9c06-35a08d615a34 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:12.430480 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369bfc4-8d86-4fa1-80a8-f6f193cbc5aa None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:12.430480 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369bfc4-8d86-4fa1-80a8-f6f193cbc5aa None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:12.430480 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 157/304] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:12.432627 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde1afa-0ac4-48dd-bab1-304bf31a003c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:12.432904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde1afa-0ac4-48dd-bab1-304bf31a003c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:12.433172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde1afa-0ac4-48dd-bab1-304bf31a003c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:12.453946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ccde1afa-0ac4-48dd-bab1-304bf31a003c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:12.455103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ccde1afa-0ac4-48dd-bab1-304bf31a003c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:12.473924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:12.487599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:12.548268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 158/305] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:12.577344 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18909453-e35f-4ec4-9c06-35a08d615a34 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:12.616594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d9108-f4c3-43e7-92cb-9f0a9cd38c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:12.617128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d9108-f4c3-43e7-92cb-9f0a9cd38c50 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:12.617401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d9108-f4c3-43e7-92cb-9f0a9cd38c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:12.617673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d9108-f4c3-43e7-92cb-9f0a9cd38c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:12.618397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d9108-f4c3-43e7-92cb-9f0a9cd38c50 None admin] RBAC: Adding query filter params (role.id=4cae4d2a35654718bfccd726a5588ba1, user.id=c7bc34c6cf47418393a8f4acfc2ae975, scope.system=all) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:12.618699 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d9108-f4c3-43e7-92cb-9f0a9cd38c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:12.620178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d9108-f4c3-43e7-92cb-9f0a9cd38c50 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:12.626099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 148/306] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Sep 6 00:59:12 2022] GET /identity/v3/role_assignments?user.id=c7bc34c6cf47418393a8f4acfc2ae975&scope.system=all&role.id=4cae4d2a35654718bfccd726a5588ba1 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:12.822937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde1afa-0ac4-48dd-bab1-304bf31a003c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:12.926092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde1afa-0ac4-48dd-bab1-304bf31a003c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:12.962369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa2eab-c6a1-4d0a-adeb-e23a2ce7b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:12.963401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa2eab-c6a1-4d0a-adeb-e23a2ce7b871 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:12.963875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa2eab-c6a1-4d0a-adeb-e23a2ce7b871 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:12.964368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa2eab-c6a1-4d0a-adeb-e23a2ce7b871 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:12.969205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e249d33-e64b-4141-946c-e690d0960565 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:12.969484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e249d33-e64b-4141-946c-e690d0960565 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:12.969752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e249d33-e64b-4141-946c-e690d0960565 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:12.971419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 149/307] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:12.976510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751107d-9f5e-4422-9d3a-faf6b3b8bbb9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:12.976788 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751107d-9f5e-4422-9d3a-faf6b3b8bbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:12.977061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751107d-9f5e-4422-9d3a-faf6b3b8bbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:12.978686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa2eab-c6a1-4d0a-adeb-e23a2ce7b871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c2fa2eab-c6a1-4d0a-adeb-e23a2ce7b871 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:12.984123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:12.985469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:12.986491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:12.986491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:12.986491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:12.986491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:12.986491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:12.986491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:12.986491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:12.986491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:12.986491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:12.986491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:12.986491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:12.986491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:12.988531 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 159/308] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:12.995419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa2eab-c6a1-4d0a-adeb-e23a2ce7b871 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:13.001376 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7751107d-9f5e-4422-9d3a-faf6b3b8bbb9 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:13.001644 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7751107d-9f5e-4422-9d3a-faf6b3b8bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:13.027110 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:13.100662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 150/309] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:13.124503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa2eab-c6a1-4d0a-adeb-e23a2ce7b871 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:13.162784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e11d2-9c15-4c23-8c2d-7f65e29b2d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:13.163832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e11d2-9c15-4c23-8c2d-7f65e29b2d5a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:13.164322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e11d2-9c15-4c23-8c2d-7f65e29b2d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:13.164784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e11d2-9c15-4c23-8c2d-7f65e29b2d5a None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:13.165640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e11d2-9c15-4c23-8c2d-7f65e29b2d5a None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:13.166149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e11d2-9c15-4c23-8c2d-7f65e29b2d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:13.167782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e11d2-9c15-4c23-8c2d-7f65e29b2d5a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:13.177620 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 160/310] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:13.183507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751107d-9f5e-4422-9d3a-faf6b3b8bbb9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:13.213371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:13.292700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751107d-9f5e-4422-9d3a-faf6b3b8bbb9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:13.332220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c96f10-612a-4d1d-99be-91d48d1ff2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:13.333157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c96f10-612a-4d1d-99be-91d48d1ff2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:13.333627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c96f10-612a-4d1d-99be-91d48d1ff2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:13.334088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c96f10-612a-4d1d-99be-91d48d1ff2b0 None admin] PATH_INFO: `/v3/users/09c77b42ffcd438b9c53af6356cf9c14` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:13.335392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c96f10-612a-4d1d-99be-91d48d1ff2b0 None admin] RBAC: Authorizing `identity:get_user(user_id=09c77b42ffcd438b9c53af6356cf9c14)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:13.337150 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c96f10-612a-4d1d-99be-91d48d1ff2b0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:13.338918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 151/311] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:13 2022] GET /identity/v3/users/09c77b42ffcd438b9c53af6356cf9c14 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:13.345374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e11d2-9c15-4c23-8c2d-7f65e29b2d5a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:13.394678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c96f10-612a-4d1d-99be-91d48d1ff2b0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:13.443376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:13.461668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e11d2-9c15-4c23-8c2d-7f65e29b2d5a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:13.492365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:13.502175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774dfd3-4904-4fbd-b851-08f67222c0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:13.503114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774dfd3-4904-4fbd-b851-08f67222c0fc None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:13.503602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774dfd3-4904-4fbd-b851-08f67222c0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:13.504061 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774dfd3-4904-4fbd-b851-08f67222c0fc None admin] PATH_INFO: `/v3/system/users/09c77b42ffcd438b9c53af6356cf9c14/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:13.504927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c96f10-612a-4d1d-99be-91d48d1ff2b0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:13.505937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774dfd3-4904-4fbd-b851-08f67222c0fc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=09c77b42ffcd438b9c53af6356cf9c14, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:13.507673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774dfd3-4904-4fbd-b851-08f67222c0fc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:13.521725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 161/312] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Sep 6 00:59:13 2022] PUT /identity/v3/system/users/09c77b42ffcd438b9c53af6356cf9c14/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:13.547773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b303f61-fe70-4bb1-985f-78fcfed21026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:13.548805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b303f61-fe70-4bb1-985f-78fcfed21026 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:13.549217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b303f61-fe70-4bb1-985f-78fcfed21026 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:13.549621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b303f61-fe70-4bb1-985f-78fcfed21026 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:13.562737 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b303f61-fe70-4bb1-985f-78fcfed21026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-7b303f61-fe70-4bb1-985f-78fcfed21026 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:13.568213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:13.569379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:13.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:13.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:13.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:13.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:13.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:13.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:13.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:13.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:13.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:13.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:13.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:59:13.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:13.572849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 152/313] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:59:13.579183 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774dfd3-4904-4fbd-b851-08f67222c0fc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:13.698860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774dfd3-4904-4fbd-b851-08f67222c0fc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:13.735419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0897f-c4a7-4d6d-bf44-10585f0f3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:13.736034 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0897f-c4a7-4d6d-bf44-10585f0f3e92 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:13.736327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0897f-c4a7-4d6d-bf44-10585f0f3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:13.736600 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0897f-c4a7-4d6d-bf44-10585f0f3e92 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:13.737315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0897f-c4a7-4d6d-bf44-10585f0f3e92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:13.737617 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0897f-c4a7-4d6d-bf44-10585f0f3e92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:13.739058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0897f-c4a7-4d6d-bf44-10585f0f3e92 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:13.747835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 162/314] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:13.753657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b303f61-fe70-4bb1-985f-78fcfed21026 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:13.862362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b303f61-fe70-4bb1-985f-78fcfed21026 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:13.898181 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45aacc-1177-4fa8-9b76-c6ed8b92062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:13.898828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45aacc-1177-4fa8-9b76-c6ed8b92062c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:13.899106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45aacc-1177-4fa8-9b76-c6ed8b92062c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:13.899382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45aacc-1177-4fa8-9b76-c6ed8b92062c None admin] PATH_INFO: `/v3/users/80a09e3cfd444033967edb4b3fd5e978` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:13.900542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45aacc-1177-4fa8-9b76-c6ed8b92062c None admin] RBAC: Authorizing `identity:get_user(user_id=80a09e3cfd444033967edb4b3fd5e978)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:13.902032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45aacc-1177-4fa8-9b76-c6ed8b92062c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:13.903992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 153/315] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:13 2022] GET /identity/v3/users/80a09e3cfd444033967edb4b3fd5e978 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:13.909650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0897f-c4a7-4d6d-bf44-10585f0f3e92 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:13.923874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:14.019343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0897f-c4a7-4d6d-bf44-10585f0f3e92 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:14.055632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f3be2-2618-47d2-82ef-032fb3845585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:14.056544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f3be2-2618-47d2-82ef-032fb3845585 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:14.056960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f3be2-2618-47d2-82ef-032fb3845585 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:14.057369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f3be2-2618-47d2-82ef-032fb3845585 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:14.127794 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f3be2-2618-47d2-82ef-032fb3845585 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:14.129616 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f3be2-2618-47d2-82ef-032fb3845585 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:14.141876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:14.233549 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 163/316] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:14.240122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45aacc-1177-4fa8-9b76-c6ed8b92062c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:14.267448 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:14.352969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45aacc-1177-4fa8-9b76-c6ed8b92062c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:14.388351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b95dc-fd18-4fc3-bf66-b17a50a4949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:14.389330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b95dc-fd18-4fc3-bf66-b17a50a4949c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:14.389772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b95dc-fd18-4fc3-bf66-b17a50a4949c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:14.390329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b95dc-fd18-4fc3-bf66-b17a50a4949c None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:14.391807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b95dc-fd18-4fc3-bf66-b17a50a4949c None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:14.393519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b95dc-fd18-4fc3-bf66-b17a50a4949c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:14.395746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 154/317] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:14 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:14.401839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f3be2-2618-47d2-82ef-032fb3845585 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:14.505797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f3be2-2618-47d2-82ef-032fb3845585 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:14.518515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da080daa-2909-492a-8d44-11ef3a6dd0db None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:14.519146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da080daa-2909-492a-8d44-11ef3a6dd0db None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:14.519614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da080daa-2909-492a-8d44-11ef3a6dd0db None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:14.521540 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:14.522920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 155/318] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:14.524227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665952b-0754-47ce-93f5-b520cb05e143 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:14.524804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665952b-0754-47ce-93f5-b520cb05e143 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:14.525549 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665952b-0754-47ce-93f5-b520cb05e143 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:14.527077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 156/319] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:14.527957 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aefba-66e9-470e-ba65-5fc727ef833e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:14.528229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aefba-66e9-470e-ba65-5fc727ef833e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:14.528524 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aefba-66e9-470e-ba65-5fc727ef833e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:14.548537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c18aefba-66e9-470e-ba65-5fc727ef833e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:14.549049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5d9ec-d56b-434d-a133-57f361a0f69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:14.549671 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5d9ec-d56b-434d-a133-57f361a0f69e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:14.549770 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c18aefba-66e9-470e-ba65-5fc727ef833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:14.549952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5d9ec-d56b-434d-a133-57f361a0f69e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:14.550225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5d9ec-d56b-434d-a133-57f361a0f69e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:14.550957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5d9ec-d56b-434d-a133-57f361a0f69e None admin] RBAC: Adding query filter params (role.id=4cae4d2a35654718bfccd726a5588ba1, scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1, user.id=80a09e3cfd444033967edb4b3fd5e978) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:14.551264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5d9ec-d56b-434d-a133-57f361a0f69e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:14.553785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5d9ec-d56b-434d-a133-57f361a0f69e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:14.560800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 164/320] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:14 2022] GET /identity/v3/role_assignments?user.id=80a09e3cfd444033967edb4b3fd5e978&scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1&role.id=4cae4d2a35654718bfccd726a5588ba1 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:14.561965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75272c2e-7079-413f-b384-8a0f979abdeb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:14.562245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75272c2e-7079-413f-b384-8a0f979abdeb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:14.562528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75272c2e-7079-413f-b384-8a0f979abdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:14.591195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-75272c2e-7079-413f-b384-8a0f979abdeb None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:14.595120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-75272c2e-7079-413f-b384-8a0f979abdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:14.641379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 157/321] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:14.691906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 165/322] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:14.921410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aefba-66e9-470e-ba65-5fc727ef833e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:14.940587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:14.953420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75272c2e-7079-413f-b384-8a0f979abdeb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:15.034279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aefba-66e9-470e-ba65-5fc727ef833e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:15.067545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75272c2e-7079-413f-b384-8a0f979abdeb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:15.068539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7c2d7-4135-4913-be19-9f0a82e65442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:15.069185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7c2d7-4135-4913-be19-9f0a82e65442 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:15.069458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7c2d7-4135-4913-be19-9f0a82e65442 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:15.069727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7c2d7-4135-4913-be19-9f0a82e65442 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:15.071654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:15.080721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7c2d7-4135-4913-be19-9f0a82e65442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-33d7c2d7-4135-4913-be19-9f0a82e65442 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:15.085757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:15.086635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:15.087421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 158/323] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:15.092565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7c2d7-4135-4913-be19-9f0a82e65442 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:15.108723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e46a47-1ca7-49af-b591-f2c193a9c58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:15.109392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e46a47-1ca7-49af-b591-f2c193a9c58b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:15.109656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e46a47-1ca7-49af-b591-f2c193a9c58b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:15.110007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e46a47-1ca7-49af-b591-f2c193a9c58b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:15.111201 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e46a47-1ca7-49af-b591-f2c193a9c58b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:15.112726 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e46a47-1ca7-49af-b591-f2c193a9c58b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:15.114495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 166/324] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:15.119729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e46a47-1ca7-49af-b591-f2c193a9c58b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:15.188252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:15.215125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7c2d7-4135-4913-be19-9f0a82e65442 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:15.226567 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e46a47-1ca7-49af-b591-f2c193a9c58b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:15.251864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c5cb-742a-49d1-976d-5124a1687d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:15.252637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c5cb-742a-49d1-976d-5124a1687d1f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:15.252830 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c5cb-742a-49d1-976d-5124a1687d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:15.253134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c5cb-742a-49d1-976d-5124a1687d1f None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:15.253751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2c5cb-742a-49d1-976d-5124a1687d1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:15.254269 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2c5cb-742a-49d1-976d-5124a1687d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:15.255489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2c5cb-742a-49d1-976d-5124a1687d1f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:15.264967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 159/325] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:15.265110 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca9c76-4995-4513-89be-410f2588ae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:15.265944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca9c76-4995-4513-89be-410f2588ae88 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:15.266606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca9c76-4995-4513-89be-410f2588ae88 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:15.266606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca9c76-4995-4513-89be-410f2588ae88 None admin] PATH_INFO: `/v3/groups` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:15.267111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca9c76-4995-4513-89be-410f2588ae88 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:15.268642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca9c76-4995-4513-89be-410f2588ae88 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:15.270570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c5cb-742a-49d1-976d-5124a1687d1f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:15.289454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 167/326] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Sep 6 00:59:15 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 00:59:15.385335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c5cb-742a-49d1-976d-5124a1687d1f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:15.423825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d9e3e-fc14-4719-a548-68bece85508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:15.424617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d9e3e-fc14-4719-a548-68bece85508e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:15.424854 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d9e3e-fc14-4719-a548-68bece85508e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:15.425177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d9e3e-fc14-4719-a548-68bece85508e None admin] PATH_INFO: `/v3/users/c7bc34c6cf47418393a8f4acfc2ae975` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:15.426363 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d9e3e-fc14-4719-a548-68bece85508e None admin] RBAC: Authorizing `identity:get_user(user_id=c7bc34c6cf47418393a8f4acfc2ae975)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:15.427903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d9e3e-fc14-4719-a548-68bece85508e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:15.429715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 160/327] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:15 2022] GET /identity/v3/users/c7bc34c6cf47418393a8f4acfc2ae975 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:15.435980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca9c76-4995-4513-89be-410f2588ae88 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:15.472499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:15.545998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca9c76-4995-4513-89be-410f2588ae88 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:15.582314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa6871-019a-4dc5-91b8-bbe9e6920855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:15.583344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6871-019a-4dc5-91b8-bbe9e6920855 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:15.583810 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6871-019a-4dc5-91b8-bbe9e6920855 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:15.584268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6871-019a-4dc5-91b8-bbe9e6920855 None admin] PATH_INFO: `/v3/system/users/c7bc34c6cf47418393a8f4acfc2ae975/roles/4cae4d2a35654718bfccd726a5588ba1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:15.585975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa6871-019a-4dc5-91b8-bbe9e6920855 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c7bc34c6cf47418393a8f4acfc2ae975, role_id=4cae4d2a35654718bfccd726a5588ba1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:15.587877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa6871-019a-4dc5-91b8-bbe9e6920855 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:15.598154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 168/328] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Sep 6 00:59:15 2022] PUT /identity/v3/system/users/c7bc34c6cf47418393a8f4acfc2ae975/roles/4cae4d2a35654718bfccd726a5588ba1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:15.614641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c29a5-99b6-4116-87a1-a36b7b6089a2 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:15.615027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c29a5-99b6-4116-87a1-a36b7b6089a2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:15.615216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c29a5-99b6-4116-87a1-a36b7b6089a2 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:15.616813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 161/329] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:15.623298 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939659cf-6740-477d-95ad-3173a165cd10 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:15.624058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939659cf-6740-477d-95ad-3173a165cd10 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:15.624362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939659cf-6740-477d-95ad-3173a165cd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:15.645561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-939659cf-6740-477d-95ad-3173a165cd10 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:15.646911 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-939659cf-6740-477d-95ad-3173a165cd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:15.725764 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 169/330] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:15.996996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c29a5-99b6-4116-87a1-a36b7b6089a2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:16.007551 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:16.116830 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c29a5-99b6-4116-87a1-a36b7b6089a2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:16.154041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd7138-f189-4bd0-9afb-7846959fce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:16.154942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd7138-f189-4bd0-9afb-7846959fce61 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:16.155358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd7138-f189-4bd0-9afb-7846959fce61 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:16.155763 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd7138-f189-4bd0-9afb-7846959fce61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:16.167074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd7138-f189-4bd0-9afb-7846959fce61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-cdfd7138-f189-4bd0-9afb-7846959fce61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:16.174905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:16.175995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:16.177032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:16.177032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:16.177032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:16.177032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:16.177032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:16.177032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:16.177032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:16.177032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:16.177032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:16.177032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:16.177032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:16.177032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:16.179336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 162/331] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:16.185470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939659cf-6740-477d-95ad-3173a165cd10 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:16.213789 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:16.308172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939659cf-6740-477d-95ad-3173a165cd10 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:16.349033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb171-89df-42ed-bbb8-7148e533df88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:16.349895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb171-89df-42ed-bbb8-7148e533df88 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:16.350368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb171-89df-42ed-bbb8-7148e533df88 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:16.350775 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb171-89df-42ed-bbb8-7148e533df88 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:16.351613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fb171-89df-42ed-bbb8-7148e533df88 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:16.352054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fb171-89df-42ed-bbb8-7148e533df88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:16.353653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fb171-89df-42ed-bbb8-7148e533df88 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:16.365308 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 170/332] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:16.371055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd7138-f189-4bd0-9afb-7846959fce61 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:16.442877 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:16.481807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd7138-f189-4bd0-9afb-7846959fce61 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:16.518468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55758e89-2d7e-4621-90cc-4782606b383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:16.519112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55758e89-2d7e-4621-90cc-4782606b383b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:16.519383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55758e89-2d7e-4621-90cc-4782606b383b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:16.519651 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55758e89-2d7e-4621-90cc-4782606b383b None admin] PATH_INFO: `/v3/users/09c77b42ffcd438b9c53af6356cf9c14` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:16.520831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55758e89-2d7e-4621-90cc-4782606b383b None admin] RBAC: Authorizing `identity:get_user(user_id=09c77b42ffcd438b9c53af6356cf9c14)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:16.522396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55758e89-2d7e-4621-90cc-4782606b383b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:16.524277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 163/333] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:16 2022] GET /identity/v3/users/09c77b42ffcd438b9c53af6356cf9c14 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:16.530430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb171-89df-42ed-bbb8-7148e533df88 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:16.632067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:16.649307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb171-89df-42ed-bbb8-7148e533df88 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:16.701920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262bce4-815a-469d-9114-245a27ec1309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:16.702568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262bce4-815a-469d-9114-245a27ec1309 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:16.702833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262bce4-815a-469d-9114-245a27ec1309 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:16.703147 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262bce4-815a-469d-9114-245a27ec1309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:16.703957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262bce4-815a-469d-9114-245a27ec1309 None admin] RBAC: Adding query filter params (role.id=948a63d9dffa4bdb815a397570a1d381, user.id=09c77b42ffcd438b9c53af6356cf9c14, scope.system=all) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:16.704263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262bce4-815a-469d-9114-245a27ec1309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:16.705797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262bce4-815a-469d-9114-245a27ec1309 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:16.723127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 171/334] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Sep 6 00:59:16 2022] GET /identity/v3/role_assignments?user.id=09c77b42ffcd438b9c53af6356cf9c14&scope.system=all&role.id=948a63d9dffa4bdb815a397570a1d381 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:17.821905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af89e0d-bc9b-4322-bb82-071be1e5a184 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:17.822793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af89e0d-bc9b-4322-bb82-071be1e5a184 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:17.823207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af89e0d-bc9b-4322-bb82-071be1e5a184 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:17.824750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 164/335] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:17.830692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82e21-8875-4f99-9222-b263d214451b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:17.831617 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82e21-8875-4f99-9222-b263d214451b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:17.832084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82e21-8875-4f99-9222-b263d214451b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:17.851723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-20a82e21-8875-4f99-9222-b263d214451b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:17.857329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-20a82e21-8875-4f99-9222-b263d214451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:17.870680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c32585-0dec-41cf-bfcf-308cfe23df52 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:17.871003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c32585-0dec-41cf-bfcf-308cfe23df52 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:17.871218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c32585-0dec-41cf-bfcf-308cfe23df52 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:17.873063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 165/336] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:17.878056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38d4a-dd29-4dce-a584-cf2a6e3bf437 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:17.878274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38d4a-dd29-4dce-a584-cf2a6e3bf437 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:17.878556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38d4a-dd29-4dce-a584-cf2a6e3bf437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:17.908842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-5cc38d4a-dd29-4dce-a584-cf2a6e3bf437 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:17.910045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5cc38d4a-dd29-4dce-a584-cf2a6e3bf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:17.944645 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 172/337] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:18.030075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 166/338] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:18.151217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee89f4-83d8-4fc6-a500-3bc3eb6c52f8 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:18.151820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee89f4-83d8-4fc6-a500-3bc3eb6c52f8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:18.152282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee89f4-83d8-4fc6-a500-3bc3eb6c52f8 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:18.154115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 173/339] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:18.159790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bf02e-b7bd-4d0e-97e3-3d11e0cc080f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:18.160075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bf02e-b7bd-4d0e-97e3-3d11e0cc080f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:18.160385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bf02e-b7bd-4d0e-97e3-3d11e0cc080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:18.189343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e76bf02e-b7bd-4d0e-97e3-3d11e0cc080f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:18.190565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e76bf02e-b7bd-4d0e-97e3-3d11e0cc080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:18.262365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:18.271684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 167/340] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:18.616549 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee89f4-83d8-4fc6-a500-3bc3eb6c52f8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:18.655342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bf02e-b7bd-4d0e-97e3-3d11e0cc080f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:18.728672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:18.771413 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee89f4-83d8-4fc6-a500-3bc3eb6c52f8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:18.816394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57d357-6f08-44e7-bcef-395635b0a5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:18.817505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d357-6f08-44e7-bcef-395635b0a5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:18.817981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d357-6f08-44e7-bcef-395635b0a5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:18.818438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d357-6f08-44e7-bcef-395635b0a5c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:18.822649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bf02e-b7bd-4d0e-97e3-3d11e0cc080f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:18.831670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57d357-6f08-44e7-bcef-395635b0a5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2b57d357-6f08-44e7-bcef-395635b0a5c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:18.837215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:18.838094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:18.838924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:18.838924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:18.838924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:18.838924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:18.838924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:18.838924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:18.838924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:18.838924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:18.838924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:18.838924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:18.838924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 00:59:18.838924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:18.841541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 174/341] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:18.848800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d3f62-1443-4c8c-ab50-295555ca8050 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:18.849350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d3f62-1443-4c8c-ab50-295555ca8050 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:18.849838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d3f62-1443-4c8c-ab50-295555ca8050 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:18.852659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 175/342] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:18.853572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d3f62-1443-4c8c-ab50-295555ca8050 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:18.863459 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f169ca-f59a-459a-8fc1-97d64aaf609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:18.864206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f169ca-f59a-459a-8fc1-97d64aaf609b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:18.864508 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f169ca-f59a-459a-8fc1-97d64aaf609b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:18.864780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f169ca-f59a-459a-8fc1-97d64aaf609b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:18.881602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f169ca-f59a-459a-8fc1-97d64aaf609b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-d4f169ca-f59a-459a-8fc1-97d64aaf609b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:18.887476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:18.888399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:18.889213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:18.889213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:18.889213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:18.889213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:18.889213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:18.889213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:18.889213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:18.889213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:18.889213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:18.889213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:18.889213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:18.889213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:18.892999 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 168/343] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:18.894302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f169ca-f59a-459a-8fc1-97d64aaf609b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:18.956780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:18.975030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d3f62-1443-4c8c-ab50-295555ca8050 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:19.014842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f169ca-f59a-459a-8fc1-97d64aaf609b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:19.015725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54f741-a626-4d5d-a0be-5dc0dca3b769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:19.016399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54f741-a626-4d5d-a0be-5dc0dca3b769 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:19.016680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54f741-a626-4d5d-a0be-5dc0dca3b769 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:19.016947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54f741-a626-4d5d-a0be-5dc0dca3b769 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:19.020087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:19.031771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54f741-a626-4d5d-a0be-5dc0dca3b769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9a54f741-a626-4d5d-a0be-5dc0dca3b769 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:19.037511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:19.038598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:19.039626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:19.039626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:19.039626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:19.039626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:19.039626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:19.039626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:19.039626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:19.039626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:19.039626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:19.039626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:19.039626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:19.039626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:19.043735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 176/344] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:59:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:19.047473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcfe2f-9ecd-4a5e-8db6-4a83a6300ada None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:19.047473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcfe2f-9ecd-4a5e-8db6-4a83a6300ada None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:19.047473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcfe2f-9ecd-4a5e-8db6-4a83a6300ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:19.068563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf71c0-5940-42df-9e97-77336c58b608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:19.069554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf71c0-5940-42df-9e97-77336c58b608 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:19.070017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf71c0-5940-42df-9e97-77336c58b608 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:19.070457 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf71c0-5940-42df-9e97-77336c58b608 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:19.070673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f3bcfe2f-9ecd-4a5e-8db6-4a83a6300ada None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:19.071502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf71c0-5940-42df-9e97-77336c58b608 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:19.071912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f3bcfe2f-9ecd-4a5e-8db6-4a83a6300ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:19.072173 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf71c0-5940-42df-9e97-77336c58b608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:19.073822 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf71c0-5940-42df-9e97-77336c58b608 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:19.087243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 169/345] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:19.088846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf71c0-5940-42df-9e97-77336c58b608 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:19.163556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 177/346] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:19.164161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcfe2f-9ecd-4a5e-8db6-4a83a6300ada None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:19.231074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf71c0-5940-42df-9e97-77336c58b608 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:19.250261 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:19.275210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4c197-97db-4044-995a-6961015775a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:19.276249 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4c197-97db-4044-995a-6961015775a5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:19.276874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4c197-97db-4044-995a-6961015775a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:19.277360 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4c197-97db-4044-995a-6961015775a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:19.278474 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4c197-97db-4044-995a-6961015775a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:19.279367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4c197-97db-4044-995a-6961015775a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:19.281060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4c197-97db-4044-995a-6961015775a5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:19.294466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 170/347] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:19.296102 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4c197-97db-4044-995a-6961015775a5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:19.406994 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4c197-97db-4044-995a-6961015775a5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:19.429773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcfe2f-9ecd-4a5e-8db6-4a83a6300ada None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:19.449156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a18f0-17c9-42ea-9c32-9304008a80a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:19.449806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a18f0-17c9-42ea-9c32-9304008a80a2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:19.450078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a18f0-17c9-42ea-9c32-9304008a80a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:19.450350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a18f0-17c9-42ea-9c32-9304008a80a2 None admin] PATH_INFO: `/v3/users/c7bc34c6cf47418393a8f4acfc2ae975` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:19.451593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a18f0-17c9-42ea-9c32-9304008a80a2 None admin] RBAC: Authorizing `identity:get_user(user_id=c7bc34c6cf47418393a8f4acfc2ae975)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:19.457281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a18f0-17c9-42ea-9c32-9304008a80a2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:19.459037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 171/348] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 00:59:19 2022] GET /identity/v3/users/c7bc34c6cf47418393a8f4acfc2ae975 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:19.459921 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a18f0-17c9-42ea-9c32-9304008a80a2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:19.461908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:19.473693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264ae38-6a0c-407e-91f0-f16d43b9cbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:19.480119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264ae38-6a0c-407e-91f0-f16d43b9cbf4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:19.480415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264ae38-6a0c-407e-91f0-f16d43b9cbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:19.480685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264ae38-6a0c-407e-91f0-f16d43b9cbf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:19.481375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264ae38-6a0c-407e-91f0-f16d43b9cbf4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:19.481677 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264ae38-6a0c-407e-91f0-f16d43b9cbf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:19.483134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264ae38-6a0c-407e-91f0-f16d43b9cbf4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:19.501081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 178/349] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:19.501928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264ae38-6a0c-407e-91f0-f16d43b9cbf4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:19.549343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:19.612922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a18f0-17c9-42ea-9c32-9304008a80a2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:19.658009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264ae38-6a0c-407e-91f0-f16d43b9cbf4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:19.660258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1ee9a-5f41-4a98-a3ac-d5e461c3cf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:19.661104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1ee9a-5f41-4a98-a3ac-d5e461c3cf3c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:19.661373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1ee9a-5f41-4a98-a3ac-d5e461c3cf3c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:19.661639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1ee9a-5f41-4a98-a3ac-d5e461c3cf3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:19.699457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec0546-103e-43a1-af73-fc7f85f123e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:19.699992 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec0546-103e-43a1-af73-fc7f85f123e0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:19.700263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec0546-103e-43a1-af73-fc7f85f123e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:19.700557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec0546-103e-43a1-af73-fc7f85f123e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:19.701394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec0546-103e-43a1-af73-fc7f85f123e0 None admin] RBAC: Adding query filter params (role.id=4cae4d2a35654718bfccd726a5588ba1, user.id=c7bc34c6cf47418393a8f4acfc2ae975, scope.system=all) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:19.701699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec0546-103e-43a1-af73-fc7f85f123e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:19.703338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec0546-103e-43a1-af73-fc7f85f123e0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:19.718010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 179/350] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Sep 6 00:59:19 2022] GET /identity/v3/role_assignments?user.id=c7bc34c6cf47418393a8f4acfc2ae975&scope.system=all&role.id=4cae4d2a35654718bfccd726a5588ba1 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:19.719132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec0546-103e-43a1-af73-fc7f85f123e0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:19.783049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1ee9a-5f41-4a98-a3ac-d5e461c3cf3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:19.784756 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:19.784878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1ee9a-5f41-4a98-a3ac-d5e461c3cf3c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:19.846614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:19.875544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec0546-103e-43a1-af73-fc7f85f123e0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:19.915975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 172/351] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:19.917146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1ee9a-5f41-4a98-a3ac-d5e461c3cf3c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:19.921466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1e2c7-d299-424b-8399-7f6549429b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:19.922424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1e2c7-d299-424b-8399-7f6549429b94 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:19.922903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1e2c7-d299-424b-8399-7f6549429b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:19.923365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1e2c7-d299-424b-8399-7f6549429b94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.018941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1e2c7-d299-424b-8399-7f6549429b94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:20.020816 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1e2c7-d299-424b-8399-7f6549429b94 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:20.043881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1ee9a-5f41-4a98-a3ac-d5e461c3cf3c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:20.085697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3912d-457f-46ed-a9ba-e55521ff0d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:20.086344 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3912d-457f-46ed-a9ba-e55521ff0d07 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:20.086445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:20.086621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3912d-457f-46ed-a9ba-e55521ff0d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:20.086900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3912d-457f-46ed-a9ba-e55521ff0d07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.099073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3912d-457f-46ed-a9ba-e55521ff0d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c9c3912d-457f-46ed-a9ba-e55521ff0d07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:20.103851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:20.104846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:20.105682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:20.105682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:20.105682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:20.105682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:20.105682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:20.105682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:20.105682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:20.105682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:20.105682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:20.105682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:20.105682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:20.105682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:20.106287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 173/352] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:20.107187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eab564-9373-45fa-92e3-fe675f5da0f6 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:20.107461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eab564-9373-45fa-92e3-fe675f5da0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:20.107730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eab564-9373-45fa-92e3-fe675f5da0f6 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.109436 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 174/353] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:20.113675 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eab564-9373-45fa-92e3-fe675f5da0f6 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:20.124231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:20.154204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 180/354] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:20.155827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b071f2-4808-4bdf-990c-34b18ab7d0ff None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:20.156266 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b071f2-4808-4bdf-990c-34b18ab7d0ff None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:20.156557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b071f2-4808-4bdf-990c-34b18ab7d0ff None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.157826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 181/355] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:20.158516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b071f2-4808-4bdf-990c-34b18ab7d0ff None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:20.238684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eab564-9373-45fa-92e3-fe675f5da0f6 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:20.278502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba169f5-c437-415f-8dcf-c922dd641ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:20.279067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba169f5-c437-415f-8dcf-c922dd641ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:20.279330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba169f5-c437-415f-8dcf-c922dd641ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:20.279605 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba169f5-c437-415f-8dcf-c922dd641ec6 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.280900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b071f2-4808-4bdf-990c-34b18ab7d0ff None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:20.281028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba169f5-c437-415f-8dcf-c922dd641ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:20.282649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba169f5-c437-415f-8dcf-c922dd641ec6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:20.288346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 175/356] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:20 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:20.288346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52e62e-1a99-4289-8cca-94641a4ae00e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:20.288346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52e62e-1a99-4289-8cca-94641a4ae00e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:20.288346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52e62e-1a99-4289-8cca-94641a4ae00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.309264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ee52e62e-1a99-4289-8cca-94641a4ae00e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:20.309264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ee52e62e-1a99-4289-8cca-94641a4ae00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:20.322366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953617ae-4121-45cf-8f3b-bff60dce4a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:20.322980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953617ae-4121-45cf-8f3b-bff60dce4a2b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:20.323259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953617ae-4121-45cf-8f3b-bff60dce4a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:20.323525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953617ae-4121-45cf-8f3b-bff60dce4a2b None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.324191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953617ae-4121-45cf-8f3b-bff60dce4a2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:20.324521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953617ae-4121-45cf-8f3b-bff60dce4a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:20.325953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953617ae-4121-45cf-8f3b-bff60dce4a2b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:20.336398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 182/357] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:20.336567 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fa355-8aef-4ddd-9fe5-0eda10d00743 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:20.336754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fa355-8aef-4ddd-9fe5-0eda10d00743 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:20.337022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fa355-8aef-4ddd-9fe5-0eda10d00743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.356277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8d0fa355-8aef-4ddd-9fe5-0eda10d00743 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:20.357501 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8d0fa355-8aef-4ddd-9fe5-0eda10d00743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:20.359606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:20.393663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 176/358] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:20.394839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52e62e-1a99-4289-8cca-94641a4ae00e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:20.398983 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:20.444816 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 183/359] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:20.445894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fa355-8aef-4ddd-9fe5-0eda10d00743 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:20.534640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52e62e-1a99-4289-8cca-94641a4ae00e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:20.555925 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fa355-8aef-4ddd-9fe5-0eda10d00743 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:20.577051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78b6a3-49a5-4f9e-aef9-8b088cbd3905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:20.577786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78b6a3-49a5-4f9e-aef9-8b088cbd3905 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:20.578066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78b6a3-49a5-4f9e-aef9-8b088cbd3905 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:20.578335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78b6a3-49a5-4f9e-aef9-8b088cbd3905 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.579526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78b6a3-49a5-4f9e-aef9-8b088cbd3905 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:20.580979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78b6a3-49a5-4f9e-aef9-8b088cbd3905 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:20.582907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 177/360] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:20 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:20.583795 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78b6a3-49a5-4f9e-aef9-8b088cbd3905 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:20.607823 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109558c8-0235-482d-b064-4eeff7ac67c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:20.609134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109558c8-0235-482d-b064-4eeff7ac67c9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:20.609414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109558c8-0235-482d-b064-4eeff7ac67c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:20.609680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109558c8-0235-482d-b064-4eeff7ac67c9 None admin] PATH_INFO: `/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.616460 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109558c8-0235-482d-b064-4eeff7ac67c9 None admin] RBAC: Authorizing `identity:get_group(group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:20.618072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109558c8-0235-482d-b064-4eeff7ac67c9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:20.619850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 184/361] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:20 2022] GET /identity/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:20.621843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109558c8-0235-482d-b064-4eeff7ac67c9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:20.624828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:20.685239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:20.718099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78b6a3-49a5-4f9e-aef9-8b088cbd3905 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:20.746451 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109558c8-0235-482d-b064-4eeff7ac67c9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:20.767771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2b16b-61b4-41cd-a488-6443095ec7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:20.768425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2b16b-61b4-41cd-a488-6443095ec7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:20.768702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2b16b-61b4-41cd-a488-6443095ec7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:20.768972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2b16b-61b4-41cd-a488-6443095ec7a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.794634 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870887ba-9caf-4fb6-aff1-696d7494e6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:20.795542 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870887ba-9caf-4fb6-aff1-696d7494e6ca None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:20.796331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870887ba-9caf-4fb6-aff1-696d7494e6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:20.796331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870887ba-9caf-4fb6-aff1-696d7494e6ca None admin] PATH_INFO: `/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.797916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870887ba-9caf-4fb6-aff1-696d7494e6ca None admin] RBAC: Authorizing `identity:get_group(group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:20.799839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870887ba-9caf-4fb6-aff1-696d7494e6ca None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:20.801822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 185/362] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:20 2022] GET /identity/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:20.802582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870887ba-9caf-4fb6-aff1-696d7494e6ca None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:20.850380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2b16b-61b4-41cd-a488-6443095ec7a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:20.851881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2b16b-61b4-41cd-a488-6443095ec7a1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:20.887115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:20.930465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870887ba-9caf-4fb6-aff1-696d7494e6ca None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:20.934609 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:20.967923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf906b6-eb27-4369-9d46-13e9dbde8930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:20.968673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf906b6-eb27-4369-9d46-13e9dbde8930 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:20.968951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf906b6-eb27-4369-9d46-13e9dbde8930 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:20.969228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf906b6-eb27-4369-9d46-13e9dbde8930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:20.969972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf906b6-eb27-4369-9d46-13e9dbde8930 None admin] RBAC: Adding query filter params (group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90, role.id=948a63d9dffa4bdb815a397570a1d381, scope.project.id=df4081668f8c44e3a8072b71f9f14168) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:20.971082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf906b6-eb27-4369-9d46-13e9dbde8930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:20.971782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf906b6-eb27-4369-9d46-13e9dbde8930 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:20.973618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 178/363] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:20.974951 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2b16b-61b4-41cd-a488-6443095ec7a1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:20.983572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 186/364] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 6 00:59:20 2022] GET /identity/v3/role_assignments?group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90&scope.project.id=df4081668f8c44e3a8072b71f9f14168&role.id=948a63d9dffa4bdb815a397570a1d381 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:20.984596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf906b6-eb27-4369-9d46-13e9dbde8930 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:21.123271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2b16b-61b4-41cd-a488-6443095ec7a1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:21.123700 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf906b6-eb27-4369-9d46-13e9dbde8930 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:21.165565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2a355-adb0-4f1c-a73b-74aa0c0d9b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:21.166204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2a355-adb0-4f1c-a73b-74aa0c0d9b99 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:21.166474 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2a355-adb0-4f1c-a73b-74aa0c0d9b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:21.166737 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2a355-adb0-4f1c-a73b-74aa0c0d9b99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:21.168658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5a994-e8bb-47d3-bad2-d224d277a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:21.169931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5a994-e8bb-47d3-bad2-d224d277a863 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:21.170397 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5a994-e8bb-47d3-bad2-d224d277a863 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:21.170851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5a994-e8bb-47d3-bad2-d224d277a863 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:21.173659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:21.179942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2a355-adb0-4f1c-a73b-74aa0c0d9b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-feb2a355-adb0-4f1c-a73b-74aa0c0d9b99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:21.185119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:21.186037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 179/365] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:59:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:21.186840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2a355-adb0-4f1c-a73b-74aa0c0d9b99 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:21.192230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5a994-e8bb-47d3-bad2-d224d277a863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-fae5a994-e8bb-47d3-bad2-d224d277a863 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:21.198311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:21.199206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:21.200004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:21.200004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:21.200004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:21.200004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:21.200004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:21.200004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:21.200004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:21.200004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:21.200004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:21.200004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:21.200004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:59:21.200004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:21.200661 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 187/366] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:21.201183 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5a994-e8bb-47d3-bad2-d224d277a863 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:21.222373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:21.308256 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2a355-adb0-4f1c-a73b-74aa0c0d9b99 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:21.352738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5a994-e8bb-47d3-bad2-d224d277a863 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:21.357522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220ee32-2e46-4744-b82a-921cf2a06286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:21.358252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220ee32-2e46-4744-b82a-921cf2a06286 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:21.358622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220ee32-2e46-4744-b82a-921cf2a06286 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:21.359211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220ee32-2e46-4744-b82a-921cf2a06286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:21.359903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220ee32-2e46-4744-b82a-921cf2a06286 None admin] RBAC: Adding query filter params (group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90, role.id=5f42b81ce88a4943902b63aaaffc1bc2, scope.project.id=df4081668f8c44e3a8072b71f9f14168) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:21.360327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220ee32-2e46-4744-b82a-921cf2a06286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:21.362417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220ee32-2e46-4744-b82a-921cf2a06286 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:21.369927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 180/367] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 6 00:59:21 2022] GET /identity/v3/role_assignments?group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90&scope.project.id=df4081668f8c44e3a8072b71f9f14168&role.id=5f42b81ce88a4943902b63aaaffc1bc2 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:21.370749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220ee32-2e46-4744-b82a-921cf2a06286 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:21.397495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682f62-8757-4d03-b6b0-d1200c37a406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:21.398604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682f62-8757-4d03-b6b0-d1200c37a406 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:21.399223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682f62-8757-4d03-b6b0-d1200c37a406 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:21.399691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682f62-8757-4d03-b6b0-d1200c37a406 None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:21.401193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7682f62-8757-4d03-b6b0-d1200c37a406 None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:21.403184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7682f62-8757-4d03-b6b0-d1200c37a406 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:21.405387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 188/368] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:21 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:21.406321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682f62-8757-4d03-b6b0-d1200c37a406 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:21.491509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:21.506720 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:21.514394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220ee32-2e46-4744-b82a-921cf2a06286 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:21.544691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682f62-8757-4d03-b6b0-d1200c37a406 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:21.565714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e125de-bb05-45b5-8909-fcdc30d0b8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:21.566341 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e125de-bb05-45b5-8909-fcdc30d0b8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:21.566619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e125de-bb05-45b5-8909-fcdc30d0b8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:21.566887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e125de-bb05-45b5-8909-fcdc30d0b8a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:21.567557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e125de-bb05-45b5-8909-fcdc30d0b8a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:21.567858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e125de-bb05-45b5-8909-fcdc30d0b8a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:21.569300 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e125de-bb05-45b5-8909-fcdc30d0b8a4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:21.578464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 181/369] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:21.579175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e125de-bb05-45b5-8909-fcdc30d0b8a4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:21.589717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4f401-39c1-4337-8026-8cfb194675cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:21.590343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4f401-39c1-4337-8026-8cfb194675cc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:21.590692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4f401-39c1-4337-8026-8cfb194675cc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:21.591477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4f401-39c1-4337-8026-8cfb194675cc None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:21.592158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4f401-39c1-4337-8026-8cfb194675cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:21.592489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4f401-39c1-4337-8026-8cfb194675cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:21.594848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4f401-39c1-4337-8026-8cfb194675cc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:21.606414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 189/370] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:21.607591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4f401-39c1-4337-8026-8cfb194675cc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:21.718184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e125de-bb05-45b5-8909-fcdc30d0b8a4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:21.763497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4f401-39c1-4337-8026-8cfb194675cc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:21.767445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ab735-9d17-45df-b583-50c12adc4818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:21.768171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ab735-9d17-45df-b583-50c12adc4818 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:21.768544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ab735-9d17-45df-b583-50c12adc4818 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:21.768889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ab735-9d17-45df-b583-50c12adc4818 None admin] PATH_INFO: `/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:21.770076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ab735-9d17-45df-b583-50c12adc4818 None admin] RBAC: Authorizing `identity:get_group(group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:21.771724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ab735-9d17-45df-b583-50c12adc4818 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:21.773559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 182/371] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:21 2022] GET /identity/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:21.774152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ab735-9d17-45df-b583-50c12adc4818 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:21.795406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:21.812297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:21.813624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de659446-2428-463c-af46-4b90d5d869e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:21.814644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de659446-2428-463c-af46-4b90d5d869e9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:21.814918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de659446-2428-463c-af46-4b90d5d869e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:21.815533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de659446-2428-463c-af46-4b90d5d869e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:21.904332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de659446-2428-463c-af46-4b90d5d869e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:21.905961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de659446-2428-463c-af46-4b90d5d869e9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:21.911322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ab735-9d17-45df-b583-50c12adc4818 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:21.967949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66be112-41b4-40c1-ae04-a8ebbf176861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:21.968712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66be112-41b4-40c1-ae04-a8ebbf176861 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:21.968936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66be112-41b4-40c1-ae04-a8ebbf176861 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:21.969201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66be112-41b4-40c1-ae04-a8ebbf176861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:22.034497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 190/372] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:22.038231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de659446-2428-463c-af46-4b90d5d869e9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:22.077454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66be112-41b4-40c1-ae04-a8ebbf176861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:22.079079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66be112-41b4-40c1-ae04-a8ebbf176861 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:22.083113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:22.108361 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:22.187972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de659446-2428-463c-af46-4b90d5d869e9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:22.197480 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 183/373] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:22.198730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66be112-41b4-40c1-ae04-a8ebbf176861 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:22.231837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c19324-be10-45b7-8cf7-c6b300a0ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:22.232411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c19324-be10-45b7-8cf7-c6b300a0ff4a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:22.232698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c19324-be10-45b7-8cf7-c6b300a0ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:22.233223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c19324-be10-45b7-8cf7-c6b300a0ff4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:22.234067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c19324-be10-45b7-8cf7-c6b300a0ff4a None admin] RBAC: Adding query filter params (group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90, role.id=948a63d9dffa4bdb815a397570a1d381, scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:22.234403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c19324-be10-45b7-8cf7-c6b300a0ff4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:22.236116 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c19324-be10-45b7-8cf7-c6b300a0ff4a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:22.243272 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 191/374] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 6 00:59:22 2022] GET /identity/v3/role_assignments?group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90&scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1&role.id=948a63d9dffa4bdb815a397570a1d381 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:22.245060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c19324-be10-45b7-8cf7-c6b300a0ff4a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:22.370007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:22.387651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c19324-be10-45b7-8cf7-c6b300a0ff4a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:22.403392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66be112-41b4-40c1-ae04-a8ebbf176861 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:22.469879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:22.485175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb590c-2061-486e-a1a1-99260fb90584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:22.485756 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb590c-2061-486e-a1a1-99260fb90584 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:22.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb590c-2061-486e-a1a1-99260fb90584 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:22.486320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb590c-2061-486e-a1a1-99260fb90584 None admin] PATH_INFO: `/v3/projects/13e2411eaf2541e38a8d727a7403f2f2` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:22.487984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb590c-2061-486e-a1a1-99260fb90584 None admin] RBAC: Authorizing `identity:get_project(project_id=13e2411eaf2541e38a8d727a7403f2f2)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:22.489029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b09e24-8eed-4a73-99e9-e5c9c73f44bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:22.489529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb590c-2061-486e-a1a1-99260fb90584 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:22.490283 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b09e24-8eed-4a73-99e9-e5c9c73f44bd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:22.490754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b09e24-8eed-4a73-99e9-e5c9c73f44bd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:22.491199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 192/375] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:22 2022] GET /identity/v3/projects/13e2411eaf2541e38a8d727a7403f2f2 => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:22.491414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b09e24-8eed-4a73-99e9-e5c9c73f44bd None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:22.492824 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b09e24-8eed-4a73-99e9-e5c9c73f44bd None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:22.494562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b09e24-8eed-4a73-99e9-e5c9c73f44bd None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:22.496718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 184/376] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:22 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:22.500550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb590c-2061-486e-a1a1-99260fb90584 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:22.502942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b09e24-8eed-4a73-99e9-e5c9c73f44bd None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:22.612457 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b09e24-8eed-4a73-99e9-e5c9c73f44bd None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:22.648772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a88b2-c422-494a-bcce-adf30a2a39bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:22.649782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a88b2-c422-494a-bcce-adf30a2a39bb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:22.650374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a88b2-c422-494a-bcce-adf30a2a39bb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:22.650861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a88b2-c422-494a-bcce-adf30a2a39bb None admin] PATH_INFO: `/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:22.652189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a88b2-c422-494a-bcce-adf30a2a39bb None admin] RBAC: Authorizing `identity:get_group(group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:22.654047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a88b2-c422-494a-bcce-adf30a2a39bb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:22.660735 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 185/377] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:22 2022] GET /identity/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:22.663541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a88b2-c422-494a-bcce-adf30a2a39bb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:22.733592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:22.758294 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb590c-2061-486e-a1a1-99260fb90584 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:22.772579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a88b2-c422-494a-bcce-adf30a2a39bb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:22.809988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9484b9b-a360-46ed-b3db-65b2405d07e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:22.811260 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484b9b-a360-46ed-b3db-65b2405d07e3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:22.811754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484b9b-a360-46ed-b3db-65b2405d07e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:22.812241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484b9b-a360-46ed-b3db-65b2405d07e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:22.813408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9484b9b-a360-46ed-b3db-65b2405d07e3 None admin] RBAC: Adding query filter params (group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90, role.id=5f42b81ce88a4943902b63aaaffc1bc2, scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:22.813934 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9484b9b-a360-46ed-b3db-65b2405d07e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:22.815617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9484b9b-a360-46ed-b3db-65b2405d07e3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:22.822177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 186/378] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 6 00:59:22 2022] GET /identity/v3/role_assignments?group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90&scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1&role.id=5f42b81ce88a4943902b63aaaffc1bc2 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:22.829252 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0546d9-9e73-4e9d-ae01-fb0b2ef284b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:22.829924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0546d9-9e73-4e9d-ae01-fb0b2ef284b7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:22.830197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0546d9-9e73-4e9d-ae01-fb0b2ef284b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:22.830466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0546d9-9e73-4e9d-ae01-fb0b2ef284b7 None admin] PATH_INFO: `/v3/groups/f9d93038b64c4d9f99fa52a2491d069d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:22.841151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0546d9-9e73-4e9d-ae01-fb0b2ef284b7 None admin] RBAC: Authorizing `identity:get_group(group_id=f9d93038b64c4d9f99fa52a2491d069d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:22.842722 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0546d9-9e73-4e9d-ae01-fb0b2ef284b7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:22.845043 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 193/379] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:22 2022] GET /identity/v3/groups/f9d93038b64c4d9f99fa52a2491d069d => generated 229 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:22.850796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9484b9b-a360-46ed-b3db-65b2405d07e3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:22.989061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9484b9b-a360-46ed-b3db-65b2405d07e3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:23.032269 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:23.042163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b23658-95e1-497d-80de-309daaa1abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:23.048128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b23658-95e1-497d-80de-309daaa1abfa None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:23.048128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b23658-95e1-497d-80de-309daaa1abfa None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:23.048128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b23658-95e1-497d-80de-309daaa1abfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:23.048128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b23658-95e1-497d-80de-309daaa1abfa None admin] RBAC: Adding query filter params (group.id=f9d93038b64c4d9f99fa52a2491d069d, role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=13e2411eaf2541e38a8d727a7403f2f2) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:23.048128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b23658-95e1-497d-80de-309daaa1abfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:23.048128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b23658-95e1-497d-80de-309daaa1abfa None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:23.056317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 187/380] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 6 00:59:22 2022] GET /identity/v3/role_assignments?group.id=f9d93038b64c4d9f99fa52a2491d069d&scope.project.id=13e2411eaf2541e38a8d727a7403f2f2&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:23.294183 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d46a7-0841-48ea-997c-45b621ab1d4c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:23.294696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d46a7-0841-48ea-997c-45b621ab1d4c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:23.294696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d46a7-0841-48ea-997c-45b621ab1d4c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:23.295966 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 194/381] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:23.301341 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d63a94-76e3-4e75-882c-b33263040726 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:23.301633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d63a94-76e3-4e75-882c-b33263040726 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:23.301936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d63a94-76e3-4e75-882c-b33263040726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:23.329443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c5d63a94-76e3-4e75-882c-b33263040726 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:23.330738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c5d63a94-76e3-4e75-882c-b33263040726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:23.419927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 188/382] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:23.651594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c47563-f797-498a-a238-efc2e4fb7fd7 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:23.652207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c47563-f797-498a-a238-efc2e4fb7fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:23.652701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c47563-f797-498a-a238-efc2e4fb7fd7 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:23.654226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 195/383] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:23.660888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff15b-5864-4f14-adeb-c9b60925f926 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:23.661168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff15b-5864-4f14-adeb-c9b60925f926 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:23.661438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff15b-5864-4f14-adeb-c9b60925f926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:23.685240 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-49dff15b-5864-4f14-adeb-c9b60925f926 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:23.686431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-49dff15b-5864-4f14-adeb-c9b60925f926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:23.743847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c47563-f797-498a-a238-efc2e4fb7fd7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:23.772267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 189/384] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:23.779949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:23.885879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c47563-f797-498a-a238-efc2e4fb7fd7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:23.930957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a9c1e-8976-4d6d-996a-d957d47b470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:23.931497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a9c1e-8976-4d6d-996a-d957d47b470d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:23.931773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a9c1e-8976-4d6d-996a-d957d47b470d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:23.932042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a9c1e-8976-4d6d-996a-d957d47b470d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:23.945250 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a9c1e-8976-4d6d-996a-d957d47b470d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c67a9c1e-8976-4d6d-996a-d957d47b470d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:23.953136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:23.954023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:23.954865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 196/385] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:59:23.961868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dff15b-5864-4f14-adeb-c9b60925f926 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:24.024438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:24.075860 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dff15b-5864-4f14-adeb-c9b60925f926 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:24.112626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a9c1e-8976-4d6d-996a-d957d47b470d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:24.113211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b500220-b29f-4818-aa46-95c3a234c001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:24.114115 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b500220-b29f-4818-aa46-95c3a234c001 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:24.114592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b500220-b29f-4818-aa46-95c3a234c001 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:24.115059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b500220-b29f-4818-aa46-95c3a234c001 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:24.115922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b500220-b29f-4818-aa46-95c3a234c001 None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:24.116465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b500220-b29f-4818-aa46-95c3a234c001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:24.117948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b500220-b29f-4818-aa46-95c3a234c001 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:24.135004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 190/386] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:24.140497 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b500220-b29f-4818-aa46-95c3a234c001 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:24.232743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:24.257285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a9c1e-8976-4d6d-996a-d957d47b470d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:24.325269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f5372-c644-42b9-86a2-45d727d56a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:24.326833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f5372-c644-42b9-86a2-45d727d56a95 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:24.327313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f5372-c644-42b9-86a2-45d727d56a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:24.329295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f5372-c644-42b9-86a2-45d727d56a95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:24.340906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b500220-b29f-4818-aa46-95c3a234c001 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:24.353951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f5372-c644-42b9-86a2-45d727d56a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-141f5372-c644-42b9-86a2-45d727d56a95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:24.366053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:24.367057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:24.367937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:24.367937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:24.367937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:24.367937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:24.367937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:24.367937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:24.367937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:24.367937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:24.367937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:24.367937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:24.367937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:24.367937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:24.371769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 197/387] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:59:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:59:24.378131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f5372-c644-42b9-86a2-45d727d56a95 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:24.378601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:24.421887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880a9c3-a4d0-4ec8-bf32-928232ea9f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:24.422746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880a9c3-a4d0-4ec8-bf32-928232ea9f2e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:24.423071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880a9c3-a4d0-4ec8-bf32-928232ea9f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:24.423345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880a9c3-a4d0-4ec8-bf32-928232ea9f2e None admin] PATH_INFO: `/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:24.424508 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880a9c3-a4d0-4ec8-bf32-928232ea9f2e None admin] RBAC: Authorizing `identity:get_group(group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:24.426063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880a9c3-a4d0-4ec8-bf32-928232ea9f2e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:24.427654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 191/388] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:24 2022] GET /identity/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:24.437154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880a9c3-a4d0-4ec8-bf32-928232ea9f2e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:24.534053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f5372-c644-42b9-86a2-45d727d56a95 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:24.578212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a710c1-f240-4f5a-9ab5-597bec5727db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:24.578831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a710c1-f240-4f5a-9ab5-597bec5727db None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:24.579107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a710c1-f240-4f5a-9ab5-597bec5727db None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:24.579767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a710c1-f240-4f5a-9ab5-597bec5727db None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:24.580708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a710c1-f240-4f5a-9ab5-597bec5727db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:24.581015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a710c1-f240-4f5a-9ab5-597bec5727db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:24.582453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a710c1-f240-4f5a-9ab5-597bec5727db None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:24.582979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880a9c3-a4d0-4ec8-bf32-928232ea9f2e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:24.592247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 198/389] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:24.597970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d488d-6d67-47d7-9451-9b7df3c0c324 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:24.598256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d488d-6d67-47d7-9451-9b7df3c0c324 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:24.598529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d488d-6d67-47d7-9451-9b7df3c0c324 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:24.599913 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 199/390] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:24.602351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d488d-6d67-47d7-9451-9b7df3c0c324 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:24.606895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:24.631779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a766f-d13e-445f-830e-12a8ca3f11cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:24.632896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a766f-d13e-445f-830e-12a8ca3f11cb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:24.633380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a766f-d13e-445f-830e-12a8ca3f11cb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:24.633894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a766f-d13e-445f-830e-12a8ca3f11cb None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:24.635332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a766f-d13e-445f-830e-12a8ca3f11cb None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:24.637304 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a766f-d13e-445f-830e-12a8ca3f11cb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:24.644324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 192/391] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:24 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:24.645757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a0c91-d13d-46c3-9cd2-7e751f5e3a98 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:24.646278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a0c91-d13d-46c3-9cd2-7e751f5e3a98 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:24.646742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a0c91-d13d-46c3-9cd2-7e751f5e3a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:24.667328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-215a0c91-d13d-46c3-9cd2-7e751f5e3a98 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:24.668837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-215a0c91-d13d-46c3-9cd2-7e751f5e3a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:24.709074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d488d-6d67-47d7-9451-9b7df3c0c324 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:24.717073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:24.743092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ade05-dc07-4e53-ab78-283242ffed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:24.743802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ade05-dc07-4e53-ab78-283242ffed9e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:24.744080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ade05-dc07-4e53-ab78-283242ffed9e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:24.744389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ade05-dc07-4e53-ab78-283242ffed9e None admin] PATH_INFO: `/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:24.745475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ade05-dc07-4e53-ab78-283242ffed9e None admin] RBAC: Authorizing `identity:get_group(group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:24.752348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ade05-dc07-4e53-ab78-283242ffed9e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:24.752348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 200/392] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:24 2022] GET /identity/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:24.752348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ade05-dc07-4e53-ab78-283242ffed9e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:24.752614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 193/393] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:24.761308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a0c91-d13d-46c3-9cd2-7e751f5e3a98 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:24.860738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:24.881259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ade05-dc07-4e53-ab78-283242ffed9e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:24.938205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e903ab-50be-4146-bb00-99836e64fbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:24.939104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e903ab-50be-4146-bb00-99836e64fbbb None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:24.939378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e903ab-50be-4146-bb00-99836e64fbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:24.939646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e903ab-50be-4146-bb00-99836e64fbbb None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:24.944749 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e903ab-50be-4146-bb00-99836e64fbbb None admin] RBAC: Authorizing `identity:create_grant(project_id=df4081668f8c44e3a8072b71f9f14168, group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:24.946245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e903ab-50be-4146-bb00-99836e64fbbb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:24.968998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 201/394] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Sep 6 00:59:24 2022] PUT /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:24.974930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a0c91-d13d-46c3-9cd2-7e751f5e3a98 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:25.042778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ea0ac-07c7-4fad-bfb2-9327db9de61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:25.044646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ea0ac-07c7-4fad-bfb2-9327db9de61c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:25.045058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ea0ac-07c7-4fad-bfb2-9327db9de61c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:25.045448 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ea0ac-07c7-4fad-bfb2-9327db9de61c None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:25.046810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ea0ac-07c7-4fad-bfb2-9327db9de61c None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:25.052568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ea0ac-07c7-4fad-bfb2-9327db9de61c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:25.054939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 194/395] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:24 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:25.060820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e903ab-50be-4146-bb00-99836e64fbbb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:25.127545 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ea0ac-07c7-4fad-bfb2-9327db9de61c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:25.187417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e903ab-50be-4146-bb00-99836e64fbbb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:25.210543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:25.220903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:25.228165 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f37ee7-5586-4069-b1de-4be2e3991ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:25.228943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f37ee7-5586-4069-b1de-4be2e3991ed2 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:25.229220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f37ee7-5586-4069-b1de-4be2e3991ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:25.229489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f37ee7-5586-4069-b1de-4be2e3991ed2 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90/roles/5f42b81ce88a4943902b63aaaffc1bc2` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:25.232206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f37ee7-5586-4069-b1de-4be2e3991ed2 None admin] RBAC: Authorizing `identity:create_grant(project_id=df4081668f8c44e3a8072b71f9f14168, group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90, role_id=5f42b81ce88a4943902b63aaaffc1bc2)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:25.234473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f37ee7-5586-4069-b1de-4be2e3991ed2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:25.250373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 202/396] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Sep 6 00:59:25 2022] PUT /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90/roles/5f42b81ce88a4943902b63aaaffc1bc2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:25.282311 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ea0ac-07c7-4fad-bfb2-9327db9de61c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:25.339043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994df03c-6b29-43fc-bfa4-fbc343ecdf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:25.339695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994df03c-6b29-43fc-bfa4-fbc343ecdf0e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:25.340016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994df03c-6b29-43fc-bfa4-fbc343ecdf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:25.340308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994df03c-6b29-43fc-bfa4-fbc343ecdf0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:25.357199 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994df03c-6b29-43fc-bfa4-fbc343ecdf0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-994df03c-6b29-43fc-bfa4-fbc343ecdf0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:25.362395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:25.363265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:25.364080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 195/397] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:25.369924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f37ee7-5586-4069-b1de-4be2e3991ed2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:25.377807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4fc27-1860-4bdf-9e0b-7bc9141f3b46 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:25.378074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4fc27-1860-4bdf-9e0b-7bc9141f3b46 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:25.378290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4fc27-1860-4bdf-9e0b-7bc9141f3b46 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:25.379641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 196/398] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 00:59:25.384956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3197e0-1c31-4fea-9136-0a07f98882dd None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:25.385237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3197e0-1c31-4fea-9136-0a07f98882dd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:25.385511 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3197e0-1c31-4fea-9136-0a07f98882dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:25.404404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-af3197e0-1c31-4fea-9136-0a07f98882dd None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:25.405804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-af3197e0-1c31-4fea-9136-0a07f98882dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:25.484095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f37ee7-5586-4069-b1de-4be2e3991ed2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:25.519960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 197/399] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:25.521018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0ee3a-44c2-4a94-b413-bfb7f9e7f30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:25.521614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0ee3a-44c2-4a94-b413-bfb7f9e7f30d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:25.521888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0ee3a-44c2-4a94-b413-bfb7f9e7f30d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:25.522156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0ee3a-44c2-4a94-b413-bfb7f9e7f30d None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:25.522825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0ee3a-44c2-4a94-b413-bfb7f9e7f30d None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:25.523131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0ee3a-44c2-4a94-b413-bfb7f9e7f30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:25.524593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0ee3a-44c2-4a94-b413-bfb7f9e7f30d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:25.534456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 203/400] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:25.540886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3197e0-1c31-4fea-9136-0a07f98882dd None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:25.562058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16e18b-f433-4627-96f9-1057345cc150 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:25.562640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16e18b-f433-4627-96f9-1057345cc150 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:25.563089 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16e18b-f433-4627-96f9-1057345cc150 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:25.564891 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 204/401] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:25.571374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049306b-a5a6-41a8-99e1-7986f5344d51 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:25.571885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049306b-a5a6-41a8-99e1-7986f5344d51 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:25.572389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049306b-a5a6-41a8-99e1-7986f5344d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:25.585977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:25.592898 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2049306b-a5a6-41a8-99e1-7986f5344d51 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:25.595126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2049306b-a5a6-41a8-99e1-7986f5344d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:25.659049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3197e0-1c31-4fea-9136-0a07f98882dd None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:25.662218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:25.693866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 205/402] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:25.704567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c905b6-5aae-42b7-a607-70e84cc410d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:25.705532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c905b6-5aae-42b7-a607-70e84cc410d1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:25.706016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c905b6-5aae-42b7-a607-70e84cc410d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:25.706469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c905b6-5aae-42b7-a607-70e84cc410d1 None admin] PATH_INFO: `/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:25.707800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c905b6-5aae-42b7-a607-70e84cc410d1 None admin] RBAC: Authorizing `identity:get_group(group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:25.709517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c905b6-5aae-42b7-a607-70e84cc410d1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:25.711654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 198/403] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:25 2022] GET /identity/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:25.717106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049306b-a5a6-41a8-99e1-7986f5344d51 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:25.837926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c905b6-5aae-42b7-a607-70e84cc410d1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:25.874569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049306b-a5a6-41a8-99e1-7986f5344d51 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:25.937415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1fad7-5b43-429a-ba3b-a60e88fbaf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:25.938471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1fad7-5b43-429a-ba3b-a60e88fbaf3e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:25.938751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1fad7-5b43-429a-ba3b-a60e88fbaf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:25.939023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1fad7-5b43-429a-ba3b-a60e88fbaf3e None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:25.941113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1fad7-5b43-429a-ba3b-a60e88fbaf3e None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:25.943415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1fad7-5b43-429a-ba3b-a60e88fbaf3e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:25.945390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 206/404] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:25 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:25.950847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1fad7-5b43-429a-ba3b-a60e88fbaf3e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:25.973275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c905b6-5aae-42b7-a607-70e84cc410d1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:25.991024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:26.008960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198e73c-4263-4dd4-98a6-a6518928e553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:26.008960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198e73c-4263-4dd4-98a6-a6518928e553 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:26.009247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198e73c-4263-4dd4-98a6-a6518928e553 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:26.009485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198e73c-4263-4dd4-98a6-a6518928e553 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:26.020227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198e73c-4263-4dd4-98a6-a6518928e553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e198e73c-4263-4dd4-98a6-a6518928e553 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:26.025588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:26.026455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:26.027264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 199/405] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:59:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:59:26.032859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198e73c-4263-4dd4-98a6-a6518928e553 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:26.106401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:26.145244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198e73c-4263-4dd4-98a6-a6518928e553 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:26.174166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1fad7-5b43-429a-ba3b-a60e88fbaf3e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:26.180456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad1c93-291a-4609-8087-2ce97a2583f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:26.181068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad1c93-291a-4609-8087-2ce97a2583f1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:26.181340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad1c93-291a-4609-8087-2ce97a2583f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:26.181608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad1c93-291a-4609-8087-2ce97a2583f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:26.182266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad1c93-291a-4609-8087-2ce97a2583f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:26.182563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad1c93-291a-4609-8087-2ce97a2583f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:26.184044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad1c93-291a-4609-8087-2ce97a2583f1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:26.197405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 200/406] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:26.198206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad1c93-291a-4609-8087-2ce97a2583f1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:26.219999 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369778b-76b5-4a90-89d7-a556fde7ddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:26.220702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369778b-76b5-4a90-89d7-a556fde7ddc3 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:26.220984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369778b-76b5-4a90-89d7-a556fde7ddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:26.221257 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369778b-76b5-4a90-89d7-a556fde7ddc3 None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:26.223152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369778b-76b5-4a90-89d7-a556fde7ddc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=51dad9b4ad744f4d8da5d8d177684aa1, group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:26.224679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369778b-76b5-4a90-89d7-a556fde7ddc3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:26.230917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:26.245728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 207/407] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Sep 6 00:59:25 2022] PUT /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:26.246576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369778b-76b5-4a90-89d7-a556fde7ddc3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:26.368326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad1c93-291a-4609-8087-2ce97a2583f1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:26.403036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccd2b8-1f9d-4a75-a2d0-11e867856e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:26.403695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccd2b8-1f9d-4a75-a2d0-11e867856e6e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:26.403964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccd2b8-1f9d-4a75-a2d0-11e867856e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:26.404231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccd2b8-1f9d-4a75-a2d0-11e867856e6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:26.415949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccd2b8-1f9d-4a75-a2d0-11e867856e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-63ccd2b8-1f9d-4a75-a2d0-11e867856e6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:26.422236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:26.423129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:26.424274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 201/408] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:59:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:26.430571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccd2b8-1f9d-4a75-a2d0-11e867856e6e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:26.464881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369778b-76b5-4a90-89d7-a556fde7ddc3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:26.479892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:26.512771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d429f32-7146-4e2e-aaf6-3d64946c2226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:26.513422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429f32-7146-4e2e-aaf6-3d64946c2226 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:26.513702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429f32-7146-4e2e-aaf6-3d64946c2226 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:26.513966 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429f32-7146-4e2e-aaf6-3d64946c2226 None admin] PATH_INFO: `/v3/groups/f9d93038b64c4d9f99fa52a2491d069d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:26.515368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d429f32-7146-4e2e-aaf6-3d64946c2226 None admin] RBAC: Authorizing `identity:get_group(group_id=f9d93038b64c4d9f99fa52a2491d069d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:26.518868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d429f32-7146-4e2e-aaf6-3d64946c2226 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:26.519534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 208/409] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:26 2022] GET /identity/v3/groups/f9d93038b64c4d9f99fa52a2491d069d => generated 229 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:26.525659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d429f32-7146-4e2e-aaf6-3d64946c2226 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:26.538662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:26.558004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccd2b8-1f9d-4a75-a2d0-11e867856e6e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:26.600362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85607f-95d9-422b-8a54-fd38d53e4714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:26.601564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85607f-95d9-422b-8a54-fd38d53e4714 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:26.601944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85607f-95d9-422b-8a54-fd38d53e4714 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:26.602362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85607f-95d9-422b-8a54-fd38d53e4714 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:26.603349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85607f-95d9-422b-8a54-fd38d53e4714 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:26.603725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85607f-95d9-422b-8a54-fd38d53e4714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:26.606288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85607f-95d9-422b-8a54-fd38d53e4714 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:26.618902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 202/410] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:26.626856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85607f-95d9-422b-8a54-fd38d53e4714 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:26.652906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d429f32-7146-4e2e-aaf6-3d64946c2226 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:26.689129 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061a1db-6abe-46d2-928c-61b79ee72506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:26.690002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061a1db-6abe-46d2-928c-61b79ee72506 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:26.690495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061a1db-6abe-46d2-928c-61b79ee72506 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:26.690949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061a1db-6abe-46d2-928c-61b79ee72506 None admin] PATH_INFO: `/v3/projects/13e2411eaf2541e38a8d727a7403f2f2` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:26.692307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061a1db-6abe-46d2-928c-61b79ee72506 None admin] RBAC: Authorizing `identity:get_project(project_id=13e2411eaf2541e38a8d727a7403f2f2)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:26.694058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061a1db-6abe-46d2-928c-61b79ee72506 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:26.696191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 209/411] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:26 2022] GET /identity/v3/projects/13e2411eaf2541e38a8d727a7403f2f2 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:26.708064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061a1db-6abe-46d2-928c-61b79ee72506 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:26.789535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:26.810178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85607f-95d9-422b-8a54-fd38d53e4714 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:26.873805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed951c5-6916-432b-9d94-36d41197b583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:26.874710 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed951c5-6916-432b-9d94-36d41197b583 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:26.874978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed951c5-6916-432b-9d94-36d41197b583 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:26.875252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed951c5-6916-432b-9d94-36d41197b583 None admin] PATH_INFO: `/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:26.875672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061a1db-6abe-46d2-928c-61b79ee72506 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:26.876417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed951c5-6916-432b-9d94-36d41197b583 None admin] RBAC: Authorizing `identity:get_group(group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:26.878163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed951c5-6916-432b-9d94-36d41197b583 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:26.880486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 203/412] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:26 2022] GET /identity/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:26.890163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed951c5-6916-432b-9d94-36d41197b583 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:26.928649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:26.951300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc54d8-e5a2-42e1-9e5e-b1069bde2d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:26.953240 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc54d8-e5a2-42e1-9e5e-b1069bde2d5b None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:26.953623 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc54d8-e5a2-42e1-9e5e-b1069bde2d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:26.953897 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc54d8-e5a2-42e1-9e5e-b1069bde2d5b None admin] PATH_INFO: `/v3/projects/13e2411eaf2541e38a8d727a7403f2f2/groups/f9d93038b64c4d9f99fa52a2491d069d/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:26.956549 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc54d8-e5a2-42e1-9e5e-b1069bde2d5b None admin] RBAC: Authorizing `identity:create_grant(project_id=13e2411eaf2541e38a8d727a7403f2f2, group_id=f9d93038b64c4d9f99fa52a2491d069d, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:26.958079 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc54d8-e5a2-42e1-9e5e-b1069bde2d5b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:26.991597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 210/413] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Sep 6 00:59:26 2022] PUT /identity/v3/projects/13e2411eaf2541e38a8d727a7403f2f2/groups/f9d93038b64c4d9f99fa52a2491d069d/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:27.057945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed951c5-6916-432b-9d94-36d41197b583 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:27.097090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cfde2-1c7a-4eb9-b17c-916885e8990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:27.097737 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cfde2-1c7a-4eb9-b17c-916885e8990a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:27.098014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cfde2-1c7a-4eb9-b17c-916885e8990a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:27.098288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cfde2-1c7a-4eb9-b17c-916885e8990a None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:27.099419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cfde2-1c7a-4eb9-b17c-916885e8990a None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:27.101014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cfde2-1c7a-4eb9-b17c-916885e8990a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:27.102714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 204/414] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:26 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:27.108842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc54d8-e5a2-42e1-9e5e-b1069bde2d5b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:27.236053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc54d8-e5a2-42e1-9e5e-b1069bde2d5b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:27.245306 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:27.276510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1609a0-d278-4ae2-81a0-e5e25801d351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:27.277189 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1609a0-d278-4ae2-81a0-e5e25801d351 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:27.277463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1609a0-d278-4ae2-81a0-e5e25801d351 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:27.277735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1609a0-d278-4ae2-81a0-e5e25801d351 None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90/roles/5f42b81ce88a4943902b63aaaffc1bc2` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:27.286204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1609a0-d278-4ae2-81a0-e5e25801d351 None admin] RBAC: Authorizing `identity:create_grant(project_id=51dad9b4ad744f4d8da5d8d177684aa1, group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90, role_id=5f42b81ce88a4943902b63aaaffc1bc2)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:27.288103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1609a0-d278-4ae2-81a0-e5e25801d351 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:27.308653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 211/415] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Sep 6 00:59:27 2022] PUT /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90/roles/5f42b81ce88a4943902b63aaaffc1bc2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:27.429014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8829c-fe0b-4ac9-bf93-68a423230e78 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:27.429542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8829c-fe0b-4ac9-bf93-68a423230e78 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:27.429542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8829c-fe0b-4ac9-bf93-68a423230e78 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:27.431067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 205/416] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:27.437003 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f91b81-965a-4006-abff-80a1efaa1277 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:27.437311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f91b81-965a-4006-abff-80a1efaa1277 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:27.437596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f91b81-965a-4006-abff-80a1efaa1277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:27.460818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d9f91b81-965a-4006-abff-80a1efaa1277 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:27.462051 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d9f91b81-965a-4006-abff-80a1efaa1277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:27.544409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 212/417] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:27.636847 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72f213-a607-4982-bf78-54824248d363 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:27.637444 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72f213-a607-4982-bf78-54824248d363 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:27.637901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72f213-a607-4982-bf78-54824248d363 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:27.639674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 206/418] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:27.645421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc284732-907b-4163-8004-a49790c87e34 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:27.645702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc284732-907b-4163-8004-a49790c87e34 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:27.645970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc284732-907b-4163-8004-a49790c87e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:27.672211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-dc284732-907b-4163-8004-a49790c87e34 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:27.673460 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dc284732-907b-4163-8004-a49790c87e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:27.742341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 213/419] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:27.867551 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72f213-a607-4982-bf78-54824248d363 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:27.956682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:27.973604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72f213-a607-4982-bf78-54824248d363 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:28.010197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a2a44-d506-4dfe-bc2a-1d00f68e682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:28.010849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a2a44-d506-4dfe-bc2a-1d00f68e682c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:28.011125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a2a44-d506-4dfe-bc2a-1d00f68e682c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:28.011399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a2a44-d506-4dfe-bc2a-1d00f68e682c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:28.022732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a2a44-d506-4dfe-bc2a-1d00f68e682c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-367a2a44-d506-4dfe-bc2a-1d00f68e682c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:28.027595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:28.028542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:28.029346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:28.029346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:28.029346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:28.029346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:28.029346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:28.029346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:28.029346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:28.029346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:28.029346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:28.029346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:28.029346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:28.029346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:28.032394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 207/420] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:28.035028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc284732-907b-4163-8004-a49790c87e34 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:28.064665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:28.137482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc284732-907b-4163-8004-a49790c87e34 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:28.174541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622dc8c-93da-4c89-8e4d-06deca2e9392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:28.175155 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622dc8c-93da-4c89-8e4d-06deca2e9392 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:28.175435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622dc8c-93da-4c89-8e4d-06deca2e9392 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:28.175709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622dc8c-93da-4c89-8e4d-06deca2e9392 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:28.176407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622dc8c-93da-4c89-8e4d-06deca2e9392 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:28.176712 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622dc8c-93da-4c89-8e4d-06deca2e9392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:28.178133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622dc8c-93da-4c89-8e4d-06deca2e9392 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:28.186413 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 214/421] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:28.192274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a2a44-d506-4dfe-bc2a-1d00f68e682c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:28.267991 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622dc8c-93da-4c89-8e4d-06deca2e9392 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:28.299252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a2a44-d506-4dfe-bc2a-1d00f68e682c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:28.338330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88c865-66f3-4fd2-b82f-ced12e75f8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:28.338955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88c865-66f3-4fd2-b82f-ced12e75f8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:28.339232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88c865-66f3-4fd2-b82f-ced12e75f8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:28.339505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88c865-66f3-4fd2-b82f-ced12e75f8d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:28.357878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:28.419241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88c865-66f3-4fd2-b82f-ced12e75f8d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:28.420980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88c865-66f3-4fd2-b82f-ced12e75f8d5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:28.450889 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:28.506260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622dc8c-93da-4c89-8e4d-06deca2e9392 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:28.531202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 208/422] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:28.537528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88c865-66f3-4fd2-b82f-ced12e75f8d5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:28.567407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ef658-f9c1-43b2-b57f-f3cb18d5763f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:28.568754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ef658-f9c1-43b2-b57f-f3cb18d5763f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:28.569236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ef658-f9c1-43b2-b57f-f3cb18d5763f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:28.569828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ef658-f9c1-43b2-b57f-f3cb18d5763f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:28.580984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ef658-f9c1-43b2-b57f-f3cb18d5763f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-628ef658-f9c1-43b2-b57f-f3cb18d5763f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:28.586939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:28.587838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:28.588714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:28.588714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:28.588714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:28.588714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:28.588714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:28.588714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:28.588714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:28.588714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:28.588714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:28.588714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:28.588714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:28.588714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:28.590282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:28.592112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 215/423] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:59:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:59:28.593817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56ceab-696c-44e0-b300-df47129e2883 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:28.594303 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56ceab-696c-44e0-b300-df47129e2883 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:28.594775 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56ceab-696c-44e0-b300-df47129e2883 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:28.600460 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 216/424] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:28.601451 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56ceab-696c-44e0-b300-df47129e2883 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:28.656550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88c865-66f3-4fd2-b82f-ced12e75f8d5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:28.693956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04aedd-f591-4a3c-9d35-7eefaa9d9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:28.694964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04aedd-f591-4a3c-9d35-7eefaa9d9374 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:28.695432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04aedd-f591-4a3c-9d35-7eefaa9d9374 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:28.695987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04aedd-f591-4a3c-9d35-7eefaa9d9374 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:28.697361 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04aedd-f591-4a3c-9d35-7eefaa9d9374 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:28.699253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04aedd-f591-4a3c-9d35-7eefaa9d9374 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:28.701539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 209/425] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:28 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:28.702913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af4c32-96ab-40f2-8df4-073eae00284b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:28.703393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af4c32-96ab-40f2-8df4-073eae00284b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:28.703865 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af4c32-96ab-40f2-8df4-073eae00284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:28.726174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e0af4c32-96ab-40f2-8df4-073eae00284b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:28.727811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e0af4c32-96ab-40f2-8df4-073eae00284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:28.730832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56ceab-696c-44e0-b300-df47129e2883 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:28.772443 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de859e9-9b5c-4732-aec6-988e44c9055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:28.773491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de859e9-9b5c-4732-aec6-988e44c9055e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:28.773779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de859e9-9b5c-4732-aec6-988e44c9055e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:28.774053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de859e9-9b5c-4732-aec6-988e44c9055e None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:28.774735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de859e9-9b5c-4732-aec6-988e44c9055e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:28.775045 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de859e9-9b5c-4732-aec6-988e44c9055e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:28.777952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de859e9-9b5c-4732-aec6-988e44c9055e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:28.795268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 217/426] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:28.796360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de859e9-9b5c-4732-aec6-988e44c9055e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:28.812426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 210/427] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:28.813031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:28.814129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af4c32-96ab-40f2-8df4-073eae00284b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:28.897642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:28.990157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de859e9-9b5c-4732-aec6-988e44c9055e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:29.028385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af4c32-96ab-40f2-8df4-073eae00284b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:29.054664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaeda7-aa3f-40e3-88ef-d2847f64437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:29.055801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaeda7-aa3f-40e3-88ef-d2847f64437d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:29.056272 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaeda7-aa3f-40e3-88ef-d2847f64437d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:29.056762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaeda7-aa3f-40e3-88ef-d2847f64437d None admin] PATH_INFO: `/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:29.058162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaeda7-aa3f-40e3-88ef-d2847f64437d None admin] RBAC: Authorizing `identity:get_group(group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:29.059971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaeda7-aa3f-40e3-88ef-d2847f64437d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:29.061823 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 218/428] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:28 2022] GET /identity/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:29.067732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaeda7-aa3f-40e3-88ef-d2847f64437d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:29.112645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f104f-0d5d-4606-abdf-49e085567c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:29.113654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f104f-0d5d-4606-abdf-49e085567c17 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:29.114124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f104f-0d5d-4606-abdf-49e085567c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:29.114606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f104f-0d5d-4606-abdf-49e085567c17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:29.179707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:29.210253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaeda7-aa3f-40e3-88ef-d2847f64437d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:29.216207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f104f-0d5d-4606-abdf-49e085567c17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:29.217754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f104f-0d5d-4606-abdf-49e085567c17 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:29.255038 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba02df-c0cb-4626-b2b1-73201e198ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:29.256707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba02df-c0cb-4626-b2b1-73201e198ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:29.257306 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba02df-c0cb-4626-b2b1-73201e198ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:29.257870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba02df-c0cb-4626-b2b1-73201e198ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:29.258858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba02df-c0cb-4626-b2b1-73201e198ba1 None admin] RBAC: Adding query filter params (group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90, role.id=948a63d9dffa4bdb815a397570a1d381, scope.project.id=df4081668f8c44e3a8072b71f9f14168) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:29.259610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba02df-c0cb-4626-b2b1-73201e198ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:29.262225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba02df-c0cb-4626-b2b1-73201e198ba1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:29.276771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 219/429] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 6 00:59:29 2022] GET /identity/v3/role_assignments?group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90&scope.project.id=df4081668f8c44e3a8072b71f9f14168&role.id=948a63d9dffa4bdb815a397570a1d381 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:29.276771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba02df-c0cb-4626-b2b1-73201e198ba1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:29.278059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:29.372386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 211/430] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:29.373789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3885639-212a-46e9-ab0d-254a5f190ed6 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:29.374094 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3885639-212a-46e9-ab0d-254a5f190ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:29.374440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3885639-212a-46e9-ab0d-254a5f190ed6 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:29.376005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 212/431] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:29.378339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3885639-212a-46e9-ab0d-254a5f190ed6 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:29.417817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba02df-c0cb-4626-b2b1-73201e198ba1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:29.459354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e612d30-4469-4c1a-a0c8-5e5311a17e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:29.460033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e612d30-4469-4c1a-a0c8-5e5311a17e9e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:29.460341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e612d30-4469-4c1a-a0c8-5e5311a17e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:29.460647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e612d30-4469-4c1a-a0c8-5e5311a17e9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:29.473185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e612d30-4469-4c1a-a0c8-5e5311a17e9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9e612d30-4469-4c1a-a0c8-5e5311a17e9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:29.478455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:29.479374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:29.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 220/432] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:29.481807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104af078-01cc-40e6-abc5-d0f7d8daeb99 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:29.481807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104af078-01cc-40e6-abc5-d0f7d8daeb99 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:29.481807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104af078-01cc-40e6-abc5-d0f7d8daeb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:29.488856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:29.501835 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3885639-212a-46e9-ab0d-254a5f190ed6 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:29.505081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-104af078-01cc-40e6-abc5-d0f7d8daeb99 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:29.506330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-104af078-01cc-40e6-abc5-d0f7d8daeb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:29.554709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19753829-826c-4565-bec0-4277ba585935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:29.555365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19753829-826c-4565-bec0-4277ba585935 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:29.555647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19753829-826c-4565-bec0-4277ba585935 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:29.555928 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19753829-826c-4565-bec0-4277ba585935 None admin] PATH_INFO: `/v3/projects/df4081668f8c44e3a8072b71f9f14168` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:29.557111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19753829-826c-4565-bec0-4277ba585935 None admin] RBAC: Authorizing `identity:get_project(project_id=df4081668f8c44e3a8072b71f9f14168)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:29.558616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19753829-826c-4565-bec0-4277ba585935 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:29.560442 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 213/433] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:29 2022] GET /identity/v3/projects/df4081668f8c44e3a8072b71f9f14168 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:29.561331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19753829-826c-4565-bec0-4277ba585935 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:29.577866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:29.604575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 221/434] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:29.605505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104af078-01cc-40e6-abc5-d0f7d8daeb99 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:29.701856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19753829-826c-4565-bec0-4277ba585935 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:29.736732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104af078-01cc-40e6-abc5-d0f7d8daeb99 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:29.739193 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e21b0a-8fda-456c-981a-564f2a69b638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:29.740035 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e21b0a-8fda-456c-981a-564f2a69b638 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:29.740568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e21b0a-8fda-456c-981a-564f2a69b638 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:29.741067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e21b0a-8fda-456c-981a-564f2a69b638 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:29.742000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e21b0a-8fda-456c-981a-564f2a69b638 None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:29.742503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e21b0a-8fda-456c-981a-564f2a69b638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:29.744115 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e21b0a-8fda-456c-981a-564f2a69b638 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:29.754230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 214/435] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 00:59:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:29.755846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e638b-a1af-4dbe-bccf-77e0fb70309f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:29.756373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e638b-a1af-4dbe-bccf-77e0fb70309f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:29.756854 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e638b-a1af-4dbe-bccf-77e0fb70309f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:29.758506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 215/436] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:29.763913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cf766-6bb6-4a38-ba4c-bfd2d1b99cc9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:29.764483 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cf766-6bb6-4a38-ba4c-bfd2d1b99cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:29.765105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cf766-6bb6-4a38-ba4c-bfd2d1b99cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:29.780565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:29.783661 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020eac1-f475-4fda-a1f9-e07d1e88ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:29.784510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020eac1-f475-4fda-a1f9-e07d1e88ef6b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:29.784896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020eac1-f475-4fda-a1f9-e07d1e88ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:29.785167 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020eac1-f475-4fda-a1f9-e07d1e88ef6b None admin] PATH_INFO: `/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:29.785305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-790cf766-6bb6-4a38-ba4c-bfd2d1b99cc9 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:29.786514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020eac1-f475-4fda-a1f9-e07d1e88ef6b None admin] RBAC: Authorizing `identity:get_group(group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:29.787024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-790cf766-6bb6-4a38-ba4c-bfd2d1b99cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:29.788403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020eac1-f475-4fda-a1f9-e07d1e88ef6b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:29.795052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 222/437] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:29 2022] GET /identity/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:29.796456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020eac1-f475-4fda-a1f9-e07d1e88ef6b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:29.869934 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 216/438] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:29.870789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cf766-6bb6-4a38-ba4c-bfd2d1b99cc9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:29.875294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:29.928434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020eac1-f475-4fda-a1f9-e07d1e88ef6b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:29.962664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c285e-9ed1-4f0c-a53f-514d1d600fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:29.963197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c285e-9ed1-4f0c-a53f-514d1d600fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:29.963475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c285e-9ed1-4f0c-a53f-514d1d600fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:29.963743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c285e-9ed1-4f0c-a53f-514d1d600fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:29.987145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cf766-6bb6-4a38-ba4c-bfd2d1b99cc9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:30.026381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337e145-ef49-4d50-a993-de6c25992dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:30.027302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337e145-ef49-4d50-a993-de6c25992dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:30.027798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337e145-ef49-4d50-a993-de6c25992dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:30.028363 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337e145-ef49-4d50-a993-de6c25992dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:30.029377 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337e145-ef49-4d50-a993-de6c25992dd2 None admin] RBAC: Adding query filter params (group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90, role.id=5f42b81ce88a4943902b63aaaffc1bc2, scope.project.id=df4081668f8c44e3a8072b71f9f14168) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:30.029861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337e145-ef49-4d50-a993-de6c25992dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:30.031649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337e145-ef49-4d50-a993-de6c25992dd2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:30.033430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:30.035797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c285e-9ed1-4f0c-a53f-514d1d600fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:30.037791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c285e-9ed1-4f0c-a53f-514d1d600fb5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:30.047870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 217/439] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 6 00:59:29 2022] GET /identity/v3/role_assignments?group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90&scope.project.id=df4081668f8c44e3a8072b71f9f14168&role.id=5f42b81ce88a4943902b63aaaffc1bc2 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:30.049014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337e145-ef49-4d50-a993-de6c25992dd2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:30.132414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:30.162348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 223/440] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:30.163221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c285e-9ed1-4f0c-a53f-514d1d600fb5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:30.178329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337e145-ef49-4d50-a993-de6c25992dd2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:30.222416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9a70-d870-40bc-994b-d20145a03c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:30.223365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9a70-d870-40bc-994b-d20145a03c35 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:30.223639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9a70-d870-40bc-994b-d20145a03c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:30.223908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9a70-d870-40bc-994b-d20145a03c35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:30.235489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa9a70-d870-40bc-994b-d20145a03c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c8aa9a70-d870-40bc-994b-d20145a03c35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:30.241466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:30.242385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:30.243180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 218/441] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:59:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:30.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9a70-d870-40bc-994b-d20145a03c35 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:30.282065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:30.287604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c285e-9ed1-4f0c-a53f-514d1d600fb5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:30.326135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b086fe1-48d4-4f55-9fed-d249240c998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:30.326778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b086fe1-48d4-4f55-9fed-d249240c998e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:30.327116 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b086fe1-48d4-4f55-9fed-d249240c998e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:30.327611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b086fe1-48d4-4f55-9fed-d249240c998e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:30.340056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b086fe1-48d4-4f55-9fed-d249240c998e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-4b086fe1-48d4-4f55-9fed-d249240c998e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:30.345297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:30.346302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:30.347122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 224/442] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:59:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:30.347781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b086fe1-48d4-4f55-9fed-d249240c998e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:30.373165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9a70-d870-40bc-994b-d20145a03c35 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:30.403323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:30.412341 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c72da5-d098-4f1a-a492-be9b3c8813cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:30.412987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72da5-d098-4f1a-a492-be9b3c8813cf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:30.413329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72da5-d098-4f1a-a492-be9b3c8813cf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:30.413522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72da5-d098-4f1a-a492-be9b3c8813cf None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:30.414874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c72da5-d098-4f1a-a492-be9b3c8813cf None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:30.416633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c72da5-d098-4f1a-a492-be9b3c8813cf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:30.418289 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 219/443] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:30 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:30.419047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c72da5-d098-4f1a-a492-be9b3c8813cf None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:30.459286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b086fe1-48d4-4f55-9fed-d249240c998e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:30.494232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efb75b-580f-4395-9541-b45e18db03f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:30.495130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efb75b-580f-4395-9541-b45e18db03f5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:30.495412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efb75b-580f-4395-9541-b45e18db03f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:30.495683 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efb75b-580f-4395-9541-b45e18db03f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:30.496702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efb75b-580f-4395-9541-b45e18db03f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:30.497000 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efb75b-580f-4395-9541-b45e18db03f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:30.498440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efb75b-580f-4395-9541-b45e18db03f5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:30.507137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 225/444] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:30.507930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efb75b-580f-4395-9541-b45e18db03f5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:30.517759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c72da5-d098-4f1a-a492-be9b3c8813cf None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:30.533315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:30.554798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a811f1e-07cb-4fcb-ba91-1f61deaf3a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:30.555419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a811f1e-07cb-4fcb-ba91-1f61deaf3a32 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:30.555747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a811f1e-07cb-4fcb-ba91-1f61deaf3a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:30.556017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a811f1e-07cb-4fcb-ba91-1f61deaf3a32 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:30.556724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a811f1e-07cb-4fcb-ba91-1f61deaf3a32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:30.557026 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a811f1e-07cb-4fcb-ba91-1f61deaf3a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:30.558462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a811f1e-07cb-4fcb-ba91-1f61deaf3a32 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:30.566538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 220/445] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:30.567328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a811f1e-07cb-4fcb-ba91-1f61deaf3a32 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:30.610213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efb75b-580f-4395-9541-b45e18db03f5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:30.627997 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:30.644954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece257d-0313-4ed2-985f-d8b73445a19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:30.645585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece257d-0313-4ed2-985f-d8b73445a19d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:30.645863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece257d-0313-4ed2-985f-d8b73445a19d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:30.646133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece257d-0313-4ed2-985f-d8b73445a19d None admin] PATH_INFO: `/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:30.647248 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece257d-0313-4ed2-985f-d8b73445a19d None admin] RBAC: Authorizing `identity:get_group(group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:30.648794 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece257d-0313-4ed2-985f-d8b73445a19d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:30.650352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 226/446] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:30 2022] GET /identity/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:30.651097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece257d-0313-4ed2-985f-d8b73445a19d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:30.675313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a811f1e-07cb-4fcb-ba91-1f61deaf3a32 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:30.708340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2962d6-24c6-4c15-9b52-ba441813760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:30.708961 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2962d6-24c6-4c15-9b52-ba441813760d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:30.709236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2962d6-24c6-4c15-9b52-ba441813760d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:30.709509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2962d6-24c6-4c15-9b52-ba441813760d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:30.752676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:30.762494 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece257d-0313-4ed2-985f-d8b73445a19d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:30.777863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2962d6-24c6-4c15-9b52-ba441813760d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:30.779416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2962d6-24c6-4c15-9b52-ba441813760d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:30.795982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd858f5-becb-4679-89a3-6f91159bcb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:30.797163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd858f5-becb-4679-89a3-6f91159bcb3d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:30.797446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd858f5-becb-4679-89a3-6f91159bcb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:30.797721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd858f5-becb-4679-89a3-6f91159bcb3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:30.835025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:30.864520 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd858f5-becb-4679-89a3-6f91159bcb3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:30.866063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd858f5-becb-4679-89a3-6f91159bcb3d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:30.881665 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 221/447] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:30.882686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2962d6-24c6-4c15-9b52-ba441813760d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:30.964568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:30.975743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 227/448] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:30.976592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd858f5-becb-4679-89a3-6f91159bcb3d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:30.994142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2962d6-24c6-4c15-9b52-ba441813760d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:31.031397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390907f-9884-403a-bcad-f0c2683ef807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:31.031917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390907f-9884-403a-bcad-f0c2683ef807 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:31.032187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390907f-9884-403a-bcad-f0c2683ef807 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:31.032489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390907f-9884-403a-bcad-f0c2683ef807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:31.033214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390907f-9884-403a-bcad-f0c2683ef807 None admin] RBAC: Adding query filter params (group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90, role.id=948a63d9dffa4bdb815a397570a1d381, scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:31.033524 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390907f-9884-403a-bcad-f0c2683ef807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:31.034987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390907f-9884-403a-bcad-f0c2683ef807 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:31.043793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 222/449] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 6 00:59:30 2022] GET /identity/v3/role_assignments?group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90&scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1&role.id=948a63d9dffa4bdb815a397570a1d381 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:31.044636 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390907f-9884-403a-bcad-f0c2683ef807 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:31.079982 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:31.098743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd858f5-becb-4679-89a3-6f91159bcb3d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:31.147558 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55047d3-362c-47d4-9725-cf2c43e2d84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:31.148601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55047d3-362c-47d4-9725-cf2c43e2d84e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:31.149006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55047d3-362c-47d4-9725-cf2c43e2d84e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:31.149279 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55047d3-362c-47d4-9725-cf2c43e2d84e None admin] PATH_INFO: `/v3/projects/13e2411eaf2541e38a8d727a7403f2f2` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:31.150566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55047d3-362c-47d4-9725-cf2c43e2d84e None admin] RBAC: Authorizing `identity:get_project(project_id=13e2411eaf2541e38a8d727a7403f2f2)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:31.152582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55047d3-362c-47d4-9725-cf2c43e2d84e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:31.154454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 228/450] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:30 2022] GET /identity/v3/projects/13e2411eaf2541e38a8d727a7403f2f2 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:31.160207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55047d3-362c-47d4-9725-cf2c43e2d84e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:31.174240 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390907f-9884-403a-bcad-f0c2683ef807 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:31.211479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350c9c0-6072-406b-9e73-0913bdf24501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:31.212226 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350c9c0-6072-406b-9e73-0913bdf24501 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:31.212589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350c9c0-6072-406b-9e73-0913bdf24501 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:31.212877 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350c9c0-6072-406b-9e73-0913bdf24501 None admin] PATH_INFO: `/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:31.214063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350c9c0-6072-406b-9e73-0913bdf24501 None admin] RBAC: Authorizing `identity:get_project(project_id=51dad9b4ad744f4d8da5d8d177684aa1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:31.215459 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350c9c0-6072-406b-9e73-0913bdf24501 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:31.217297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 223/451] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 00:59:31 2022] GET /identity/v3/projects/51dad9b4ad744f4d8da5d8d177684aa1 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:31.223070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350c9c0-6072-406b-9e73-0913bdf24501 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:31.233845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:31.284505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55047d3-362c-47d4-9725-cf2c43e2d84e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:31.326150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107fea3-67aa-4a99-8997-1625ed082c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:31.326703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:31.326834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107fea3-67aa-4a99-8997-1625ed082c35 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:31.327050 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107fea3-67aa-4a99-8997-1625ed082c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:31.327372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107fea3-67aa-4a99-8997-1625ed082c35 None admin] PATH_INFO: `/v3/groups/f9d93038b64c4d9f99fa52a2491d069d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:31.329429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107fea3-67aa-4a99-8997-1625ed082c35 None admin] RBAC: Authorizing `identity:get_group(group_id=f9d93038b64c4d9f99fa52a2491d069d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:31.330992 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107fea3-67aa-4a99-8997-1625ed082c35 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:31.337479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 229/452] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:31 2022] GET /identity/v3/groups/f9d93038b64c4d9f99fa52a2491d069d => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:31.338389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107fea3-67aa-4a99-8997-1625ed082c35 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:31.342398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350c9c0-6072-406b-9e73-0913bdf24501 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:31.382197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7bbd-25cd-4fdc-ab6a-14c1340ec846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:31.382833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7bbd-25cd-4fdc-ab6a-14c1340ec846 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:31.383111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7bbd-25cd-4fdc-ab6a-14c1340ec846 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:31.383423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7bbd-25cd-4fdc-ab6a-14c1340ec846 None admin] PATH_INFO: `/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:31.384586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f7bbd-25cd-4fdc-ab6a-14c1340ec846 None admin] RBAC: Authorizing `identity:get_group(group_id=cf3f9b3b1f3a4a35a7714d7eaee95e90)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:31.386120 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f7bbd-25cd-4fdc-ab6a-14c1340ec846 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:31.388013 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 224/453] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 6 00:59:31 2022] GET /identity/v3/groups/cf3f9b3b1f3a4a35a7714d7eaee95e90 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:31.394351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7bbd-25cd-4fdc-ab6a-14c1340ec846 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:31.452153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107fea3-67aa-4a99-8997-1625ed082c35 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:31.480177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:31.490586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8917d79-8cac-494a-8ff0-a7cdffb5df3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:31.491195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917d79-8cac-494a-8ff0-a7cdffb5df3d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:31.491471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917d79-8cac-494a-8ff0-a7cdffb5df3d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:31.491742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917d79-8cac-494a-8ff0-a7cdffb5df3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:31.492500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8917d79-8cac-494a-8ff0-a7cdffb5df3d None admin] RBAC: Adding query filter params (group.id=f9d93038b64c4d9f99fa52a2491d069d, role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=13e2411eaf2541e38a8d727a7403f2f2) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:31.492808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8917d79-8cac-494a-8ff0-a7cdffb5df3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:31.494318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8917d79-8cac-494a-8ff0-a7cdffb5df3d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:31.500569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 230/454] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 6 00:59:31 2022] GET /identity/v3/role_assignments?group.id=f9d93038b64c4d9f99fa52a2491d069d&scope.project.id=13e2411eaf2541e38a8d727a7403f2f2&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:31.502044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7bbd-25cd-4fdc-ab6a-14c1340ec846 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:31.539954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad436c32-6eff-4758-b0a7-cc979f8cf32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:31.540514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad436c32-6eff-4758-b0a7-cc979f8cf32f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:31.540792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad436c32-6eff-4758-b0a7-cc979f8cf32f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:31.541070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad436c32-6eff-4758-b0a7-cc979f8cf32f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:31.541809 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad436c32-6eff-4758-b0a7-cc979f8cf32f None admin] RBAC: Adding query filter params (group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90, role.id=5f42b81ce88a4943902b63aaaffc1bc2, scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:31.542119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad436c32-6eff-4758-b0a7-cc979f8cf32f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:31.543632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad436c32-6eff-4758-b0a7-cc979f8cf32f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:31.550667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 225/455] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 6 00:59:31 2022] GET /identity/v3/role_assignments?group.id=cf3f9b3b1f3a4a35a7714d7eaee95e90&scope.project.id=51dad9b4ad744f4d8da5d8d177684aa1&role.id=5f42b81ce88a4943902b63aaaffc1bc2 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:34.201444 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75392b-2d86-4609-9d1e-129cdd57e59a None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:34.202496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75392b-2d86-4609-9d1e-129cdd57e59a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:34.202978 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75392b-2d86-4609-9d1e-129cdd57e59a None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:34.204583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 231/456] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:34.210032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0529f-8b90-4fc2-a4b2-05604a3a9873 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:34.210836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0529f-8b90-4fc2-a4b2-05604a3a9873 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:34.211301 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0529f-8b90-4fc2-a4b2-05604a3a9873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:34.237343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-92d0529f-8b90-4fc2-a4b2-05604a3a9873 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:34.238567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-92d0529f-8b90-4fc2-a4b2-05604a3a9873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:34.259380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:34.273031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eb4ca-205b-482a-be29-ac5aa6babd07 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:34.273735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eb4ca-205b-482a-be29-ac5aa6babd07 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:34.274199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eb4ca-205b-482a-be29-ac5aa6babd07 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:34.276799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 232/457] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:34.282622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba10438-e4eb-4af2-97d6-39a7f25df093 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:34.282900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba10438-e4eb-4af2-97d6-39a7f25df093 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:34.283173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba10438-e4eb-4af2-97d6-39a7f25df093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:34.313465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-aba10438-e4eb-4af2-97d6-39a7f25df093 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:34.314591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-aba10438-e4eb-4af2-97d6-39a7f25df093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:34.359856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 226/458] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:34.423194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 233/459] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:34.449326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c934-5d8b-4502-b041-799c4e429dbf None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:34.449631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c934-5d8b-4502-b041-799c4e429dbf None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:34.449930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c934-5d8b-4502-b041-799c4e429dbf None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:34.451324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 227/460] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:34.457053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2810e-a5b2-4be6-a1c4-399dfbd18464 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:34.457332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2810e-a5b2-4be6-a1c4-399dfbd18464 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:34.457607 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2810e-a5b2-4be6-a1c4-399dfbd18464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:34.475858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-05f2810e-a5b2-4be6-a1c4-399dfbd18464 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:34.477466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-05f2810e-a5b2-4be6-a1c4-399dfbd18464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:34.556700 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 234/461] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:34.736469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcb1b-ac07-413c-883d-9b6527495eb9 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:34.737120 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcb1b-ac07-413c-883d-9b6527495eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:34.737590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcb1b-ac07-413c-883d-9b6527495eb9 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:34.739500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 228/462] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:34.743257 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2810e-a5b2-4be6-a1c4-399dfbd18464 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:34.746922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fcb1b-ac07-413c-883d-9b6527495eb9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:34.817601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:34.862137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fcb1b-ac07-413c-883d-9b6527495eb9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:34.877178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2810e-a5b2-4be6-a1c4-399dfbd18464 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:34.901277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9e9ee-6928-45c1-8202-cefa187924c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:34.901912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9e9ee-6928-45c1-8202-cefa187924c6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:34.902189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9e9ee-6928-45c1-8202-cefa187924c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:34.902461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9e9ee-6928-45c1-8202-cefa187924c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:34.913792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9e9ee-6928-45c1-8202-cefa187924c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:34.915374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9e9ee-6928-45c1-8202-cefa187924c6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:34.921682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3cc0a-1bc8-415f-b4c0-bff2fd460b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:34.922321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3cc0a-1bc8-415f-b4c0-bff2fd460b1a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:34.922588 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3cc0a-1bc8-415f-b4c0-bff2fd460b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:34.923047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3cc0a-1bc8-415f-b4c0-bff2fd460b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-d1d9e9ee-6928-45c1-8202-cefa187924c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:34.932502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:34.933623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:34.934598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:34.934598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:34.934598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:34.935052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3cc0a-1bc8-415f-b4c0-bff2fd460b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:34.936198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 229/463] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:59:34.937453 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48e9c8-20a8-4cf6-ac71-a7d7547722dc None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:34.937757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48e9c8-20a8-4cf6-ac71-a7d7547722dc None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:34.938001 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48e9c8-20a8-4cf6-ac71-a7d7547722dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:34.941299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3cc0a-1bc8-415f-b4c0-bff2fd460b1a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:34.944902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-49a3cc0a-1bc8-415f-b4c0-bff2fd460b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:34.958650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:34.960689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:34.961556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:34.961556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:34.961556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:34.961734 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ef48e9c8-20a8-4cf6-ac71-a7d7547722dc None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:34.961734 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ef48e9c8-20a8-4cf6-ac71-a7d7547722dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:34.964644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 235/464] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:34.965758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3cc0a-1bc8-415f-b4c0-bff2fd460b1a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:35.041494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 230/465] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:35.042973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48e9c8-20a8-4cf6-ac71-a7d7547722dc None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:35.086252 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3cc0a-1bc8-415f-b4c0-bff2fd460b1a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:35.088422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:35.126885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75233e50-0816-4e78-96a5-525bb2d3fbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:35.127923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75233e50-0816-4e78-96a5-525bb2d3fbca None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:35.128435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75233e50-0816-4e78-96a5-525bb2d3fbca None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:35.128985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75233e50-0816-4e78-96a5-525bb2d3fbca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:35.141960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75233e50-0816-4e78-96a5-525bb2d3fbca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:35.143893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75233e50-0816-4e78-96a5-525bb2d3fbca None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-75233e50-0816-4e78-96a5-525bb2d3fbca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:35.160546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:35.161877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:35.162738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:35.162738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:35.162738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:35.169873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 236/466] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:35.171054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75233e50-0816-4e78-96a5-525bb2d3fbca None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:35.174134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48e9c8-20a8-4cf6-ac71-a7d7547722dc None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:35.212377 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:35.218705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c2c2c-3e40-4937-bd4d-a55e10169df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:35.220210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c2c2c-3e40-4937-bd4d-a55e10169df1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:35.220851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c2c2c-3e40-4937-bd4d-a55e10169df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:35.221316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c2c2c-3e40-4937-bd4d-a55e10169df1 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:35.222626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c2c2c-3e40-4937-bd4d-a55e10169df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:35.223278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c2c2c-3e40-4937-bd4d-a55e10169df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:35.225678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c2c2c-3e40-4937-bd4d-a55e10169df1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:35.242466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 231/467] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:35.249212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c2c2c-3e40-4937-bd4d-a55e10169df1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:35.292586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75233e50-0816-4e78-96a5-525bb2d3fbca None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:35.341375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b66d2-921c-465c-ba7c-6e393679f70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:35.342218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b66d2-921c-465c-ba7c-6e393679f70d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:35.343503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b66d2-921c-465c-ba7c-6e393679f70d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:35.343503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b66d2-921c-465c-ba7c-6e393679f70d None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:35.344454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b66d2-921c-465c-ba7c-6e393679f70d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:35.344771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b66d2-921c-465c-ba7c-6e393679f70d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:35.346414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b66d2-921c-465c-ba7c-6e393679f70d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:35.371221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 237/468] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:35.372174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b66d2-921c-465c-ba7c-6e393679f70d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:35.382171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c2c2c-3e40-4937-bd4d-a55e10169df1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:35.391265 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:35.428771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b3ef3-8030-42d8-a62e-f7d21a5b6550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:35.429714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b3ef3-8030-42d8-a62e-f7d21a5b6550 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:35.430156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b3ef3-8030-42d8-a62e-f7d21a5b6550 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:35.430608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b3ef3-8030-42d8-a62e-f7d21a5b6550 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:35.431516 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b3ef3-8030-42d8-a62e-f7d21a5b6550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:35.432058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b3ef3-8030-42d8-a62e-f7d21a5b6550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:35.434285 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b3ef3-8030-42d8-a62e-f7d21a5b6550 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:35.448954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 232/469] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:35.449792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b3ef3-8030-42d8-a62e-f7d21a5b6550 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:35.500573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b66d2-921c-465c-ba7c-6e393679f70d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:35.511221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:35.539380 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd969a8-7042-4f63-a402-50bc311cef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:35.540000 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd969a8-7042-4f63-a402-50bc311cef00 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:35.540273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd969a8-7042-4f63-a402-50bc311cef00 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:35.540573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd969a8-7042-4f63-a402-50bc311cef00 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:35.541331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd969a8-7042-4f63-a402-50bc311cef00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:35.543012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd969a8-7042-4f63-a402-50bc311cef00 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:35.566698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b3ef3-8030-42d8-a62e-f7d21a5b6550 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:35.576349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 238/470] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 00:59:35 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:59:35.576349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd969a8-7042-4f63-a402-50bc311cef00 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:35.608663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a37aa-24e4-4907-9387-77c1ea71775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:35.610068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a37aa-24e4-4907-9387-77c1ea71775f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:35.610386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a37aa-24e4-4907-9387-77c1ea71775f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:35.610821 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a37aa-24e4-4907-9387-77c1ea71775f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:35.626255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a37aa-24e4-4907-9387-77c1ea71775f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:35.628659 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a37aa-24e4-4907-9387-77c1ea71775f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-7a3a37aa-24e4-4907-9387-77c1ea71775f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:35.653276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:35.654270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:35.655161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:35.655161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:35.655161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:35.657606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 233/471] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:35.659127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a37aa-24e4-4907-9387-77c1ea71775f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:35.680216 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:35.721970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd969a8-7042-4f63-a402-50bc311cef00 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:35.763260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90feab-2424-4c54-ae79-de46c9886c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:35.763889 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90feab-2424-4c54-ae79-de46c9886c18 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:35.764168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90feab-2424-4c54-ae79-de46c9886c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:35.764599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90feab-2424-4c54-ae79-de46c9886c18 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:35.765325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90feab-2424-4c54-ae79-de46c9886c18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:35.766878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90feab-2424-4c54-ae79-de46c9886c18 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:35.785282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a37aa-24e4-4907-9387-77c1ea71775f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:35.789555 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:35.799796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 239/472] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 00:59:35 2022] POST /identity/v3/users => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:59:35.800594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90feab-2424-4c54-ae79-de46c9886c18 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:35.843654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96d09d-0f5a-46fb-b409-bf240ff768b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:35.844312 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96d09d-0f5a-46fb-b409-bf240ff768b4 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:35.844621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96d09d-0f5a-46fb-b409-bf240ff768b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:35.844890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96d09d-0f5a-46fb-b409-bf240ff768b4 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:35.845558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96d09d-0f5a-46fb-b409-bf240ff768b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:35.849183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96d09d-0f5a-46fb-b409-bf240ff768b4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:35.880856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 234/473] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 00:59:35 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:59:35.882284 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135758b8-0803-48fd-ae9a-001ff7007229 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:35.882574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135758b8-0803-48fd-ae9a-001ff7007229 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:35.882868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135758b8-0803-48fd-ae9a-001ff7007229 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:35.884263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 235/474] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:35.893827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5abe1-4516-41be-9ad7-2b5905bd41b7 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:35.894096 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5abe1-4516-41be-9ad7-2b5905bd41b7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:35.894357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5abe1-4516-41be-9ad7-2b5905bd41b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:35.924001 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c2f5abe1-4516-41be-9ad7-2b5905bd41b7 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:35.925278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c2f5abe1-4516-41be-9ad7-2b5905bd41b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:35.973554 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90feab-2424-4c54-ae79-de46c9886c18 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:36.018734 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:36.021022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 236/475] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:36.030172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e56f90-c782-480e-b09f-96885147b73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:36.031139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e56f90-c782-480e-b09f-96885147b73c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:36.031588 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e56f90-c782-480e-b09f-96885147b73c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:36.032020 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e56f90-c782-480e-b09f-96885147b73c None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:36.032867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e56f90-c782-480e-b09f-96885147b73c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:36.033317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e56f90-c782-480e-b09f-96885147b73c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:36.035331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e56f90-c782-480e-b09f-96885147b73c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:36.050846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 240/476] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:36.056788 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5abe1-4516-41be-9ad7-2b5905bd41b7 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:36.158836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:36.173342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5abe1-4516-41be-9ad7-2b5905bd41b7 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:36.211928 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd45a-3905-4bb1-90ac-2a840d761c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:36.212584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd45a-3905-4bb1-90ac-2a840d761c98 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:36.213115 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd45a-3905-4bb1-90ac-2a840d761c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:36.213115 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd45a-3905-4bb1-90ac-2a840d761c98 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:36.213773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdd45a-3905-4bb1-90ac-2a840d761c98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:36.215294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdd45a-3905-4bb1-90ac-2a840d761c98 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:36.241894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 237/477] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 00:59:36 2022] POST /identity/v3/users => generated 249 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:59:36.306907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e56f90-c782-480e-b09f-96885147b73c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:36.445392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e56f90-c782-480e-b09f-96885147b73c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:36.481511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd40fc-f10d-4b3f-bd27-fa72518a1af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:36.482130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd40fc-f10d-4b3f-bd27-fa72518a1af1 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:36.482456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd40fc-f10d-4b3f-bd27-fa72518a1af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:36.482732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd40fc-f10d-4b3f-bd27-fa72518a1af1 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:36.483592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd40fc-f10d-4b3f-bd27-fa72518a1af1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:36.485014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd40fc-f10d-4b3f-bd27-fa72518a1af1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:36.494639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.sql.core [None req-88cd40fc-f10d-4b3f-bd27-fa72518a1af1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 00:59:36.494639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 00:59:36.494639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [parameters: {'id': '0df8eb12088d4a62a84d0b4bee73c6a3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 00:59:36.494639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81741) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-88cd40fc-f10d-4b3f-bd27-fa72518a1af1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application conn.query(q) Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result.read() Sep 06 00:59:36.511519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return ref.to_dict() Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 00:59:36.512481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application next(self.gen) Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application yield resource Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application next(self.gen) Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise self.value Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application session.commit() Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 00:59:36.513721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.session.flush() Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application compat.raise_( Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 00:59:36.514644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 00:59:36.515544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application conn.query(q) Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result.read() Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 00:59:36.516918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [parameters: {'id': '0df8eb12088d4a62a84d0b4bee73c6a3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:36.518133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 00:59:36.519222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:36.520250 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 241/478] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Sep 6 00:59:36 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:36.526347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd45a-3905-4bb1-90ac-2a840d761c98 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:36.636713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd45a-3905-4bb1-90ac-2a840d761c98 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:36.675265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cff6ad-c1cf-40f7-b714-fce3beecb7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:36.675962 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff6ad-c1cf-40f7-b714-fce3beecb7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:36.676244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff6ad-c1cf-40f7-b714-fce3beecb7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:36.676546 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff6ad-c1cf-40f7-b714-fce3beecb7b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:36.688114 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cff6ad-c1cf-40f7-b714-fce3beecb7b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-91cff6ad-c1cf-40f7-b714-fce3beecb7b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:36.693526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:36.694419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:36.695395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 238/479] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 00:59:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:36.703071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd40fc-f10d-4b3f-bd27-fa72518a1af1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:36.771750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:36.824438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd40fc-f10d-4b3f-bd27-fa72518a1af1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:36.859124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54f962-256a-4861-89ae-a021d64545e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:36.859980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54f962-256a-4861-89ae-a021d64545e2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:36.860452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54f962-256a-4861-89ae-a021d64545e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:36.860859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54f962-256a-4861-89ae-a021d64545e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:36.861663 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54f962-256a-4861-89ae-a021d64545e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:36.862101 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54f962-256a-4861-89ae-a021d64545e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:36.863738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54f962-256a-4861-89ae-a021d64545e2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:36.872465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 242/480] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:38.062640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0d62e-8dcf-4a9f-a444-cf3ddd65ccb3 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:38.063140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0d62e-8dcf-4a9f-a444-cf3ddd65ccb3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:38.063213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0d62e-8dcf-4a9f-a444-cf3ddd65ccb3 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:38.064782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 239/481] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:38.069934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4867d1-06ce-49a4-8bc9-e652c38ed41c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:38.070723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4867d1-06ce-49a4-8bc9-e652c38ed41c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:38.071186 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4867d1-06ce-49a4-8bc9-e652c38ed41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:38.095573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ab4867d1-06ce-49a4-8bc9-e652c38ed41c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:38.096830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ab4867d1-06ce-49a4-8bc9-e652c38ed41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:38.190226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 243/482] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:38.383292 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5ba87-f502-496a-b1b9-b2b09c66282c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:38.383462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5ba87-f502-496a-b1b9-b2b09c66282c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:38.383722 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5ba87-f502-496a-b1b9-b2b09c66282c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:38.385339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 240/483] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:38.390741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decebc3-8859-4b79-9cc2-b339a10383f0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:38.391026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decebc3-8859-4b79-9cc2-b339a10383f0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:38.391299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decebc3-8859-4b79-9cc2-b339a10383f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:38.392987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849957c-3c07-4d5f-b832-6731a6f405f2 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:38.393264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849957c-3c07-4d5f-b832-6731a6f405f2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:38.393531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849957c-3c07-4d5f-b832-6731a6f405f2 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:38.395042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 241/484] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:38.399467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469f62b-35b5-465f-a979-b9a8a3811c02 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:38.399745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469f62b-35b5-465f-a979-b9a8a3811c02 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:38.400011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469f62b-35b5-465f-a979-b9a8a3811c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:38.420979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:38.431430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7469f62b-35b5-465f-a979-b9a8a3811c02 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:38.432712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7469f62b-35b5-465f-a979-b9a8a3811c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:38.435570 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3decebc3-8859-4b79-9cc2-b339a10383f0 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:38.436820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3decebc3-8859-4b79-9cc2-b339a10383f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:38.500649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:38.545367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 242/485] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:38.566903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 244/486] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:38.603011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469f62b-35b5-465f-a979-b9a8a3811c02 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:38.690366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b026-08e0-448d-b649-2eceb9d101ce None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:38.690989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b026-08e0-448d-b649-2eceb9d101ce None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:38.691477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b026-08e0-448d-b649-2eceb9d101ce None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:38.693303 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 245/487] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:38.698100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebade00-3d61-4f85-8baf-e493609345dc None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:38.698616 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebade00-3d61-4f85-8baf-e493609345dc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:38.699081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebade00-3d61-4f85-8baf-e493609345dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:38.725844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469f62b-35b5-465f-a979-b9a8a3811c02 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:38.737931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9ebade00-3d61-4f85-8baf-e493609345dc None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:38.739130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9ebade00-3d61-4f85-8baf-e493609345dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:38.790589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b3f2e-66b6-4757-8041-5b9fb87b31fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:38.791216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b3f2e-66b6-4757-8041-5b9fb87b31fe None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:38.791485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b3f2e-66b6-4757-8041-5b9fb87b31fe None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:38.791751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b3f2e-66b6-4757-8041-5b9fb87b31fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:38.803970 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b3f2e-66b6-4757-8041-5b9fb87b31fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-210b3f2e-66b6-4757-8041-5b9fb87b31fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:38.808861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:38.809785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:38.812616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 243/488] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:38.817133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b3f2e-66b6-4757-8041-5b9fb87b31fe None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:38.869175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 246/489] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:38.907851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebade00-3d61-4f85-8baf-e493609345dc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:38.918499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b3f2e-66b6-4757-8041-5b9fb87b31fe None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:38.953438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cd2f4-2aeb-4c32-88a1-8241e1aa0b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:38.954012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cd2f4-2aeb-4c32-88a1-8241e1aa0b92 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:38.954233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cd2f4-2aeb-4c32-88a1-8241e1aa0b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:38.954499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cd2f4-2aeb-4c32-88a1-8241e1aa0b92 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:38.955156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cd2f4-2aeb-4c32-88a1-8241e1aa0b92 None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:38.955455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cd2f4-2aeb-4c32-88a1-8241e1aa0b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:38.957143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cd2f4-2aeb-4c32-88a1-8241e1aa0b92 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:38.967056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 244/490] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:38.968336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cd2f4-2aeb-4c32-88a1-8241e1aa0b92 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:39.035612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:39.064266 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebade00-3d61-4f85-8baf-e493609345dc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:39.066751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:39.092210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cd2f4-2aeb-4c32-88a1-8241e1aa0b92 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:39.102829 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d3c65-069b-48b9-b9e5-d751cbfae198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:39.104093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d3c65-069b-48b9-b9e5-d751cbfae198 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.104584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d3c65-069b-48b9-b9e5-d751cbfae198 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.105080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d3c65-069b-48b9-b9e5-d751cbfae198 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.116489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d3c65-069b-48b9-b9e5-d751cbfae198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7f9d3c65-069b-48b9-b9e5-d751cbfae198 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:39.121608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:39.122578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:39.123415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:39.123415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:39.123415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:39.123415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:39.123415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:39.123415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:39.123415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:39.123415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:39.123415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:39.123415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:39.123415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:39.123415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:39.126848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 247/491] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:59:39.127980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d3c65-069b-48b9-b9e5-d751cbfae198 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:39.134747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46846f-2e0c-4c6b-acdb-3a374162d1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:39.136188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46846f-2e0c-4c6b-acdb-3a374162d1bd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.136188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46846f-2e0c-4c6b-acdb-3a374162d1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.136188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46846f-2e0c-4c6b-acdb-3a374162d1bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.147590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46846f-2e0c-4c6b-acdb-3a374162d1bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-5c46846f-2e0c-4c6b-acdb-3a374162d1bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:39.153262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:39.154148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:39.155021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 245/492] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:39.156931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46846f-2e0c-4c6b-acdb-3a374162d1bd None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:39.241060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d3c65-069b-48b9-b9e5-d751cbfae198 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:39.269877 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46846f-2e0c-4c6b-acdb-3a374162d1bd None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:39.276176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456cac9-b0cf-4acd-b61f-9e8ff1c6ab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:39.277249 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456cac9-b0cf-4acd-b61f-9e8ff1c6ab4d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.277249 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456cac9-b0cf-4acd-b61f-9e8ff1c6ab4d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.277441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456cac9-b0cf-4acd-b61f-9e8ff1c6ab4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.290849 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456cac9-b0cf-4acd-b61f-9e8ff1c6ab4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:39.292388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456cac9-b0cf-4acd-b61f-9e8ff1c6ab4d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:39.293382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2456cac9-b0cf-4acd-b61f-9e8ff1c6ab4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:39.307678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:39.308648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:39.310330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:39.310330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:39.310330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:39.310330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 248/493] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:39.314323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456cac9-b0cf-4acd-b61f-9e8ff1c6ab4d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:39.314885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df6d25-40da-45c3-9b4a-8a79348daba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:39.315614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df6d25-40da-45c3-9b4a-8a79348daba2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.315892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df6d25-40da-45c3-9b4a-8a79348daba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.316160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df6d25-40da-45c3-9b4a-8a79348daba2 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.316927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df6d25-40da-45c3-9b4a-8a79348daba2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:39.317154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df6d25-40da-45c3-9b4a-8a79348daba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:39.318897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df6d25-40da-45c3-9b4a-8a79348daba2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:39.333952 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 246/494] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:39.333952 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df6d25-40da-45c3-9b4a-8a79348daba2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:39.337735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:39.428314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456cac9-b0cf-4acd-b61f-9e8ff1c6ab4d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:39.442514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df6d25-40da-45c3-9b4a-8a79348daba2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:39.465664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b2205-a97d-4d12-b6e4-265218830484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:39.466285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b2205-a97d-4d12-b6e4-265218830484 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.466564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b2205-a97d-4d12-b6e4-265218830484 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.466840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b2205-a97d-4d12-b6e4-265218830484 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.467627 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b2205-a97d-4d12-b6e4-265218830484 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:39.468238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b2205-a97d-4d12-b6e4-265218830484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:39.469340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b2205-a97d-4d12-b6e4-265218830484 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:39.477092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ed362-5ccd-49a5-adf8-18d6e4162f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:39.477728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed362-5ccd-49a5-adf8-18d6e4162f19 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.482314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed362-5ccd-49a5-adf8-18d6e4162f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.482447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 249/495] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:39.482526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed362-5ccd-49a5-adf8-18d6e4162f19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.482596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b2205-a97d-4d12-b6e4-265218830484 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:39.493215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ed362-5ccd-49a5-adf8-18d6e4162f19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1f7ed362-5ccd-49a5-adf8-18d6e4162f19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:39.498371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:39.499976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 247/496] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:39.501288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ed362-5ccd-49a5-adf8-18d6e4162f19 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:39.547410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:39.566113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:39.589417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b2205-a97d-4d12-b6e4-265218830484 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:39.605576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ed362-5ccd-49a5-adf8-18d6e4162f19 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:39.622546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7715bf-e224-499b-8114-c8bb94d70bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:39.623228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7715bf-e224-499b-8114-c8bb94d70bcf None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.623531 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7715bf-e224-499b-8114-c8bb94d70bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.623942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7715bf-e224-499b-8114-c8bb94d70bcf None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.624602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7715bf-e224-499b-8114-c8bb94d70bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:39.624902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7715bf-e224-499b-8114-c8bb94d70bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:39.626319 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7715bf-e224-499b-8114-c8bb94d70bcf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:39.638016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 250/497] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:39.638619 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7715bf-e224-499b-8114-c8bb94d70bcf None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:39.640280 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8363fb-2a33-4cf4-9103-701c0be75189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:39.640947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8363fb-2a33-4cf4-9103-701c0be75189 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.641333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8363fb-2a33-4cf4-9103-701c0be75189 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.641590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8363fb-2a33-4cf4-9103-701c0be75189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.652410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8363fb-2a33-4cf4-9103-701c0be75189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:39.653926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8363fb-2a33-4cf4-9103-701c0be75189 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-6f8363fb-2a33-4cf4-9103-701c0be75189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:39.668668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:39.669578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:39.671041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:39.671041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:39.671041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:39.671041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 248/498] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:39.671041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8363fb-2a33-4cf4-9103-701c0be75189 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:39.740622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7715bf-e224-499b-8114-c8bb94d70bcf None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:39.764180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:39.774092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8363fb-2a33-4cf4-9103-701c0be75189 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:39.778965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f796b60-28a8-4360-9e8d-4fdda84e1d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:39.779599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f796b60-28a8-4360-9e8d-4fdda84e1d63 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.780082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f796b60-28a8-4360-9e8d-4fdda84e1d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.780885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f796b60-28a8-4360-9e8d-4fdda84e1d63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.783539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:39.791905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f796b60-28a8-4360-9e8d-4fdda84e1d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:39.793470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f796b60-28a8-4360-9e8d-4fdda84e1d63 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:39.808669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d17241-b287-485a-af69-9c73feb9e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5f796b60-28a8-4360-9e8d-4fdda84e1d63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:39.808819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:39.809760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:39.810636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:39.810636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:39.810636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:39.810799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d17241-b287-485a-af69-9c73feb9e7cb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.810799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d17241-b287-485a-af69-9c73feb9e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.810799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d17241-b287-485a-af69-9c73feb9e7cb None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.811012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 251/499] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:39.811110 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d17241-b287-485a-af69-9c73feb9e7cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:39.811110 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d17241-b287-485a-af69-9c73feb9e7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:39.812056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aead0a-6030-4d4c-9338-ba8d0ea2230d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.812056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aead0a-6030-4d4c-9338-ba8d0ea2230d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.812056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aead0a-6030-4d4c-9338-ba8d0ea2230d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.812421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d17241-b287-485a-af69-9c73feb9e7cb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:39.813417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 252/500] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:39.813956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aead0a-6030-4d4c-9338-ba8d0ea2230d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:39.821211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 249/501] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:39.822143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d17241-b287-485a-af69-9c73feb9e7cb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:39.921264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aead0a-6030-4d4c-9338-ba8d0ea2230d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:39.924710 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d17241-b287-485a-af69-9c73feb9e7cb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:39.953574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31ba1a-e3f4-4afb-943e-481265988d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:39.954191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31ba1a-e3f4-4afb-943e-481265988d3b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.954465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31ba1a-e3f4-4afb-943e-481265988d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.954729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31ba1a-e3f4-4afb-943e-481265988d3b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.958523 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfce1e-eeec-4c68-b4a4-34ec3def755d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:39.959160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfce1e-eeec-4c68-b4a4-34ec3def755d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.959438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfce1e-eeec-4c68-b4a4-34ec3def755d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.959708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfce1e-eeec-4c68-b4a4-34ec3def755d None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.960371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfce1e-eeec-4c68-b4a4-34ec3def755d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:39.960674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfce1e-eeec-4c68-b4a4-34ec3def755d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:39.961990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31ba1a-e3f4-4afb-943e-481265988d3b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:39.962093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfce1e-eeec-4c68-b4a4-34ec3def755d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:39.963477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31ba1a-e3f4-4afb-943e-481265988d3b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:39.974075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 250/502] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:39.974972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfce1e-eeec-4c68-b4a4-34ec3def755d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5e31ba1a-e3f4-4afb-943e-481265988d3b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:39.975788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:39.976753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:39.977684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:39.977684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:39.977684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:39.977684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:39.977684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:39.977684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:39.977684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:39.977684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:39.977684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 00:59:39.977684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:39.980432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 253/503] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:39.981974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0fc23-2e0b-4d4f-b85e-752b336c2c0f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:39.982258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0fc23-2e0b-4d4f-b85e-752b336c2c0f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:39.982531 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0fc23-2e0b-4d4f-b85e-752b336c2c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:39.991931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:40.002334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4fb0fc23-2e0b-4d4f-b85e-752b336c2c0f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:40.003534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4fb0fc23-2e0b-4d4f-b85e-752b336c2c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:40.051241 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:40.074871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 254/504] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:40.075695 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0fc23-2e0b-4d4f-b85e-752b336c2c0f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:40.093500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfce1e-eeec-4c68-b4a4-34ec3def755d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:40.130883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19077813-9b8a-4c2a-ab4c-a5b8c83ec598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:40.131492 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19077813-9b8a-4c2a-ab4c-a5b8c83ec598 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:40.131803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19077813-9b8a-4c2a-ab4c-a5b8c83ec598 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:40.132086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19077813-9b8a-4c2a-ab4c-a5b8c83ec598 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:40.132758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19077813-9b8a-4c2a-ab4c-a5b8c83ec598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:40.133062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19077813-9b8a-4c2a-ab4c-a5b8c83ec598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:40.134485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19077813-9b8a-4c2a-ab4c-a5b8c83ec598 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:40.146832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 251/505] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:40.151908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19077813-9b8a-4c2a-ab4c-a5b8c83ec598 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:40.190071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0fc23-2e0b-4d4f-b85e-752b336c2c0f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:40.225326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d3cda-08ab-48f8-81e0-72d213a054bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:40.225962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d3cda-08ab-48f8-81e0-72d213a054bc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:40.226233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d3cda-08ab-48f8-81e0-72d213a054bc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:40.226499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d3cda-08ab-48f8-81e0-72d213a054bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:40.231620 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:40.237002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d3cda-08ab-48f8-81e0-72d213a054bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:40.238515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d3cda-08ab-48f8-81e0-72d213a054bc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9f7d3cda-08ab-48f8-81e0-72d213a054bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:40.254011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:40.254975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:40.255843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:40.255843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:40.255843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:40.255843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 255/506] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:40.256072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d3cda-08ab-48f8-81e0-72d213a054bc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:40.263228 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19077813-9b8a-4c2a-ab4c-a5b8c83ec598 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:40.291755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:40.300174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee710133-2731-47de-ad76-74c3387a1cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:40.300782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee710133-2731-47de-ad76-74c3387a1cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:40.301063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee710133-2731-47de-ad76-74c3387a1cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:40.301337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee710133-2731-47de-ad76-74c3387a1cc4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:40.308851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee710133-2731-47de-ad76-74c3387a1cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:40.310347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee710133-2731-47de-ad76-74c3387a1cc4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-ee710133-2731-47de-ad76-74c3387a1cc4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:40.322793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:40.323724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:40.324732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:40.324732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:40.324732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:40.324732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:40.324732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:40.324732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:40.324732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:40.324732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:40.324732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 00:59:40.324732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:40.324732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 252/507] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 6 00:59:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:40.324732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee710133-2731-47de-ad76-74c3387a1cc4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:40.371178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d3cda-08ab-48f8-81e0-72d213a054bc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:40.404603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe691321-2768-46fc-9d1a-2ca2ee137057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:40.405316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe691321-2768-46fc-9d1a-2ca2ee137057 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:40.405594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe691321-2768-46fc-9d1a-2ca2ee137057 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:40.405868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe691321-2768-46fc-9d1a-2ca2ee137057 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:40.406601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe691321-2768-46fc-9d1a-2ca2ee137057 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:40.406903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe691321-2768-46fc-9d1a-2ca2ee137057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:40.408459 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe691321-2768-46fc-9d1a-2ca2ee137057 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:40.426117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee710133-2731-47de-ad76-74c3387a1cc4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:40.445358 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 256/508] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Sep 6 00:59:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:40.446196 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe691321-2768-46fc-9d1a-2ca2ee137057 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:40.460159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b04d1-4abd-40fa-bbc8-4e91c5f7e7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:40.460820 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b04d1-4abd-40fa-bbc8-4e91c5f7e7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:40.461092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b04d1-4abd-40fa-bbc8-4e91c5f7e7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:40.461357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b04d1-4abd-40fa-bbc8-4e91c5f7e7a8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:40.463218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:40.469857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b04d1-4abd-40fa-bbc8-4e91c5f7e7a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:40.471513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b04d1-4abd-40fa-bbc8-4e91c5f7e7a8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-cd4b04d1-4abd-40fa-bbc8-4e91c5f7e7a8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:40.482910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:40.484063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:40.485170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:40.485170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:40.485170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:40.485170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:40.485170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:40.485170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:40.485170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:40.485170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:40.485170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 00:59:40.485170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:40.485170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 253/509] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:40.485170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b04d1-4abd-40fa-bbc8-4e91c5f7e7a8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:40.542891 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:40.555069 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe691321-2768-46fc-9d1a-2ca2ee137057 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:40.586614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b04d1-4abd-40fa-bbc8-4e91c5f7e7a8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:40.587907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77d115-a629-44bf-8184-dcee7c1f3cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:40.588550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77d115-a629-44bf-8184-dcee7c1f3cfa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:40.588814 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77d115-a629-44bf-8184-dcee7c1f3cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:40.589073 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77d115-a629-44bf-8184-dcee7c1f3cfa None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:40.589699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77d115-a629-44bf-8184-dcee7c1f3cfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:40.589989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77d115-a629-44bf-8184-dcee7c1f3cfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:40.591419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77d115-a629-44bf-8184-dcee7c1f3cfa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:40.603145 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 257/510] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:40.603962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77d115-a629-44bf-8184-dcee7c1f3cfa None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:40.624128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424795d-d062-41ef-a2b8-9a438dac04e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:40.624576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424795d-d062-41ef-a2b8-9a438dac04e4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:40.624853 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424795d-d062-41ef-a2b8-9a438dac04e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:40.625121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424795d-d062-41ef-a2b8-9a438dac04e4 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:40.625841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424795d-d062-41ef-a2b8-9a438dac04e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:40.626141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424795d-d062-41ef-a2b8-9a438dac04e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:40.627629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424795d-d062-41ef-a2b8-9a438dac04e4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:40.664542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 254/511] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 6 00:59:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:40.665401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424795d-d062-41ef-a2b8-9a438dac04e4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:40.709676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77d115-a629-44bf-8184-dcee7c1f3cfa None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:40.720035 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:40.742163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485015f-2607-4897-96f3-afe67afd2b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:40.742789 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485015f-2607-4897-96f3-afe67afd2b98 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:40.743064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485015f-2607-4897-96f3-afe67afd2b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:40.743329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485015f-2607-4897-96f3-afe67afd2b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:40.754895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485015f-2607-4897-96f3-afe67afd2b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:40.756419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485015f-2607-4897-96f3-afe67afd2b98 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:40.764206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:40.769666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424795d-d062-41ef-a2b8-9a438dac04e4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9485015f-2607-4897-96f3-afe67afd2b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:40.771858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:40.772774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:40.777184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:40.777184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:40.777184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:40.777184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 258/512] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:40.777184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485015f-2607-4897-96f3-afe67afd2b98 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:40.805849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68600d4-e06c-4980-b3e7-1c2f08f5dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:40.806380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68600d4-e06c-4980-b3e7-1c2f08f5dc04 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:40.806649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68600d4-e06c-4980-b3e7-1c2f08f5dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:40.806915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68600d4-e06c-4980-b3e7-1c2f08f5dc04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:40.873684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68600d4-e06c-4980-b3e7-1c2f08f5dc04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:40.874153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485015f-2607-4897-96f3-afe67afd2b98 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:40.875218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68600d4-e06c-4980-b3e7-1c2f08f5dc04 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:40.907693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc606d2b-88ca-4250-8b83-db197b7bbbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:40.908403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc606d2b-88ca-4250-8b83-db197b7bbbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:40.908738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc606d2b-88ca-4250-8b83-db197b7bbbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:40.909067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc606d2b-88ca-4250-8b83-db197b7bbbb1 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:40.909846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc606d2b-88ca-4250-8b83-db197b7bbbb1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:40.910155 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc606d2b-88ca-4250-8b83-db197b7bbbb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:40.911964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc606d2b-88ca-4250-8b83-db197b7bbbb1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:40.928553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 259/513] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Sep 6 00:59:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:40.929620 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc606d2b-88ca-4250-8b83-db197b7bbbb1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:40.934783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:40.989423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 255/514] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:40.990327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68600d4-e06c-4980-b3e7-1c2f08f5dc04 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:40.991302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:41.033865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc606d2b-88ca-4250-8b83-db197b7bbbb1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:41.070288 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ea684-8f8b-4cbc-890a-fac9d185ba6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:41.070855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ea684-8f8b-4cbc-890a-fac9d185ba6c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:41.071137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ea684-8f8b-4cbc-890a-fac9d185ba6c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:41.071411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ea684-8f8b-4cbc-890a-fac9d185ba6c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:41.078733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ea684-8f8b-4cbc-890a-fac9d185ba6c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:41.080229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ea684-8f8b-4cbc-890a-fac9d185ba6c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:41.088563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68600d4-e06c-4980-b3e7-1c2f08f5dc04 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-047ea684-8f8b-4cbc-890a-fac9d185ba6c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:41.092105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:41.093411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:41.094651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:41.094651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:41.094651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:41.094651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:41.094651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:41.094651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:41.094651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:41.094651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:41.094651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 00:59:41.094651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:41.094651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 260/515] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:41.094651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ea684-8f8b-4cbc-890a-fac9d185ba6c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:41.126156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5aaa2-ebe9-4326-8465-ca1e41df4377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:41.126845 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5aaa2-ebe9-4326-8465-ca1e41df4377 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:41.127120 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5aaa2-ebe9-4326-8465-ca1e41df4377 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:41.127390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5aaa2-ebe9-4326-8465-ca1e41df4377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:41.148857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:41.194573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ea684-8f8b-4cbc-890a-fac9d185ba6c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:41.197342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5aaa2-ebe9-4326-8465-ca1e41df4377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:41.198860 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5aaa2-ebe9-4326-8465-ca1e41df4377 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:41.211234 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:41.228430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b2c2b-850f-405d-b718-3a10fd5dbaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:41.229042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2c2b-850f-405d-b718-3a10fd5dbaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:41.229322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2c2b-850f-405d-b718-3a10fd5dbaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:41.229603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2c2b-850f-405d-b718-3a10fd5dbaf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:41.230251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b2c2b-850f-405d-b718-3a10fd5dbaf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:41.230552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b2c2b-850f-405d-b718-3a10fd5dbaf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:41.231979 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b2c2b-850f-405d-b718-3a10fd5dbaf8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:41.243903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 261/516] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:41.244718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b2c2b-850f-405d-b718-3a10fd5dbaf8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:41.306835 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 256/517] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:41.307677 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5aaa2-ebe9-4326-8465-ca1e41df4377 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:41.344176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b2c2b-850f-405d-b718-3a10fd5dbaf8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:41.358759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:41.378331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354bcea-14b4-43c3-bb37-5cc87317b280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:41.378943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354bcea-14b4-43c3-bb37-5cc87317b280 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:41.379220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354bcea-14b4-43c3-bb37-5cc87317b280 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:41.379486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354bcea-14b4-43c3-bb37-5cc87317b280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:41.406657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5aaa2-ebe9-4326-8465-ca1e41df4377 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:41.427000 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:41.441372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e80db-0b75-41e9-99e0-cf78d711df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:41.442011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e80db-0b75-41e9-99e0-cf78d711df63 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:41.442278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e80db-0b75-41e9-99e0-cf78d711df63 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:41.442545 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e80db-0b75-41e9-99e0-cf78d711df63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:41.452048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354bcea-14b4-43c3-bb37-5cc87317b280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:41.452384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e80db-0b75-41e9-99e0-cf78d711df63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:41.453250 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354bcea-14b4-43c3-bb37-5cc87317b280 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:41.453889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e80db-0b75-41e9-99e0-cf78d711df63 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f86e80db-0b75-41e9-99e0-cf78d711df63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:41.469372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:41.470294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:41.471753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:41.471753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:41.471753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:41.471753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 257/518] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:41.471753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e80db-0b75-41e9-99e0-cf78d711df63 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:41.551553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 262/519] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:41.552399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354bcea-14b4-43c3-bb37-5cc87317b280 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:41.577825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e80db-0b75-41e9-99e0-cf78d711df63 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:41.580917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:41.616670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae3ff0-3ae4-4c5a-9e0f-7494a73e9f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:41.617188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae3ff0-3ae4-4c5a-9e0f-7494a73e9f80 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:41.617462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae3ff0-3ae4-4c5a-9e0f-7494a73e9f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:41.617725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae3ff0-3ae4-4c5a-9e0f-7494a73e9f80 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:41.618446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae3ff0-3ae4-4c5a-9e0f-7494a73e9f80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:41.618751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae3ff0-3ae4-4c5a-9e0f-7494a73e9f80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:41.620236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae3ff0-3ae4-4c5a-9e0f-7494a73e9f80 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:41.630514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:41.638814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 258/520] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Sep 6 00:59:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:41.638814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae3ff0-3ae4-4c5a-9e0f-7494a73e9f80 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:41.654529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354bcea-14b4-43c3-bb37-5cc87317b280 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:41.691727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcb90f-401e-4ddf-9251-ee5d7c9ca476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:41.692362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcb90f-401e-4ddf-9251-ee5d7c9ca476 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:41.692637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcb90f-401e-4ddf-9251-ee5d7c9ca476 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:41.692900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcb90f-401e-4ddf-9251-ee5d7c9ca476 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:41.693548 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bcb90f-401e-4ddf-9251-ee5d7c9ca476 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:41.695642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bcb90f-401e-4ddf-9251-ee5d7c9ca476 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:41.717493 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 263/521] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 00:59:41 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 00:59:41.718321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcb90f-401e-4ddf-9251-ee5d7c9ca476 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:41.753451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae3ff0-3ae4-4c5a-9e0f-7494a73e9f80 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:41.794584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610c041-295a-495c-b31e-db3a53a03d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:41.795352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610c041-295a-495c-b31e-db3a53a03d15 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:41.795903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610c041-295a-495c-b31e-db3a53a03d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:41.795903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610c041-295a-495c-b31e-db3a53a03d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:41.807461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610c041-295a-495c-b31e-db3a53a03d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:41.809048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610c041-295a-495c-b31e-db3a53a03d15 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f610c041-295a-495c-b31e-db3a53a03d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:41.825109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:41.826162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:41.827396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:41.827396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:41.827396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:41.827396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 259/522] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:41.827396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610c041-295a-495c-b31e-db3a53a03d15 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:41.843910 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcb90f-401e-4ddf-9251-ee5d7c9ca476 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:41.847465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:41.878703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9774a4-2aab-48bc-a1aa-1c40c1d504a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:41.879240 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9774a4-2aab-48bc-a1aa-1c40c1d504a6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:41.879513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9774a4-2aab-48bc-a1aa-1c40c1d504a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:41.879782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9774a4-2aab-48bc-a1aa-1c40c1d504a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:41.880456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9774a4-2aab-48bc-a1aa-1c40c1d504a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:41.880755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9774a4-2aab-48bc-a1aa-1c40c1d504a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:41.882167 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9774a4-2aab-48bc-a1aa-1c40c1d504a6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:41.883809 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:41.896768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 264/523] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:41.897679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9774a4-2aab-48bc-a1aa-1c40c1d504a6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:41.953509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610c041-295a-495c-b31e-db3a53a03d15 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:41.994716 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11a46e-af16-4ff4-93c4-b1b10f5c9b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:41.995779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11a46e-af16-4ff4-93c4-b1b10f5c9b4a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:41.996060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11a46e-af16-4ff4-93c4-b1b10f5c9b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:41.996350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11a46e-af16-4ff4-93c4-b1b10f5c9b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:42.009424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9774a4-2aab-48bc-a1aa-1c40c1d504a6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:42.013391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11a46e-af16-4ff4-93c4-b1b10f5c9b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:42.015175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11a46e-af16-4ff4-93c4-b1b10f5c9b4a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-dc11a46e-af16-4ff4-93c4-b1b10f5c9b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:42.031091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:42.032167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:42.033072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:42.033072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:42.033072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:42.033072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 260/524] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:42.033072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11a46e-af16-4ff4-93c4-b1b10f5c9b4a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:42.051267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064ceef-ee26-4938-acb6-6502ac03e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:42.052138 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064ceef-ee26-4938-acb6-6502ac03e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:42.052437 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064ceef-ee26-4938-acb6-6502ac03e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:42.052710 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064ceef-ee26-4938-acb6-6502ac03e3b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:42.105164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:42.114995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:42.123104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064ceef-ee26-4938-acb6-6502ac03e3b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:42.124756 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064ceef-ee26-4938-acb6-6502ac03e3b0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:42.144698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11a46e-af16-4ff4-93c4-b1b10f5c9b4a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:42.181502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d2c31-bf91-474e-96b6-fcee1ef9d8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:42.182350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d2c31-bf91-474e-96b6-fcee1ef9d8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:42.182768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d2c31-bf91-474e-96b6-fcee1ef9d8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:42.183328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d2c31-bf91-474e-96b6-fcee1ef9d8a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:42.184238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d2c31-bf91-474e-96b6-fcee1ef9d8a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:42.184714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d2c31-bf91-474e-96b6-fcee1ef9d8a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:42.186467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d2c31-bf91-474e-96b6-fcee1ef9d8a3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:42.200071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 261/525] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:42.201327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d2c31-bf91-474e-96b6-fcee1ef9d8a3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:42.231924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 265/526] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:42.233495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064ceef-ee26-4938-acb6-6502ac03e3b0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:42.312927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d2c31-bf91-474e-96b6-fcee1ef9d8a3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:42.334378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:42.341217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:42.342283 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064ceef-ee26-4938-acb6-6502ac03e3b0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:42.350793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b17126-f8ef-4dd1-b693-158fb2d885e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:42.351418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b17126-f8ef-4dd1-b693-158fb2d885e6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:42.351691 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b17126-f8ef-4dd1-b693-158fb2d885e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:42.351955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b17126-f8ef-4dd1-b693-158fb2d885e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:42.359028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b17126-f8ef-4dd1-b693-158fb2d885e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:42.360547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b17126-f8ef-4dd1-b693-158fb2d885e6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-14b17126-f8ef-4dd1-b693-158fb2d885e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:42.372327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:42.373231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:42.374807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:42.374807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:42.374807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:42.374807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:42.374807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:42.374807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:42.374807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:42.374807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:42.374807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 262/527] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:42.374807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b17126-f8ef-4dd1-b693-158fb2d885e6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:42.384039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e668f05-cc2d-4507-9a1e-b71466063d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:42.384714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668f05-cc2d-4507-9a1e-b71466063d83 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:42.384991 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668f05-cc2d-4507-9a1e-b71466063d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:42.385263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668f05-cc2d-4507-9a1e-b71466063d83 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:42.386277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e668f05-cc2d-4507-9a1e-b71466063d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:42.386582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e668f05-cc2d-4507-9a1e-b71466063d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:42.388367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e668f05-cc2d-4507-9a1e-b71466063d83 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:42.400437 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 266/528] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:42.401190 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e668f05-cc2d-4507-9a1e-b71466063d83 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:42.484550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b17126-f8ef-4dd1-b693-158fb2d885e6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:42.506515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e668f05-cc2d-4507-9a1e-b71466063d83 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:42.518567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700af0-7ac9-4a32-b1b3-d65c2d28f24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:42.519197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700af0-7ac9-4a32-b1b3-d65c2d28f24a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:42.519471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700af0-7ac9-4a32-b1b3-d65c2d28f24a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:42.519729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700af0-7ac9-4a32-b1b3-d65c2d28f24a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:42.526582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94700af0-7ac9-4a32-b1b3-d65c2d28f24a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:42.528058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94700af0-7ac9-4a32-b1b3-d65c2d28f24a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-94700af0-7ac9-4a32-b1b3-d65c2d28f24a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:42.540019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:42.540908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:42.541782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:42.541782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:42.541782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:42.541782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:42.541782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:42.541782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:42.541782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:42.541782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:42.543801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72342-37c0-4854-b3fa-9e98cb4ad597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:42.544464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72342-37c0-4854-b3fa-9e98cb4ad597 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:42.544744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72342-37c0-4854-b3fa-9e98cb4ad597 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:42.545017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72342-37c0-4854-b3fa-9e98cb4ad597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:42.546153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 263/529] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:42.546678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700af0-7ac9-4a32-b1b3-d65c2d28f24a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:42.556312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72342-37c0-4854-b3fa-9e98cb4ad597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:42.557847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72342-37c0-4854-b3fa-9e98cb4ad597 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-96d72342-37c0-4854-b3fa-9e98cb4ad597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:42.572668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:42.573610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:42.574463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:42.574463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:42.574463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:42.574463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 267/530] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:42.574693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72342-37c0-4854-b3fa-9e98cb4ad597 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:42.586100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:42.600599 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:42.656715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700af0-7ac9-4a32-b1b3-d65c2d28f24a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:42.684642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72342-37c0-4854-b3fa-9e98cb4ad597 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:42.690795 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c7dcd-e724-4384-819d-65941b2dc412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:42.691410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c7dcd-e724-4384-819d-65941b2dc412 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:42.691684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c7dcd-e724-4384-819d-65941b2dc412 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:42.691961 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c7dcd-e724-4384-819d-65941b2dc412 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:42.692675 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c7dcd-e724-4384-819d-65941b2dc412 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:42.692974 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c7dcd-e724-4384-819d-65941b2dc412 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:42.694453 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c7dcd-e724-4384-819d-65941b2dc412 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:42.715612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 264/531] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:42.716450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c7dcd-e724-4384-819d-65941b2dc412 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:42.724429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a0504-1e60-4591-abf8-2e5a8e9f2b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:42.725494 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a0504-1e60-4591-abf8-2e5a8e9f2b32 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:42.725773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a0504-1e60-4591-abf8-2e5a8e9f2b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:42.726046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a0504-1e60-4591-abf8-2e5a8e9f2b32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:42.733791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a0504-1e60-4591-abf8-2e5a8e9f2b32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:42.735298 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a0504-1e60-4591-abf8-2e5a8e9f2b32 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b01a0504-1e60-4591-abf8-2e5a8e9f2b32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:42.747724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:42.748835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:42.749731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:42.749731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:42.749731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:42.749731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:42.749731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:42.749731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:42.749731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:42.749731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:42.749731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 268/532] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:42.750206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a0504-1e60-4591-abf8-2e5a8e9f2b32 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:42.817660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:42.828263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c7dcd-e724-4384-819d-65941b2dc412 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:42.838901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:42.855704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a0504-1e60-4591-abf8-2e5a8e9f2b32 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:42.870180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af5657-8bad-4d5a-b6bd-c0ca269556d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:42.870789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af5657-8bad-4d5a-b6bd-c0ca269556d8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:42.871062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af5657-8bad-4d5a-b6bd-c0ca269556d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:42.871328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af5657-8bad-4d5a-b6bd-c0ca269556d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:42.872005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af5657-8bad-4d5a-b6bd-c0ca269556d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:42.872334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af5657-8bad-4d5a-b6bd-c0ca269556d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:42.873970 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af5657-8bad-4d5a-b6bd-c0ca269556d8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:42.885863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 265/533] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:42.886650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af5657-8bad-4d5a-b6bd-c0ca269556d8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:42.897925 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3ff16-b64e-4dc3-8f3b-1aac0ff58fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:42.898546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3ff16-b64e-4dc3-8f3b-1aac0ff58fed None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:42.898822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3ff16-b64e-4dc3-8f3b-1aac0ff58fed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:42.899097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3ff16-b64e-4dc3-8f3b-1aac0ff58fed None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:42.899770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3ff16-b64e-4dc3-8f3b-1aac0ff58fed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:42.900073 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3ff16-b64e-4dc3-8f3b-1aac0ff58fed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:42.901547 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3ff16-b64e-4dc3-8f3b-1aac0ff58fed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:42.914977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 269/534] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:42.916015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3ff16-b64e-4dc3-8f3b-1aac0ff58fed None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:42.998751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af5657-8bad-4d5a-b6bd-c0ca269556d8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:43.022092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3ff16-b64e-4dc3-8f3b-1aac0ff58fed None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:43.034853 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490a620-24c2-4de2-9049-d018ade38e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:43.035573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490a620-24c2-4de2-9049-d018ade38e0c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:43.035875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490a620-24c2-4de2-9049-d018ade38e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:43.036548 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490a620-24c2-4de2-9049-d018ade38e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:43.037315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490a620-24c2-4de2-9049-d018ade38e0c None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=31ebbadd69da4bc6ad25b5c882962ea4) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:43.037621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490a620-24c2-4de2-9049-d018ade38e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:43.039186 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490a620-24c2-4de2-9049-d018ade38e0c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:43.045475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 266/535] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:42 2022] GET /identity/v3/role_assignments?user.id=31ebbadd69da4bc6ad25b5c882962ea4&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:43.046202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490a620-24c2-4de2-9049-d018ade38e0c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:43.065001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:43.076851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47d245-70d4-41e5-8194-9ec38586e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:43.077946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47d245-70d4-41e5-8194-9ec38586e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:43.078438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47d245-70d4-41e5-8194-9ec38586e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:43.078968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47d245-70d4-41e5-8194-9ec38586e2b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:43.079977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47d245-70d4-41e5-8194-9ec38586e2b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:43.080607 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47d245-70d4-41e5-8194-9ec38586e2b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:43.082432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47d245-70d4-41e5-8194-9ec38586e2b3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:43.086748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:43.112277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 270/536] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:43.113670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47d245-70d4-41e5-8194-9ec38586e2b3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:43.178973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490a620-24c2-4de2-9049-d018ade38e0c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:43.224545 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0a65e-3822-4904-83b4-d6f20d9ce1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:43.225647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0a65e-3822-4904-83b4-d6f20d9ce1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:43.226065 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0a65e-3822-4904-83b4-d6f20d9ce1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:43.226641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0a65e-3822-4904-83b4-d6f20d9ce1f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:43.227839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0a65e-3822-4904-83b4-d6f20d9ce1f0 None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=42b9c25e98fe4b1bbc33a601d4150071) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:43.228535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0a65e-3822-4904-83b4-d6f20d9ce1f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:43.230618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0a65e-3822-4904-83b4-d6f20d9ce1f0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:43.235963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47d245-70d4-41e5-8194-9ec38586e2b3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:43.239505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 267/537] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:43 2022] GET /identity/v3/role_assignments?user.id=42b9c25e98fe4b1bbc33a601d4150071&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:43.240602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0a65e-3822-4904-83b4-d6f20d9ce1f0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:43.360079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0a65e-3822-4904-83b4-d6f20d9ce1f0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:43.364012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:43.373273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed74f1-fa47-4ec6-9fb3-471cd0ebbd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:43.374014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed74f1-fa47-4ec6-9fb3-471cd0ebbd2d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:43.374391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed74f1-fa47-4ec6-9fb3-471cd0ebbd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:43.374806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed74f1-fa47-4ec6-9fb3-471cd0ebbd2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:43.400909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43230e2-55e8-4359-ab12-821f51486753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:43.401813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43230e2-55e8-4359-ab12-821f51486753 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:43.402086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed74f1-fa47-4ec6-9fb3-471cd0ebbd2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:43.402399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43230e2-55e8-4359-ab12-821f51486753 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:43.402804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43230e2-55e8-4359-ab12-821f51486753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:43.403664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43230e2-55e8-4359-ab12-821f51486753 None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=eae9814386a444678a292becdfe07332) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:43.403972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed74f1-fa47-4ec6-9fb3-471cd0ebbd2d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:43.404367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43230e2-55e8-4359-ab12-821f51486753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:43.406293 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43230e2-55e8-4359-ab12-821f51486753 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:43.413941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 268/538] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:43 2022] GET /identity/v3/role_assignments?user.id=eae9814386a444678a292becdfe07332&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-92ed74f1-fa47-4ec6-9fb3-471cd0ebbd2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:43.438904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:43.439836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:43.440818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:43.440818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:43.440818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:43.440818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:43.440818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:43.440818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:43.440818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:43.440818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:43.440818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 271/539] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:43.446603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43230e2-55e8-4359-ab12-821f51486753 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:43.599453 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43230e2-55e8-4359-ab12-821f51486753 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:43.637053 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ea2ac-6170-4710-959f-03ae8ae356d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:43.637669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ea2ac-6170-4710-959f-03ae8ae356d4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:43.637946 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ea2ac-6170-4710-959f-03ae8ae356d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:43.638216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ea2ac-6170-4710-959f-03ae8ae356d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:43.638941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ea2ac-6170-4710-959f-03ae8ae356d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:43.639234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ea2ac-6170-4710-959f-03ae8ae356d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:43.640774 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ea2ac-6170-4710-959f-03ae8ae356d4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:43.656602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 269/540] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:43.659669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed74f1-fa47-4ec6-9fb3-471cd0ebbd2d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:43.688715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cf1de-9141-4571-ae9c-f903f999c7b5 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:43.689074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cf1de-9141-4571-ae9c-f903f999c7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:43.689269 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cf1de-9141-4571-ae9c-f903f999c7b5 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:43.699841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 270/541] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:43.705305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8cd0-3d81-459b-b9b0-d81b00db36e0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:43.705646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8cd0-3d81-459b-b9b0-d81b00db36e0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:43.705931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8cd0-3d81-459b-b9b0-d81b00db36e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:43.718060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:43.741427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ef4a8cd0-3d81-459b-b9b0-d81b00db36e0 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:43.742702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ef4a8cd0-3d81-459b-b9b0-d81b00db36e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:43.784703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:43.801705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed74f1-fa47-4ec6-9fb3-471cd0ebbd2d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:43.863575 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 271/542] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:43.870834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae36ec-5937-4ed0-b000-0c0c44241205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:43.871667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae36ec-5937-4ed0-b000-0c0c44241205 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:43.872149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae36ec-5937-4ed0-b000-0c0c44241205 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:43.872625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae36ec-5937-4ed0-b000-0c0c44241205 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:43.873638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae36ec-5937-4ed0-b000-0c0c44241205 None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=2fc30f3a335f428082e9178227dcb4e5) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:43.874124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae36ec-5937-4ed0-b000-0c0c44241205 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:43.875988 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae36ec-5937-4ed0-b000-0c0c44241205 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:43.886831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 272/543] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:43 2022] GET /identity/v3/role_assignments?user.id=2fc30f3a335f428082e9178227dcb4e5&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:44.162270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a8cd0-3d81-459b-b9b0-d81b00db36e0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:44.273134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a8cd0-3d81-459b-b9b0-d81b00db36e0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:44.326035 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9550d2-5acf-42c6-afc4-20c0a85e6127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:44.326806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9550d2-5acf-42c6-afc4-20c0a85e6127 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:44.327083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9550d2-5acf-42c6-afc4-20c0a85e6127 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:44.327355 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9550d2-5acf-42c6-afc4-20c0a85e6127 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:44.347113 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9550d2-5acf-42c6-afc4-20c0a85e6127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-ba9550d2-5acf-42c6-afc4-20c0a85e6127 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:44.351886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:44.352817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:44.353627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 272/544] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:44.360887 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae36ec-5937-4ed0-b000-0c0c44241205 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:44.516258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae36ec-5937-4ed0-b000-0c0c44241205 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:44.526658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:44.551126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639d4f0-f40b-46bd-a18c-00d93a729ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:44.551738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639d4f0-f40b-46bd-a18c-00d93a729ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:44.552010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639d4f0-f40b-46bd-a18c-00d93a729ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:44.552279 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639d4f0-f40b-46bd-a18c-00d93a729ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:44.552963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639d4f0-f40b-46bd-a18c-00d93a729ac6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:44.553259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639d4f0-f40b-46bd-a18c-00d93a729ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:44.554699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639d4f0-f40b-46bd-a18c-00d93a729ac6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:44.563694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 273/545] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:44.569203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9550d2-5acf-42c6-afc4-20c0a85e6127 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:44.592973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:44.705047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9550d2-5acf-42c6-afc4-20c0a85e6127 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:44.741515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b514f7-a7c5-4c13-8d41-0d18e8e2db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:44.742148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b514f7-a7c5-4c13-8d41-0d18e8e2db88 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:44.742418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b514f7-a7c5-4c13-8d41-0d18e8e2db88 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:44.742684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b514f7-a7c5-4c13-8d41-0d18e8e2db88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:44.753705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b514f7-a7c5-4c13-8d41-0d18e8e2db88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:44.755217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b514f7-a7c5-4c13-8d41-0d18e8e2db88 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-72b514f7-a7c5-4c13-8d41-0d18e8e2db88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:44.771073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:44.772058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:44.772968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:44.772968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:44.772968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:44.772968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 273/546] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:44.781577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639d4f0-f40b-46bd-a18c-00d93a729ac6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:44.904101 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639d4f0-f40b-46bd-a18c-00d93a729ac6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:44.937532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e2eb3-eaaa-4dd2-826d-e6329c76d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:44.938203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e2eb3-eaaa-4dd2-826d-e6329c76d186 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:44.938476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e2eb3-eaaa-4dd2-826d-e6329c76d186 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:44.938740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e2eb3-eaaa-4dd2-826d-e6329c76d186 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:44.939375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e2eb3-eaaa-4dd2-826d-e6329c76d186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:44.939669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e2eb3-eaaa-4dd2-826d-e6329c76d186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:44.941111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e2eb3-eaaa-4dd2-826d-e6329c76d186 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:44.954224 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 274/547] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:44.961356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b514f7-a7c5-4c13-8d41-0d18e8e2db88 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:45.052656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:45.087749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b514f7-a7c5-4c13-8d41-0d18e8e2db88 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:45.122272 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fa062-f55f-487d-a362-1294a4eddf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:45.122908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fa062-f55f-487d-a362-1294a4eddf40 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:45.123262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fa062-f55f-487d-a362-1294a4eddf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:45.123619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fa062-f55f-487d-a362-1294a4eddf40 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:45.140820 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fa062-f55f-487d-a362-1294a4eddf40 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:45.142438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fa062-f55f-487d-a362-1294a4eddf40 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-254fa062-f55f-487d-a362-1294a4eddf40 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:45.154054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:45.155437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:45.157132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:45.157132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:45.157132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:45.157132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:45.157132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:45.157132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:45.157132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:45.157132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:45.157132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 00:59:45.157132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:45.157132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 274/548] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:59:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:45.161821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e2eb3-eaaa-4dd2-826d-e6329c76d186 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:45.203399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:45.295357 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e2eb3-eaaa-4dd2-826d-e6329c76d186 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:45.337049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed34c89-2f37-4c90-9ab5-0b6ad2ef9864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:45.337659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed34c89-2f37-4c90-9ab5-0b6ad2ef9864 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:45.337931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed34c89-2f37-4c90-9ab5-0b6ad2ef9864 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:45.338195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed34c89-2f37-4c90-9ab5-0b6ad2ef9864 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:45.338919 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed34c89-2f37-4c90-9ab5-0b6ad2ef9864 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:45.339217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed34c89-2f37-4c90-9ab5-0b6ad2ef9864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:45.340726 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed34c89-2f37-4c90-9ab5-0b6ad2ef9864 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:45.364203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 275/549] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Sep 6 00:59:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:45.369566 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fa062-f55f-487d-a362-1294a4eddf40 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:45.483114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545a8e4-a665-47a5-a95b-e78ccf4093bd None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:45.483307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545a8e4-a665-47a5-a95b-e78ccf4093bd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:45.483577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545a8e4-a665-47a5-a95b-e78ccf4093bd None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:45.484529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fa062-f55f-487d-a362-1294a4eddf40 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:45.485303 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 276/550] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:45.496975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352800c-d52e-4e69-a809-9f7e08e4b6ab None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:45.497787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352800c-d52e-4e69-a809-9f7e08e4b6ab None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:45.498207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352800c-d52e-4e69-a809-9f7e08e4b6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:45.514435 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:45.531987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4352800c-d52e-4e69-a809-9f7e08e4b6ab None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:45.536536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4352800c-d52e-4e69-a809-9f7e08e4b6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:45.546011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc8e04-f8d4-4df9-8d55-5129fc5104ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:45.549025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc8e04-f8d4-4df9-8d55-5129fc5104ad None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:45.549454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc8e04-f8d4-4df9-8d55-5129fc5104ad None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:45.549870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc8e04-f8d4-4df9-8d55-5129fc5104ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:45.669633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 277/551] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:45.685419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc8e04-f8d4-4df9-8d55-5129fc5104ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:45.687744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc8e04-f8d4-4df9-8d55-5129fc5104ad None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:45.787846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7073d4-d055-4ca4-8a27-51b339ab5d74 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:45.788469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7073d4-d055-4ca4-8a27-51b339ab5d74 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:45.788965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7073d4-d055-4ca4-8a27-51b339ab5d74 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:45.791073 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 278/552] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:45.797810 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b3f16-af4f-4842-948d-19bd044fddac None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:45.798089 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b3f16-af4f-4842-948d-19bd044fddac None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:45.798361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b3f16-af4f-4842-948d-19bd044fddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:45.834395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-700b3f16-af4f-4842-948d-19bd044fddac None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:45.835596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-700b3f16-af4f-4842-948d-19bd044fddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:45.864531 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:45.881810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 275/553] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:45.883268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389754d-0c6e-4071-9d6b-c5d82653214e None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:45.883551 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389754d-0c6e-4071-9d6b-c5d82653214e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:45.883820 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389754d-0c6e-4071-9d6b-c5d82653214e None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:45.885415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 276/554] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:45.886112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389754d-0c6e-4071-9d6b-c5d82653214e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:45.917301 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:45.957016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 279/555] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:45.958415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e181a2-20a8-43ca-bec0-816aac0982d4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:45.958744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e181a2-20a8-43ca-bec0-816aac0982d4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:45.959068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e181a2-20a8-43ca-bec0-816aac0982d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:45.987307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-94e181a2-20a8-43ca-bec0-816aac0982d4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:45.988715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-94e181a2-20a8-43ca-bec0-816aac0982d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:46.027789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389754d-0c6e-4071-9d6b-c5d82653214e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:46.059871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 280/556] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:46.060896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e181a2-20a8-43ca-bec0-816aac0982d4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:46.069298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69060c49-617b-4199-9310-944e0ba2030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:46.070298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69060c49-617b-4199-9310-944e0ba2030b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:46.070762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69060c49-617b-4199-9310-944e0ba2030b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:46.071216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69060c49-617b-4199-9310-944e0ba2030b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:46.083320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69060c49-617b-4199-9310-944e0ba2030b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:46.085250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69060c49-617b-4199-9310-944e0ba2030b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-69060c49-617b-4199-9310-944e0ba2030b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:46.101823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:46.103070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:46.104003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:46.104003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:46.104003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:46.106130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 277/557] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:46.111553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69060c49-617b-4199-9310-944e0ba2030b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:46.194716 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:46.207860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:46.233117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69060c49-617b-4199-9310-944e0ba2030b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:46.263830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e181a2-20a8-43ca-bec0-816aac0982d4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:46.274295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98919d-c120-4f1e-89d6-aaf3274dfaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:46.275590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98919d-c120-4f1e-89d6-aaf3274dfaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:46.276251 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98919d-c120-4f1e-89d6-aaf3274dfaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:46.276825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98919d-c120-4f1e-89d6-aaf3274dfaf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:46.277661 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98919d-c120-4f1e-89d6-aaf3274dfaf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:46.278347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98919d-c120-4f1e-89d6-aaf3274dfaf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:46.280731 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98919d-c120-4f1e-89d6-aaf3274dfaf4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:46.293263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 278/558] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:46.299036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd8a80-f6b7-46e4-a0c1-491869f20346 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:46.299281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd8a80-f6b7-46e4-a0c1-491869f20346 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:46.299532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd8a80-f6b7-46e4-a0c1-491869f20346 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:46.300916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 279/559] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:46.301022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f744a55-114a-46a1-84f5-b1268b00fa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:46.301478 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd8a80-f6b7-46e4-a0c1-491869f20346 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:46.301589 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f744a55-114a-46a1-84f5-b1268b00fa3b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:46.301912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f744a55-114a-46a1-84f5-b1268b00fa3b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:46.302112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f744a55-114a-46a1-84f5-b1268b00fa3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:46.314226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f744a55-114a-46a1-84f5-b1268b00fa3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7f744a55-114a-46a1-84f5-b1268b00fa3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:46.319031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:46.320026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 281/560] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:46.321211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f744a55-114a-46a1-84f5-b1268b00fa3b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:46.416193 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd8a80-f6b7-46e4-a0c1-491869f20346 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:46.428821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f744a55-114a-46a1-84f5-b1268b00fa3b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:46.445443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:46.450650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c798e4-01a0-4c69-9842-51bd6c9dfabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:46.451284 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c798e4-01a0-4c69-9842-51bd6c9dfabd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:46.452132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c798e4-01a0-4c69-9842-51bd6c9dfabd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:46.452427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c798e4-01a0-4c69-9842-51bd6c9dfabd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:46.462291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d353f2f-11b5-4607-96a8-ba8a53be56e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:46.462702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c798e4-01a0-4c69-9842-51bd6c9dfabd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:46.462915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d353f2f-11b5-4607-96a8-ba8a53be56e2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:46.463189 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d353f2f-11b5-4607-96a8-ba8a53be56e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:46.463454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d353f2f-11b5-4607-96a8-ba8a53be56e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-93c798e4-01a0-4c69-9842-51bd6c9dfabd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:46.468159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:46.469117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:46.470197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 280/561] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:46.471287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84a0ff-d067-488f-ac1c-f3362dabcead None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:46.471287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84a0ff-d067-488f-ac1c-f3362dabcead None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:46.471287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84a0ff-d067-488f-ac1c-f3362dabcead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:46.472276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d353f2f-11b5-4607-96a8-ba8a53be56e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:46.473798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d353f2f-11b5-4607-96a8-ba8a53be56e2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:46.476399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7d353f2f-11b5-4607-96a8-ba8a53be56e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:46.485961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:46.486843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:46.487728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:46.487728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:46.487728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:46.487728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:46.487728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:46.487728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:46.487728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:46.487728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:46.488823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-fd84a0ff-d067-488f-ac1c-f3362dabcead None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:46.490030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fd84a0ff-d067-488f-ac1c-f3362dabcead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:46.492068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 282/562] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:46.493976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d353f2f-11b5-4607-96a8-ba8a53be56e2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:46.557266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 281/563] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:46.558023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84a0ff-d067-488f-ac1c-f3362dabcead None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:46.599113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d353f2f-11b5-4607-96a8-ba8a53be56e2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:46.636936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb20511-9ef7-412b-a2bf-85621fa691ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:46.637263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb20511-9ef7-412b-a2bf-85621fa691ee None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:46.637532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb20511-9ef7-412b-a2bf-85621fa691ee None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:46.637800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb20511-9ef7-412b-a2bf-85621fa691ee None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:46.638465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb20511-9ef7-412b-a2bf-85621fa691ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:46.638792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb20511-9ef7-412b-a2bf-85621fa691ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:46.641217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb20511-9ef7-412b-a2bf-85621fa691ee None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:46.653865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 283/564] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:46.654609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb20511-9ef7-412b-a2bf-85621fa691ee None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:46.672693 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84a0ff-d067-488f-ac1c-f3362dabcead None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:46.695405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:46.708905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd53cc-97ad-4cbd-9dcf-aa5c75ae72c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:46.709537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd53cc-97ad-4cbd-9dcf-aa5c75ae72c6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:46.709811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd53cc-97ad-4cbd-9dcf-aa5c75ae72c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:46.710078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd53cc-97ad-4cbd-9dcf-aa5c75ae72c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:46.719776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:46.721459 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd53cc-97ad-4cbd-9dcf-aa5c75ae72c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-d3bd53cc-97ad-4cbd-9dcf-aa5c75ae72c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:46.726042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:46.727212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:46.728244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:46.728244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:46.728244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:46.728244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:46.728244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:46.728244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:46.728244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:46.728244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:46.728244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:46.728244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:46.728244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:46.728244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:46.732205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 282/565] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:46.733161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd53cc-97ad-4cbd-9dcf-aa5c75ae72c6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:46.764828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb20511-9ef7-412b-a2bf-85621fa691ee None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:46.801673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6be80b-d9ce-4a8c-9f0e-1bd5ad2bba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:46.802304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6be80b-d9ce-4a8c-9f0e-1bd5ad2bba2c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:46.802553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6be80b-d9ce-4a8c-9f0e-1bd5ad2bba2c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:46.802819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6be80b-d9ce-4a8c-9f0e-1bd5ad2bba2c None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:46.803497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6be80b-d9ce-4a8c-9f0e-1bd5ad2bba2c None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:46.803782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6be80b-d9ce-4a8c-9f0e-1bd5ad2bba2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:46.805227 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6be80b-d9ce-4a8c-9f0e-1bd5ad2bba2c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:46.814249 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 284/566] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:46.814982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6be80b-d9ce-4a8c-9f0e-1bd5ad2bba2c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:46.843763 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd53cc-97ad-4cbd-9dcf-aa5c75ae72c6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:46.878169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe64ca-7219-4f2f-a752-4378b15e09d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:46.878778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe64ca-7219-4f2f-a752-4378b15e09d3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:46.879052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe64ca-7219-4f2f-a752-4378b15e09d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:46.879321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe64ca-7219-4f2f-a752-4378b15e09d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:46.880032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe64ca-7219-4f2f-a752-4378b15e09d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:46.880360 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe64ca-7219-4f2f-a752-4378b15e09d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:46.881868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe64ca-7219-4f2f-a752-4378b15e09d3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:46.894399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 283/567] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:46.895180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe64ca-7219-4f2f-a752-4378b15e09d3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:46.915435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6be80b-d9ce-4a8c-9f0e-1bd5ad2bba2c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:46.937875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:46.939009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:46.950309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c637786-d640-4cab-9087-d6e1dcd305ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:46.950942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c637786-d640-4cab-9087-d6e1dcd305ae None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:46.951305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c637786-d640-4cab-9087-d6e1dcd305ae None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:46.951696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c637786-d640-4cab-9087-d6e1dcd305ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:46.962433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c637786-d640-4cab-9087-d6e1dcd305ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:46.963934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c637786-d640-4cab-9087-d6e1dcd305ae None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5c637786-d640-4cab-9087-d6e1dcd305ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:46.978332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:46.979354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:46.980273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:46.980273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:46.980273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:46.980273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 285/568] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:46.980273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c637786-d640-4cab-9087-d6e1dcd305ae None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:46.997591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe64ca-7219-4f2f-a752-4378b15e09d3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:47.033882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7586b0-0e9f-40a7-9590-ac373a3c532d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:47.034500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7586b0-0e9f-40a7-9590-ac373a3c532d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:47.034774 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7586b0-0e9f-40a7-9590-ac373a3c532d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:47.035045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7586b0-0e9f-40a7-9590-ac373a3c532d None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:47.035706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7586b0-0e9f-40a7-9590-ac373a3c532d None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:47.036010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7586b0-0e9f-40a7-9590-ac373a3c532d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:47.037812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7586b0-0e9f-40a7-9590-ac373a3c532d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:47.047189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 284/569] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:47.048119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7586b0-0e9f-40a7-9590-ac373a3c532d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:47.093830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c637786-d640-4cab-9087-d6e1dcd305ae None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:47.128091 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718ec4d-751e-4ff1-b624-b8dfddc12b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:47.128741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ec4d-751e-4ff1-b624-b8dfddc12b9b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:47.129024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ec4d-751e-4ff1-b624-b8dfddc12b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:47.129285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ec4d-751e-4ff1-b624-b8dfddc12b9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:47.140432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718ec4d-751e-4ff1-b624-b8dfddc12b9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:47.141952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718ec4d-751e-4ff1-b624-b8dfddc12b9b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:47.153430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7586b0-0e9f-40a7-9590-ac373a3c532d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8718ec4d-751e-4ff1-b624-b8dfddc12b9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:47.155858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:47.156918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:47.157940 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:47.157940 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:47.157940 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:47.158132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:47.158214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 286/570] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:47.158214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718ec4d-751e-4ff1-b624-b8dfddc12b9b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:47.194631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:47.202289 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9968-f36b-4fe0-9754-fbd426bf3f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:47.202918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9968-f36b-4fe0-9754-fbd426bf3f4a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:47.203191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9968-f36b-4fe0-9754-fbd426bf3f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:47.203459 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9968-f36b-4fe0-9754-fbd426bf3f4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:47.215135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a9968-f36b-4fe0-9754-fbd426bf3f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1e1a9968-f36b-4fe0-9754-fbd426bf3f4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:47.219941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:47.220923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 285/571] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:47.221814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9968-f36b-4fe0-9754-fbd426bf3f4a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:47.270323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718ec4d-751e-4ff1-b624-b8dfddc12b9b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:47.304274 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be106a2-ef9d-4e87-9af0-3ce76363d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:47.304881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be106a2-ef9d-4e87-9af0-3ce76363d738 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:47.305146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be106a2-ef9d-4e87-9af0-3ce76363d738 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:47.305416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be106a2-ef9d-4e87-9af0-3ce76363d738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:47.306135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be106a2-ef9d-4e87-9af0-3ce76363d738 None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=d7e2ea2ab4ae4a14be9bd35af20080c6) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:47.306439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be106a2-ef9d-4e87-9af0-3ce76363d738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:47.307912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be106a2-ef9d-4e87-9af0-3ce76363d738 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:47.313469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 287/572] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:47 2022] GET /identity/v3/role_assignments?user.id=d7e2ea2ab4ae4a14be9bd35af20080c6&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:47.314231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be106a2-ef9d-4e87-9af0-3ce76363d738 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:47.324519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9968-f36b-4fe0-9754-fbd426bf3f4a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:47.372170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f168d-bcac-49b2-afcd-652162c35633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:47.373060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f168d-bcac-49b2-afcd-652162c35633 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:47.373060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f168d-bcac-49b2-afcd-652162c35633 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:47.373357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f168d-bcac-49b2-afcd-652162c35633 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:47.374022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f168d-bcac-49b2-afcd-652162c35633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:47.374560 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f168d-bcac-49b2-afcd-652162c35633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:47.376029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f168d-bcac-49b2-afcd-652162c35633 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:47.398305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 286/573] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:47.398305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f168d-bcac-49b2-afcd-652162c35633 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:47.430224 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:47.430790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:47.445116 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be106a2-ef9d-4e87-9af0-3ce76363d738 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:47.490957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f677e-1906-4fa6-b532-643bc36e5dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:47.491896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f677e-1906-4fa6-b532-643bc36e5dcf None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:47.492173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f677e-1906-4fa6-b532-643bc36e5dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:47.492663 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f677e-1906-4fa6-b532-643bc36e5dcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:47.503244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f677e-1906-4fa6-b532-643bc36e5dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:47.504832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f677e-1906-4fa6-b532-643bc36e5dcf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:47.514614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f168d-bcac-49b2-afcd-652162c35633 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ec6f677e-1906-4fa6-b532-643bc36e5dcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:47.519586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:47.520581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:47.521512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:47.521512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:47.521512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:47.521512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 288/574] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:47.521512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f677e-1906-4fa6-b532-643bc36e5dcf None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:47.557464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3f52a-8b58-4627-adc0-a24756337a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:47.558077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3f52a-8b58-4627-adc0-a24756337a3d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:47.558344 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3f52a-8b58-4627-adc0-a24756337a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:47.558766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3f52a-8b58-4627-adc0-a24756337a3d None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:47.560177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3f52a-8b58-4627-adc0-a24756337a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:47.560525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3f52a-8b58-4627-adc0-a24756337a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:47.562185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3f52a-8b58-4627-adc0-a24756337a3d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:47.574321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 287/575] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:47.575145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3f52a-8b58-4627-adc0-a24756337a3d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:47.635046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f677e-1906-4fa6-b532-643bc36e5dcf None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:47.664481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:47.672457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdc119-bc7a-4d06-8739-e72c4b5c5e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:47.673087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdc119-bc7a-4d06-8739-e72c4b5c5e33 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:47.673364 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdc119-bc7a-4d06-8739-e72c4b5c5e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:47.673640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdc119-bc7a-4d06-8739-e72c4b5c5e33 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:47.674302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdc119-bc7a-4d06-8739-e72c4b5c5e33 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:47.674603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdc119-bc7a-4d06-8739-e72c4b5c5e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:47.676025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdc119-bc7a-4d06-8739-e72c4b5c5e33 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:47.681372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3f52a-8b58-4627-adc0-a24756337a3d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:47.688927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 289/576] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:47.688927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdc119-bc7a-4d06-8739-e72c4b5c5e33 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:47.698864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:47.717419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28c9e2-8ec6-41da-b109-a17ced186184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:47.718153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28c9e2-8ec6-41da-b109-a17ced186184 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:47.718426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28c9e2-8ec6-41da-b109-a17ced186184 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:47.718798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28c9e2-8ec6-41da-b109-a17ced186184 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:47.726047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28c9e2-8ec6-41da-b109-a17ced186184 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:47.728205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28c9e2-8ec6-41da-b109-a17ced186184 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-2a28c9e2-8ec6-41da-b109-a17ced186184 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:47.740277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:47.741518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:47.742519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:47.742519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:47.742519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:47.742519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:47.742519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:47.742519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:47.742519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:47.742519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:47.742519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 00:59:47.742519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:47.742519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 288/577] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:47.743139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28c9e2-8ec6-41da-b109-a17ced186184 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:47.812552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdc119-bc7a-4d06-8739-e72c4b5c5e33 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:47.849497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b19f11-22c2-413e-852a-a797e2d6e99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:47.850388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b19f11-22c2-413e-852a-a797e2d6e99d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:47.850828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28c9e2-8ec6-41da-b109-a17ced186184 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:47.850963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b19f11-22c2-413e-852a-a797e2d6e99d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:47.851352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b19f11-22c2-413e-852a-a797e2d6e99d None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:47.852228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b19f11-22c2-413e-852a-a797e2d6e99d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:47.852561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b19f11-22c2-413e-852a-a797e2d6e99d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:47.854084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b19f11-22c2-413e-852a-a797e2d6e99d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:47.866953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 290/578] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:47.872077 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b19f11-22c2-413e-852a-a797e2d6e99d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:47.884919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97349b12-23ad-4e77-af7e-e618b627e7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:47.885600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97349b12-23ad-4e77-af7e-e618b627e7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:47.885848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97349b12-23ad-4e77-af7e-e618b627e7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:47.886109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97349b12-23ad-4e77-af7e-e618b627e7c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:47.895044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97349b12-23ad-4e77-af7e-e618b627e7c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:47.896746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97349b12-23ad-4e77-af7e-e618b627e7c5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-97349b12-23ad-4e77-af7e-e618b627e7c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:47.907936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:47.909168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:47.910308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:47.910308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:47.910308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:47.910308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:47.910308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:47.910308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:47.910308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:47.910308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:47.910308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 00:59:47.910308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:47.913907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 289/579] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 6 00:59:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:47.914764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97349b12-23ad-4e77-af7e-e618b627e7c5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:47.918342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:47.947673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:47.984781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b19f11-22c2-413e-852a-a797e2d6e99d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:48.019905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97349b12-23ad-4e77-af7e-e618b627e7c5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:48.024795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26c88f-b503-4cdf-a4f2-c38b3c41fa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:48.025549 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26c88f-b503-4cdf-a4f2-c38b3c41fa9f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:48.025947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26c88f-b503-4cdf-a4f2-c38b3c41fa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:48.026318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26c88f-b503-4cdf-a4f2-c38b3c41fa9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:48.038172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26c88f-b503-4cdf-a4f2-c38b3c41fa9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:48.039871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26c88f-b503-4cdf-a4f2-c38b3c41fa9f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:48.055857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eaa0b-dfa0-4204-9722-615e34889a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:48.056571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eaa0b-dfa0-4204-9722-615e34889a18 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:48.056910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eaa0b-dfa0-4204-9722-615e34889a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:48.057240 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eaa0b-dfa0-4204-9722-615e34889a18 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7b26c88f-b503-4cdf-a4f2-c38b3c41fa9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:48.057392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:48.058478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:48.059676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:48.059676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:48.059676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:48.059898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296eaa0b-dfa0-4204-9722-615e34889a18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:48.059898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296eaa0b-dfa0-4204-9722-615e34889a18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:48.060351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 291/580] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:48.061222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26c88f-b503-4cdf-a4f2-c38b3c41fa9f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:48.066359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296eaa0b-dfa0-4204-9722-615e34889a18 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:48.092461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 290/581] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Sep 6 00:59:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:48.092461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eaa0b-dfa0-4204-9722-615e34889a18 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:48.158106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:48.166714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26c88f-b503-4cdf-a4f2-c38b3c41fa9f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:48.184912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:48.202087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9704e3-c330-4b9d-a67d-b171005bab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:48.202811 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9704e3-c330-4b9d-a67d-b171005bab54 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:48.203185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9704e3-c330-4b9d-a67d-b171005bab54 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:48.203647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9704e3-c330-4b9d-a67d-b171005bab54 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:48.205996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eaa0b-dfa0-4204-9722-615e34889a18 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:48.211294 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9704e3-c330-4b9d-a67d-b171005bab54 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:48.212928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9704e3-c330-4b9d-a67d-b171005bab54 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-fe9704e3-c330-4b9d-a67d-b171005bab54 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:48.224691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:48.225642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:48.226594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:48.226594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:48.226594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:48.226594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:48.226594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:48.226594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:48.226594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:48.226594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:48.226594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 00:59:48.226594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:48.226594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 292/582] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:48.227178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9704e3-c330-4b9d-a67d-b171005bab54 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:48.245738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43d123-835a-4aca-ae62-5f16a2166ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:48.246354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43d123-835a-4aca-ae62-5f16a2166ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:48.246630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43d123-835a-4aca-ae62-5f16a2166ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:48.246898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43d123-835a-4aca-ae62-5f16a2166ad5 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:48.247623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43d123-835a-4aca-ae62-5f16a2166ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:48.247931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43d123-835a-4aca-ae62-5f16a2166ad5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:48.249490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43d123-835a-4aca-ae62-5f16a2166ad5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:48.267182 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 291/583] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 6 00:59:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:48.268017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43d123-835a-4aca-ae62-5f16a2166ad5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:48.344149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9704e3-c330-4b9d-a67d-b171005bab54 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:48.379409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5d527-d1a6-4c19-8263-7c494b5ec443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:48.380022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5d527-d1a6-4c19-8263-7c494b5ec443 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:48.380314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5d527-d1a6-4c19-8263-7c494b5ec443 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:48.380594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5d527-d1a6-4c19-8263-7c494b5ec443 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:48.381240 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5d527-d1a6-4c19-8263-7c494b5ec443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:48.381538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5d527-d1a6-4c19-8263-7c494b5ec443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:48.381647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43d123-835a-4aca-ae62-5f16a2166ad5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:48.382968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5d527-d1a6-4c19-8263-7c494b5ec443 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:48.395637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 293/584] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:48.396647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5d527-d1a6-4c19-8263-7c494b5ec443 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:48.411452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:48.429458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f6b9d-0881-44d9-8e49-81c96e8b9f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:48.430097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f6b9d-0881-44d9-8e49-81c96e8b9f33 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:48.430370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f6b9d-0881-44d9-8e49-81c96e8b9f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:48.430643 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f6b9d-0881-44d9-8e49-81c96e8b9f33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:48.441854 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f6b9d-0881-44d9-8e49-81c96e8b9f33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:48.443341 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f6b9d-0881-44d9-8e49-81c96e8b9f33 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:48.456456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f38f6b9d-0881-44d9-8e49-81c96e8b9f33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:48.458682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:48.459629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:48.460562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:48.460562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:48.460562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:48.460562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 292/585] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:48.461193 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f6b9d-0881-44d9-8e49-81c96e8b9f33 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:48.523826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5d527-d1a6-4c19-8263-7c494b5ec443 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:48.562837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e656106-ac95-47d1-a4e5-32a67056c615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:48.563657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e656106-ac95-47d1-a4e5-32a67056c615 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:48.563919 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e656106-ac95-47d1-a4e5-32a67056c615 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:48.564247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e656106-ac95-47d1-a4e5-32a67056c615 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:48.565060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e656106-ac95-47d1-a4e5-32a67056c615 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:48.565469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e656106-ac95-47d1-a4e5-32a67056c615 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:48.566714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f6b9d-0881-44d9-8e49-81c96e8b9f33 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:48.567072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e656106-ac95-47d1-a4e5-32a67056c615 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:48.590056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 294/586] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Sep 6 00:59:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:48.591393 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e656106-ac95-47d1-a4e5-32a67056c615 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:48.600374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bd422-9759-4321-b05f-24a79a3df42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:48.601006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bd422-9759-4321-b05f-24a79a3df42e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:48.601278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bd422-9759-4321-b05f-24a79a3df42e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:48.601545 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bd422-9759-4321-b05f-24a79a3df42e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:48.612829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bd422-9759-4321-b05f-24a79a3df42e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:48.614244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bd422-9759-4321-b05f-24a79a3df42e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-2c2bd422-9759-4321-b05f-24a79a3df42e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:48.628670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:48.629639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:48.630553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:48.630553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:48.630553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:48.630553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 293/587] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:48.631704 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bd422-9759-4321-b05f-24a79a3df42e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:48.658767 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:48.698124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:48.705231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e656106-ac95-47d1-a4e5-32a67056c615 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:48.741095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bd422-9759-4321-b05f-24a79a3df42e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:48.742580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84275a73-0efc-4148-9fa0-d261d6af74bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:48.743225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84275a73-0efc-4148-9fa0-d261d6af74bc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:48.743493 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84275a73-0efc-4148-9fa0-d261d6af74bc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:48.743757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84275a73-0efc-4148-9fa0-d261d6af74bc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:48.751500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84275a73-0efc-4148-9fa0-d261d6af74bc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:48.753048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84275a73-0efc-4148-9fa0-d261d6af74bc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-84275a73-0efc-4148-9fa0-d261d6af74bc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:48.765295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:48.766486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:48.767432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:48.767432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:48.767432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:48.767432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:48.767432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:48.767432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:48.767432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:48.767432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:48.767432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 00:59:48.767432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:48.767432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 295/588] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:48.768124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84275a73-0efc-4148-9fa0-d261d6af74bc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:48.784303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde110a-49dd-4bf3-b120-4f381a9d15ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:48.784925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde110a-49dd-4bf3-b120-4f381a9d15ac None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:48.785203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde110a-49dd-4bf3-b120-4f381a9d15ac None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:48.785482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde110a-49dd-4bf3-b120-4f381a9d15ac None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:48.786476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde110a-49dd-4bf3-b120-4f381a9d15ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:48.786780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde110a-49dd-4bf3-b120-4f381a9d15ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:48.788195 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde110a-49dd-4bf3-b120-4f381a9d15ac None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:48.805024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 294/589] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:48.805024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde110a-49dd-4bf3-b120-4f381a9d15ac None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:48.874767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84275a73-0efc-4148-9fa0-d261d6af74bc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:48.887451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:48.905187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde110a-49dd-4bf3-b120-4f381a9d15ac None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:48.914552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988b7f-d15a-4fc0-b4d4-2772f502c89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:48.915819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988b7f-d15a-4fc0-b4d4-2772f502c89a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:48.916280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988b7f-d15a-4fc0-b4d4-2772f502c89a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:48.917069 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988b7f-d15a-4fc0-b4d4-2772f502c89a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:48.929020 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0988b7f-d15a-4fc0-b4d4-2772f502c89a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:48.930541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0988b7f-d15a-4fc0-b4d4-2772f502c89a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:48.942294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaca64c-281c-4a6f-bdd3-eb27728d0797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:48.942905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaca64c-281c-4a6f-bdd3-eb27728d0797 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:48.943186 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaca64c-281c-4a6f-bdd3-eb27728d0797 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:48.943458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaca64c-281c-4a6f-bdd3-eb27728d0797 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:48.944092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaca64c-281c-4a6f-bdd3-eb27728d0797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:48.944419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaca64c-281c-4a6f-bdd3-eb27728d0797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f0988b7f-d15a-4fc0-b4d4-2772f502c89a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:48.945055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:48.945953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:48.953333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:48.953333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:48.953333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:48.953557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaca64c-281c-4a6f-bdd3-eb27728d0797 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:48.953645 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 296/590] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:48.953645 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988b7f-d15a-4fc0-b4d4-2772f502c89a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:48.960823 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:48.963692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 295/591] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:48.964577 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaca64c-281c-4a6f-bdd3-eb27728d0797 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:49.071107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988b7f-d15a-4fc0-b4d4-2772f502c89a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:49.082793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaca64c-281c-4a6f-bdd3-eb27728d0797 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:49.105967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d165930-7f51-4f3e-a1e7-2992fbd7733c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:49.106797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165930-7f51-4f3e-a1e7-2992fbd7733c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.106942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165930-7f51-4f3e-a1e7-2992fbd7733c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.107118 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165930-7f51-4f3e-a1e7-2992fbd7733c None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.108142 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d165930-7f51-4f3e-a1e7-2992fbd7733c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:49.108529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d165930-7f51-4f3e-a1e7-2992fbd7733c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:49.109936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d165930-7f51-4f3e-a1e7-2992fbd7733c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:49.118560 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4545b-b14e-48b9-b307-107cf372f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:49.119206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4545b-b14e-48b9-b307-107cf372f627 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.119475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4545b-b14e-48b9-b307-107cf372f627 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.119740 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4545b-b14e-48b9-b307-107cf372f627 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.126793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4545b-b14e-48b9-b307-107cf372f627 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:49.132125 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 297/592] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Sep 6 00:59:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:49.132266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4545b-b14e-48b9-b307-107cf372f627 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:49.132371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d165930-7f51-4f3e-a1e7-2992fbd7733c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-09b4545b-b14e-48b9-b307-107cf372f627 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:49.145681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:49.146638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:49.147569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:49.147569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:49.147569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:49.147569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:49.147569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:49.147569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:49.147569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:49.147569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:49.147569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 296/593] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:49.148072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4545b-b14e-48b9-b307-107cf372f627 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:49.153066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:49.205259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:49.243508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d165930-7f51-4f3e-a1e7-2992fbd7733c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:49.258507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4545b-b14e-48b9-b307-107cf372f627 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:49.278391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902ab1-50c0-4386-8843-bbff4dc888e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:49.278993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902ab1-50c0-4386-8843-bbff4dc888e3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.279299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902ab1-50c0-4386-8843-bbff4dc888e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.279574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902ab1-50c0-4386-8843-bbff4dc888e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.280487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68902ab1-50c0-4386-8843-bbff4dc888e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:49.280790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68902ab1-50c0-4386-8843-bbff4dc888e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:49.282215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68902ab1-50c0-4386-8843-bbff4dc888e3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:49.293568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23fc86-86b9-4b3d-a507-cd068d1067c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:49.293715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 298/594] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:49.294198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23fc86-86b9-4b3d-a507-cd068d1067c2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.294472 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23fc86-86b9-4b3d-a507-cd068d1067c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.294587 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902ab1-50c0-4386-8843-bbff4dc888e3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:49.294758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23fc86-86b9-4b3d-a507-cd068d1067c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.304033 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23fc86-86b9-4b3d-a507-cd068d1067c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:49.305539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23fc86-86b9-4b3d-a507-cd068d1067c2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-cb23fc86-86b9-4b3d-a507-cd068d1067c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:49.316739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:49.317631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:49.318529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:49.318529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:49.318529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:49.318529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:49.318529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:49.318529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:49.318529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:49.318529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:49.318529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 297/595] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:49.318529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23fc86-86b9-4b3d-a507-cd068d1067c2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:49.384084 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:49.404429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902ab1-50c0-4386-8843-bbff4dc888e3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:49.431182 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23fc86-86b9-4b3d-a507-cd068d1067c2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:49.436127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:49.445458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ef6d7-c3b1-49f7-abd2-a0e462e74249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:49.446096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ef6d7-c3b1-49f7-abd2-a0e462e74249 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.446371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ef6d7-c3b1-49f7-abd2-a0e462e74249 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.446639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ef6d7-c3b1-49f7-abd2-a0e462e74249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.458426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ef6d7-c3b1-49f7-abd2-a0e462e74249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:49.459871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ef6d7-c3b1-49f7-abd2-a0e462e74249 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:49.464913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fa1d2-5027-460e-859d-5c09fd4867e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:49.465514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fa1d2-5027-460e-859d-5c09fd4867e6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.465786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fa1d2-5027-460e-859d-5c09fd4867e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.466079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fa1d2-5027-460e-859d-5c09fd4867e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.466844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fa1d2-5027-460e-859d-5c09fd4867e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:49.467231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fa1d2-5027-460e-859d-5c09fd4867e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:49.468719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fa1d2-5027-460e-859d-5c09fd4867e6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8b4ef6d7-c3b1-49f7-abd2-a0e462e74249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:49.474133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:49.475072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:49.476047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:49.476047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:49.476047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:49.476047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 299/596] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:49.476727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5021b-31de-4a54-ac76-513587fb8c97 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.476727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5021b-31de-4a54-ac76-513587fb8c97 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.476970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5021b-31de-4a54-ac76-513587fb8c97 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.478186 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 300/597] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:49.478867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5021b-31de-4a54-ac76-513587fb8c97 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:49.482485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 298/598] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:49.483322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fa1d2-5027-460e-859d-5c09fd4867e6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:49.581317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5021b-31de-4a54-ac76-513587fb8c97 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:49.582924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fa1d2-5027-460e-859d-5c09fd4867e6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:49.606825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:49.615146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61a1a5-ca6d-4a61-be60-505e5bba39d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:49.615770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61a1a5-ca6d-4a61-be60-505e5bba39d1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.616065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61a1a5-ca6d-4a61-be60-505e5bba39d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.616336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61a1a5-ca6d-4a61-be60-505e5bba39d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.618887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cd622-540c-46f2-814e-b07abe33a3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:49.619499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd622-540c-46f2-814e-b07abe33a3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.619777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd622-540c-46f2-814e-b07abe33a3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.620051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd622-540c-46f2-814e-b07abe33a3d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.620773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cd622-540c-46f2-814e-b07abe33a3d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:49.621085 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cd622-540c-46f2-814e-b07abe33a3d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:49.622563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cd622-540c-46f2-814e-b07abe33a3d3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:49.622778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61a1a5-ca6d-4a61-be60-505e5bba39d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:49.624327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61a1a5-ca6d-4a61-be60-505e5bba39d1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:49.634089 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 299/599] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:49.634876 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cd622-540c-46f2-814e-b07abe33a3d3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2f61a1a5-ca6d-4a61-be60-505e5bba39d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:49.635705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:49.636581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:49.637500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:49.637500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:49.637500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:49.637500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:49.637500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:49.637500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:49.637500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:49.637500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:49.637500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 301/600] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:49.638264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9792b4-2170-4599-91f7-3ef38a8f6ae4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.638479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9792b4-2170-4599-91f7-3ef38a8f6ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.638933 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9792b4-2170-4599-91f7-3ef38a8f6ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.656944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6d9792b4-2170-4599-91f7-3ef38a8f6ae4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:49.658147 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6d9792b4-2170-4599-91f7-3ef38a8f6ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:49.688500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:49.726240 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 302/601] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:49.726958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9792b4-2170-4599-91f7-3ef38a8f6ae4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:49.749391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cd622-540c-46f2-814e-b07abe33a3d3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:49.788482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade5d1-89f1-44b3-88d3-81ecdc1d4acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:49.789097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade5d1-89f1-44b3-88d3-81ecdc1d4acb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.789466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade5d1-89f1-44b3-88d3-81ecdc1d4acb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.789923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade5d1-89f1-44b3-88d3-81ecdc1d4acb None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.790673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ade5d1-89f1-44b3-88d3-81ecdc1d4acb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:49.790986 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ade5d1-89f1-44b3-88d3-81ecdc1d4acb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:49.792436 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ade5d1-89f1-44b3-88d3-81ecdc1d4acb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:49.805547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 300/602] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:49.806345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade5d1-89f1-44b3-88d3-81ecdc1d4acb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:49.835215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9792b4-2170-4599-91f7-3ef38a8f6ae4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:49.859395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:49.871530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d627c-2f8f-4185-8460-13065aaa6fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:49.872203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d627c-2f8f-4185-8460-13065aaa6fbc None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.872514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d627c-2f8f-4185-8460-13065aaa6fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.872785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d627c-2f8f-4185-8460-13065aaa6fbc None admin] PATH_INFO: `/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/31ebbadd69da4bc6ad25b5c882962ea4/roles/200ce779351e41d0b4f43970f4008cd0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.887246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d627c-2f8f-4185-8460-13065aaa6fbc None admin] RBAC: Authorizing `identity:create_grant(project_id=d31b0823b61d4895accd0f27e6006b08, user_id=31ebbadd69da4bc6ad25b5c882962ea4, role_id=200ce779351e41d0b4f43970f4008cd0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:49.889050 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d627c-2f8f-4185-8460-13065aaa6fbc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:49.906152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 303/603] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:59:49 2022] PUT /identity/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/31ebbadd69da4bc6ad25b5c882962ea4/roles/200ce779351e41d0b4f43970f4008cd0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:49.907192 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d627c-2f8f-4185-8460-13065aaa6fbc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:49.922754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade5d1-89f1-44b3-88d3-81ecdc1d4acb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:49.951980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:49.973278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd146b25-b478-47a9-aee8-0eb632ff5de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:49.974348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd146b25-b478-47a9-aee8-0eb632ff5de8 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:49.974822 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd146b25-b478-47a9-aee8-0eb632ff5de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:49.975312 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd146b25-b478-47a9-aee8-0eb632ff5de8 None admin] PATH_INFO: `/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/42b9c25e98fe4b1bbc33a601d4150071/roles/200ce779351e41d0b4f43970f4008cd0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:49.999235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd146b25-b478-47a9-aee8-0eb632ff5de8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d31b0823b61d4895accd0f27e6006b08, user_id=42b9c25e98fe4b1bbc33a601d4150071, role_id=200ce779351e41d0b4f43970f4008cd0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:50.001706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd146b25-b478-47a9-aee8-0eb632ff5de8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:50.021302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 301/604] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:59:49 2022] PUT /identity/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/42b9c25e98fe4b1bbc33a601d4150071/roles/200ce779351e41d0b4f43970f4008cd0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:50.025364 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd146b25-b478-47a9-aee8-0eb632ff5de8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:50.066753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d627c-2f8f-4185-8460-13065aaa6fbc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:50.113553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cc178-3076-4596-9cc4-22fa0cb5ccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:50.114097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cc178-3076-4596-9cc4-22fa0cb5ccb9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:50.114377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cc178-3076-4596-9cc4-22fa0cb5ccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:50.114684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cc178-3076-4596-9cc4-22fa0cb5ccb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:50.115454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cc178-3076-4596-9cc4-22fa0cb5ccb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:50.115762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cc178-3076-4596-9cc4-22fa0cb5ccb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:50.120736 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cc178-3076-4596-9cc4-22fa0cb5ccb9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:50.134188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 304/605] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:50.140459 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cc178-3076-4596-9cc4-22fa0cb5ccb9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:50.169438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:50.179211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd146b25-b478-47a9-aee8-0eb632ff5de8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:50.229411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e0336-21e6-4701-b47e-25214b743cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:50.230054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e0336-21e6-4701-b47e-25214b743cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:50.230323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e0336-21e6-4701-b47e-25214b743cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:50.230585 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e0336-21e6-4701-b47e-25214b743cb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:50.238397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e0336-21e6-4701-b47e-25214b743cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:50.239882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e0336-21e6-4701-b47e-25214b743cb6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:50.244145 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-aa2e0336-21e6-4701-b47e-25214b743cb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:50.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:50.252990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:50.253924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:50.253924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:50.253924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:50.253924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:50.253924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:50.253924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:50.253924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:50.253924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:50.253924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 302/606] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:50.254422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e0336-21e6-4701-b47e-25214b743cb6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:50.272107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cc178-3076-4596-9cc4-22fa0cb5ccb9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:50.320691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ce9a2-cd5a-4352-9192-6551d5462136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:50.321336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ce9a2-cd5a-4352-9192-6551d5462136 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:50.321613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ce9a2-cd5a-4352-9192-6551d5462136 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:50.321885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ce9a2-cd5a-4352-9192-6551d5462136 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:50.336261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ce9a2-cd5a-4352-9192-6551d5462136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2d4ce9a2-cd5a-4352-9192-6551d5462136 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:50.343903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:50.345837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 305/607] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:50.347973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ce9a2-cd5a-4352-9192-6551d5462136 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:50.364433 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e0336-21e6-4701-b47e-25214b743cb6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:50.403673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac1d2b-72e9-4e0e-9d6d-6f4a27c0b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:50.404830 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac1d2b-72e9-4e0e-9d6d-6f4a27c0b05e None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:50.405318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac1d2b-72e9-4e0e-9d6d-6f4a27c0b05e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:50.405836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac1d2b-72e9-4e0e-9d6d-6f4a27c0b05e None admin] PATH_INFO: `/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/eae9814386a444678a292becdfe07332/roles/200ce779351e41d0b4f43970f4008cd0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:50.422537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac1d2b-72e9-4e0e-9d6d-6f4a27c0b05e None admin] RBAC: Authorizing `identity:create_grant(project_id=d31b0823b61d4895accd0f27e6006b08, user_id=eae9814386a444678a292becdfe07332, role_id=200ce779351e41d0b4f43970f4008cd0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:50.424390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac1d2b-72e9-4e0e-9d6d-6f4a27c0b05e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:50.448466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 303/608] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:59:50 2022] PUT /identity/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/eae9814386a444678a292becdfe07332/roles/200ce779351e41d0b4f43970f4008cd0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:50.449967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac1d2b-72e9-4e0e-9d6d-6f4a27c0b05e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:50.457852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:50.470232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ce9a2-cd5a-4352-9192-6551d5462136 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:50.512411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ba000-6880-4df9-b38a-fb806bf3fc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:50.512411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ba000-6880-4df9-b38a-fb806bf3fc5d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:50.512411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ba000-6880-4df9-b38a-fb806bf3fc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:50.512411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ba000-6880-4df9-b38a-fb806bf3fc5d None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:50.512848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ba000-6880-4df9-b38a-fb806bf3fc5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:50.512848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ba000-6880-4df9-b38a-fb806bf3fc5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:50.513187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ba000-6880-4df9-b38a-fb806bf3fc5d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:50.521600 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:50.526841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 306/609] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:50.537383 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ba000-6880-4df9-b38a-fb806bf3fc5d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:50.672522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac1d2b-72e9-4e0e-9d6d-6f4a27c0b05e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:50.708251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ba000-6880-4df9-b38a-fb806bf3fc5d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:50.712101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc657d-4c23-4455-ae4e-3b53cfcfd8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:50.712921 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc657d-4c23-4455-ae4e-3b53cfcfd8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:50.713368 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc657d-4c23-4455-ae4e-3b53cfcfd8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:50.713796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc657d-4c23-4455-ae4e-3b53cfcfd8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:50.714608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc657d-4c23-4455-ae4e-3b53cfcfd8e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:50.715062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc657d-4c23-4455-ae4e-3b53cfcfd8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:50.716798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc657d-4c23-4455-ae4e-3b53cfcfd8e0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:50.726475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 304/610] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:50.731731 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc657d-4c23-4455-ae4e-3b53cfcfd8e0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:50.746429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cab57-0dcc-40e9-96cb-f2ac837b8c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:50.746875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cab57-0dcc-40e9-96cb-f2ac837b8c99 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:50.747151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cab57-0dcc-40e9-96cb-f2ac837b8c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:50.747421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cab57-0dcc-40e9-96cb-f2ac837b8c99 None admin] PATH_INFO: `/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/2fc30f3a335f428082e9178227dcb4e5/roles/200ce779351e41d0b4f43970f4008cd0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:50.770076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cab57-0dcc-40e9-96cb-f2ac837b8c99 None admin] RBAC: Authorizing `identity:create_grant(project_id=d31b0823b61d4895accd0f27e6006b08, user_id=2fc30f3a335f428082e9178227dcb4e5, role_id=200ce779351e41d0b4f43970f4008cd0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:50.771506 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cab57-0dcc-40e9-96cb-f2ac837b8c99 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:50.800757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 307/611] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:59:50 2022] PUT /identity/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/2fc30f3a335f428082e9178227dcb4e5/roles/200ce779351e41d0b4f43970f4008cd0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:50.806148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:50.844906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc657d-4c23-4455-ae4e-3b53cfcfd8e0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:50.882880 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f9443-3dfd-417c-b1a4-9a26417080ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:50.883852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f9443-3dfd-417c-b1a4-9a26417080ea None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:50.884325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f9443-3dfd-417c-b1a4-9a26417080ea None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:50.884744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f9443-3dfd-417c-b1a4-9a26417080ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:50.896701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f9443-3dfd-417c-b1a4-9a26417080ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:50.898576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f9443-3dfd-417c-b1a4-9a26417080ea None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-2f3f9443-3dfd-417c-b1a4-9a26417080ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:50.914956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:50.916224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:50.917328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:50.917328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:50.917328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:50.919212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 305/612] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:50.924977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cab57-0dcc-40e9-96cb-f2ac837b8c99 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:51.004510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:51.059870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cab57-0dcc-40e9-96cb-f2ac837b8c99 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:51.097449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794dace-211a-4d43-bac6-8ade9348081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:51.098074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794dace-211a-4d43-bac6-8ade9348081c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:51.098352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794dace-211a-4d43-bac6-8ade9348081c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:51.098636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794dace-211a-4d43-bac6-8ade9348081c None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:51.099290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794dace-211a-4d43-bac6-8ade9348081c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:51.099590 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794dace-211a-4d43-bac6-8ade9348081c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:51.101105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794dace-211a-4d43-bac6-8ade9348081c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:51.116313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 308/613] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:51.121401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f9443-3dfd-417c-b1a4-9a26417080ea None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:51.241522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f9443-3dfd-417c-b1a4-9a26417080ea None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:51.260187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:51.277093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998f4f0-a90e-4536-9eb7-3daca1e6648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:51.277772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998f4f0-a90e-4536-9eb7-3daca1e6648d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:51.278052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998f4f0-a90e-4536-9eb7-3daca1e6648d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:51.278319 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998f4f0-a90e-4536-9eb7-3daca1e6648d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:51.290041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998f4f0-a90e-4536-9eb7-3daca1e6648d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:51.291537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998f4f0-a90e-4536-9eb7-3daca1e6648d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-9998f4f0-a90e-4536-9eb7-3daca1e6648d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:51.307627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:51.308600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:51.310140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:51.310140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:51.310140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:51.310140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:51.310140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:51.310140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:51.310140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:51.310140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:51.310140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 00:59:51.310140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:51.310140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 306/614] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:59:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:51.314720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794dace-211a-4d43-bac6-8ade9348081c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:51.467989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794dace-211a-4d43-bac6-8ade9348081c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:51.480182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:51.517264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795db30-98a0-422c-b8e1-c6a5f13512ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:51.518270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795db30-98a0-422c-b8e1-c6a5f13512ed None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:51.518744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795db30-98a0-422c-b8e1-c6a5f13512ed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:51.519234 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795db30-98a0-422c-b8e1-c6a5f13512ed None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:51.520172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795db30-98a0-422c-b8e1-c6a5f13512ed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:51.520694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795db30-98a0-422c-b8e1-c6a5f13512ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:51.522384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795db30-98a0-422c-b8e1-c6a5f13512ed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:51.546817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 309/615] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Sep 6 00:59:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:51.557456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998f4f0-a90e-4536-9eb7-3daca1e6648d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:51.703910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998f4f0-a90e-4536-9eb7-3daca1e6648d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:51.751353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803a352-47c6-4b8b-8b45-9b377fafae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:51.752003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803a352-47c6-4b8b-8b45-9b377fafae1d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:51.752280 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803a352-47c6-4b8b-8b45-9b377fafae1d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:51.752570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803a352-47c6-4b8b-8b45-9b377fafae1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:51.768138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803a352-47c6-4b8b-8b45-9b377fafae1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:51.769670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803a352-47c6-4b8b-8b45-9b377fafae1d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-4803a352-47c6-4b8b-8b45-9b377fafae1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:51.790412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:51.791426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:51.792798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:51.792798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:51.792798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:51.792798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 307/616] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:51.799823 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795db30-98a0-422c-b8e1-c6a5f13512ed None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:51.948185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795db30-98a0-422c-b8e1-c6a5f13512ed None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:51.990536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed87e23-cd3a-40bc-9d63-5376d4d2cf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:51.991504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed87e23-cd3a-40bc-9d63-5376d4d2cf3e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:51.991998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed87e23-cd3a-40bc-9d63-5376d4d2cf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:51.992486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed87e23-cd3a-40bc-9d63-5376d4d2cf3e None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:51.993405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed87e23-cd3a-40bc-9d63-5376d4d2cf3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:51.993899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed87e23-cd3a-40bc-9d63-5376d4d2cf3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:51.995510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed87e23-cd3a-40bc-9d63-5376d4d2cf3e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:52.010317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 310/617] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:52.016740 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803a352-47c6-4b8b-8b45-9b377fafae1d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:52.064655 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:52.071176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3cb05-b038-47cc-975f-a9ca9340c0a1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:52.071697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3cb05-b038-47cc-975f-a9ca9340c0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:52.072405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3cb05-b038-47cc-975f-a9ca9340c0a1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:52.074126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 311/618] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:52.079535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129cfd5-6c2e-451e-bfdf-e9beb795ea48 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:52.080087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129cfd5-6c2e-451e-bfdf-e9beb795ea48 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:52.080592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129cfd5-6c2e-451e-bfdf-e9beb795ea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:52.100985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5129cfd5-6c2e-451e-bfdf-e9beb795ea48 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:52.103105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5129cfd5-6c2e-451e-bfdf-e9beb795ea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:52.136714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:52.194974 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803a352-47c6-4b8b-8b45-9b377fafae1d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:52.221296 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 312/619] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:52.223269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6378c14-aca2-488c-8736-e197a2310393 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:52.223813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6378c14-aca2-488c-8736-e197a2310393 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:52.224090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6378c14-aca2-488c-8736-e197a2310393 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:52.226333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 313/620] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:52.231867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1e17f-a622-402b-bdde-61f6ecf89d5b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:52.232154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1e17f-a622-402b-bdde-61f6ecf89d5b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:52.232750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1e17f-a622-402b-bdde-61f6ecf89d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:52.233888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee8149-589a-4983-846b-8d1d61ade4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:52.234663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee8149-589a-4983-846b-8d1d61ade4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:52.235221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee8149-589a-4983-846b-8d1d61ade4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:52.235586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee8149-589a-4983-846b-8d1d61ade4d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:52.242882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee8149-589a-4983-846b-8d1d61ade4d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:52.244540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee8149-589a-4983-846b-8d1d61ade4d7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:52.252238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-dea1e17f-a622-402b-bdde-61f6ecf89d5b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:52.253485 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dea1e17f-a622-402b-bdde-61f6ecf89d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-20ee8149-589a-4983-846b-8d1d61ade4d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:52.256550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:52.257778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:52.259814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:52.259814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:52.259814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:52.259814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:52.259814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:52.259814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:52.259814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:52.259814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:52.259814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 308/621] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:52.265072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee8149-589a-4983-846b-8d1d61ade4d7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:52.326570 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 314/622] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:52.358213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:52.368068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee8149-589a-4983-846b-8d1d61ade4d7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:52.402578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9e0fe-c466-4bc9-be2b-e70bc6d0ae0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:52.403190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9e0fe-c466-4bc9-be2b-e70bc6d0ae0a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:52.403463 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9e0fe-c466-4bc9-be2b-e70bc6d0ae0a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:52.403733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9e0fe-c466-4bc9-be2b-e70bc6d0ae0a None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:52.404590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9e0fe-c466-4bc9-be2b-e70bc6d0ae0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:52.404897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9e0fe-c466-4bc9-be2b-e70bc6d0ae0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:52.406375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9e0fe-c466-4bc9-be2b-e70bc6d0ae0a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:52.419604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 309/623] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:52.425707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1e17f-a622-402b-bdde-61f6ecf89d5b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:52.512654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:52.537398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1e17f-a622-402b-bdde-61f6ecf89d5b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:52.585582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb74fd5-c6c4-4452-a2b5-4c55ffe5200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:52.586247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb74fd5-c6c4-4452-a2b5-4c55ffe5200f None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:52.586519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb74fd5-c6c4-4452-a2b5-4c55ffe5200f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:52.586785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb74fd5-c6c4-4452-a2b5-4c55ffe5200f None admin] PATH_INFO: `/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/d7e2ea2ab4ae4a14be9bd35af20080c6/roles/200ce779351e41d0b4f43970f4008cd0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:52.606535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb74fd5-c6c4-4452-a2b5-4c55ffe5200f None admin] RBAC: Authorizing `identity:create_grant(project_id=d31b0823b61d4895accd0f27e6006b08, user_id=d7e2ea2ab4ae4a14be9bd35af20080c6, role_id=200ce779351e41d0b4f43970f4008cd0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:52.608095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb74fd5-c6c4-4452-a2b5-4c55ffe5200f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:52.622302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9e0fe-c466-4bc9-be2b-e70bc6d0ae0a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:52.627775 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 315/624] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 00:59:52 2022] PUT /identity/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/d7e2ea2ab4ae4a14be9bd35af20080c6/roles/200ce779351e41d0b4f43970f4008cd0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 00:59:52.702790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb74fd5-c6c4-4452-a2b5-4c55ffe5200f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:52.761340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9e0fe-c466-4bc9-be2b-e70bc6d0ae0a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:52.796626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941fc0e-54b0-4124-962e-7451fd41ca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:52.797140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941fc0e-54b0-4124-962e-7451fd41ca77 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:52.797419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941fc0e-54b0-4124-962e-7451fd41ca77 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:52.797693 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941fc0e-54b0-4124-962e-7451fd41ca77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:52.820731 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941fc0e-54b0-4124-962e-7451fd41ca77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-9941fc0e-54b0-4124-962e-7451fd41ca77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:52.825299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:52.826422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:52.827278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 310/625] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:52.835082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941fc0e-54b0-4124-962e-7451fd41ca77 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:52.860161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:52.882162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb74fd5-c6c4-4452-a2b5-4c55ffe5200f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:52.931851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84c90-92b1-49af-a9a4-1d670db018a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:52.932542 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84c90-92b1-49af-a9a4-1d670db018a2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:52.932826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84c90-92b1-49af-a9a4-1d670db018a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:52.933100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84c90-92b1-49af-a9a4-1d670db018a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:52.936371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:52.957292 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca84c90-92b1-49af-a9a4-1d670db018a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-aca84c90-92b1-49af-a9a4-1d670db018a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:52.962668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:52.963624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:52.964536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:52.964536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:52.964536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:52.964536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:52.964536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:52.964536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:52.964536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:52.964536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:52.964536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:52.964536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:52.964536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:52.964536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:52.970416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 316/626] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 00:59:52.976268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84c90-92b1-49af-a9a4-1d670db018a2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:53.012442 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941fc0e-54b0-4124-962e-7451fd41ca77 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:53.083000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fab56-3120-4892-838f-a6b1fca23bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:53.083583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fab56-3120-4892-838f-a6b1fca23bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:53.083855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fab56-3120-4892-838f-a6b1fca23bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:53.084121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fab56-3120-4892-838f-a6b1fca23bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:53.084810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fab56-3120-4892-838f-a6b1fca23bb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:53.085112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fab56-3120-4892-838f-a6b1fca23bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:53.086525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fab56-3120-4892-838f-a6b1fca23bb1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:53.106431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 311/627] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:53.113792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fab56-3120-4892-838f-a6b1fca23bb1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:53.175017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84c90-92b1-49af-a9a4-1d670db018a2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:53.225902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:53.236942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecc73e-a791-48a5-aa22-84e5f73daa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:53.237664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecc73e-a791-48a5-aa22-84e5f73daa84 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:53.237935 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecc73e-a791-48a5-aa22-84e5f73daa84 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:53.238204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecc73e-a791-48a5-aa22-84e5f73daa84 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:53.238869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecc73e-a791-48a5-aa22-84e5f73daa84 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:53.239170 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecc73e-a791-48a5-aa22-84e5f73daa84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:53.240860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecc73e-a791-48a5-aa22-84e5f73daa84 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:53.250157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 317/628] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:53.251402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328e658-69b9-41ba-a164-c2f76f63d451 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:53.251682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328e658-69b9-41ba-a164-c2f76f63d451 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:53.251953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328e658-69b9-41ba-a164-c2f76f63d451 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:53.257508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 318/629] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:53.258274 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328e658-69b9-41ba-a164-c2f76f63d451 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:53.266790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fab56-3120-4892-838f-a6b1fca23bb1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:53.305658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a390c-0c27-4dd6-a95e-cc709f8d82a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:53.306421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a390c-0c27-4dd6-a95e-cc709f8d82a0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:53.306706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a390c-0c27-4dd6-a95e-cc709f8d82a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:53.307161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a390c-0c27-4dd6-a95e-cc709f8d82a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:53.319642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a390c-0c27-4dd6-a95e-cc709f8d82a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:53.321282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a390c-0c27-4dd6-a95e-cc709f8d82a0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:53.325067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-df6a390c-0c27-4dd6-a95e-cc709f8d82a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:53.339056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:53.340218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:53.341345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:53.341345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:53.341345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:53.341345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 312/630] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:53.341803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d15d7-8398-4002-93d0-43bb1f0ad85f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:53.342783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d15d7-8398-4002-93d0-43bb1f0ad85f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:53.343065 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d15d7-8398-4002-93d0-43bb1f0ad85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:53.368336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-928d15d7-8398-4002-93d0-43bb1f0ad85f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:53.368336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-928d15d7-8398-4002-93d0-43bb1f0ad85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:53.382178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328e658-69b9-41ba-a164-c2f76f63d451 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:53.422386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418c53a-c888-4b90-a362-f21b0656935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:53.423378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418c53a-c888-4b90-a362-f21b0656935e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:53.423655 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418c53a-c888-4b90-a362-f21b0656935e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:53.424054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418c53a-c888-4b90-a362-f21b0656935e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:53.439100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418c53a-c888-4b90-a362-f21b0656935e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:53.441135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418c53a-c888-4b90-a362-f21b0656935e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:53.444442 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 313/631] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:53.445654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d15d7-8398-4002-93d0-43bb1f0ad85f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7418c53a-c888-4b90-a362-f21b0656935e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:53.459446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:53.460497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:53.461440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:53.461440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:53.461440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:53.461440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 319/632] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:53.462629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda553ef-2ef4-4fd6-941b-66db7b3cc7d8 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:53.462907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda553ef-2ef4-4fd6-941b-66db7b3cc7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:53.463176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda553ef-2ef4-4fd6-941b-66db7b3cc7d8 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:53.468332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 320/633] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:53.470166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c89e0-3720-433d-84b4-d543335b7f7f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:53.470621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c89e0-3720-433d-84b4-d543335b7f7f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:53.470896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c89e0-3720-433d-84b4-d543335b7f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:53.494273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2c6c89e0-3720-433d-84b4-d543335b7f7f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:53.495469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2c6c89e0-3720-433d-84b4-d543335b7f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:53.515105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:53.568828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d15d7-8398-4002-93d0-43bb1f0ad85f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:53.578306 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 321/634] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:53.579302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c89e0-3720-433d-84b4-d543335b7f7f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:53.626821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:53.652641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc2a29-cffa-4fc7-a5b7-f274385d87cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:53.654959 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc2a29-cffa-4fc7-a5b7-f274385d87cb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:53.657754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc2a29-cffa-4fc7-a5b7-f274385d87cb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:53.658262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc2a29-cffa-4fc7-a5b7-f274385d87cb None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:53.659105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc2a29-cffa-4fc7-a5b7-f274385d87cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:53.659603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc2a29-cffa-4fc7-a5b7-f274385d87cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:53.661861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc2a29-cffa-4fc7-a5b7-f274385d87cb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:53.687002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 314/635] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:53.691634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc2a29-cffa-4fc7-a5b7-f274385d87cb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:53.728894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c89e0-3720-433d-84b4-d543335b7f7f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:53.787894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adcce3-dcbb-4f03-aa7a-54788801f021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:53.788919 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adcce3-dcbb-4f03-aa7a-54788801f021 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:53.789395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adcce3-dcbb-4f03-aa7a-54788801f021 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:53.789886 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adcce3-dcbb-4f03-aa7a-54788801f021 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:53.791038 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adcce3-dcbb-4f03-aa7a-54788801f021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:53.791628 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adcce3-dcbb-4f03-aa7a-54788801f021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:53.793312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adcce3-dcbb-4f03-aa7a-54788801f021 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:53.813168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 322/636] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:53.813168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adcce3-dcbb-4f03-aa7a-54788801f021 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:53.831156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc2a29-cffa-4fc7-a5b7-f274385d87cb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:53.847191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:53.873007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29ecb6-91a6-4f40-ba04-d006be8c39fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:53.873658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29ecb6-91a6-4f40-ba04-d006be8c39fa None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:53.873781 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29ecb6-91a6-4f40-ba04-d006be8c39fa None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:53.874017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29ecb6-91a6-4f40-ba04-d006be8c39fa None admin] PATH_INFO: `/v3/users/glance` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:53.882388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29ecb6-91a6-4f40-ba04-d006be8c39fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:53.883696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29ecb6-91a6-4f40-ba04-d006be8c39fa None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-3c29ecb6-91a6-4f40-ba04-d006be8c39fa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:53.895584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:53.896641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:53.898002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:53.898002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:53.898002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:53.898002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:53.898002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:53.898002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:53.898002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:53.898002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:53.898002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 00:59:53.898002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:53.898002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 315/637] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:53.898002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29ecb6-91a6-4f40-ba04-d006be8c39fa None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:53.944207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:53.947288 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adcce3-dcbb-4f03-aa7a-54788801f021 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:53.982663 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565ff46-96a4-4cfa-9d16-470a810ad53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:53.983291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565ff46-96a4-4cfa-9d16-470a810ad53c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:53.983612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565ff46-96a4-4cfa-9d16-470a810ad53c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:53.983885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565ff46-96a4-4cfa-9d16-470a810ad53c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:53.995140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565ff46-96a4-4cfa-9d16-470a810ad53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-0565ff46-96a4-4cfa-9d16-470a810ad53c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:54.003621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:54.004860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:54.005751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 323/638] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:54.006463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565ff46-96a4-4cfa-9d16-470a810ad53c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:54.017531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29ecb6-91a6-4f40-ba04-d006be8c39fa None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:54.057259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff4942-c373-43c9-854b-56816fae92d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:54.057905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff4942-c373-43c9-854b-56816fae92d8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:54.058207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff4942-c373-43c9-854b-56816fae92d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:54.058476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff4942-c373-43c9-854b-56816fae92d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:54.066295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff4942-c373-43c9-854b-56816fae92d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:54.067781 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff4942-c373-43c9-854b-56816fae92d8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-40ff4942-c373-43c9-854b-56816fae92d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:54.079153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:54.085060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:54.086244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:54.086244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:54.086244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:54.086244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:54.086244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:54.086244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:54.086244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:54.086244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:54.086244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 00:59:54.086244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:54.086244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 316/639] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 6 00:59:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:54.086244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff4942-c373-43c9-854b-56816fae92d8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:54.115663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:54.128520 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565ff46-96a4-4cfa-9d16-470a810ad53c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:54.164876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794f3c0-b77d-4a91-a3e4-8f188030014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:54.165425 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794f3c0-b77d-4a91-a3e4-8f188030014b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:54.165709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794f3c0-b77d-4a91-a3e4-8f188030014b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:54.165977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794f3c0-b77d-4a91-a3e4-8f188030014b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:54.177377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794f3c0-b77d-4a91-a3e4-8f188030014b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-0794f3c0-b77d-4a91-a3e4-8f188030014b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:54.182609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:54.183647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 324/640] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:54.184552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794f3c0-b77d-4a91-a3e4-8f188030014b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:54.190368 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff4942-c373-43c9-854b-56816fae92d8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:54.208835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:54.226684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0ef4d-c487-4801-bd8e-92a77d484e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:54.227291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0ef4d-c487-4801-bd8e-92a77d484e9c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:54.227565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0ef4d-c487-4801-bd8e-92a77d484e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:54.227833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0ef4d-c487-4801-bd8e-92a77d484e9c None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:54.228582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0ef4d-c487-4801-bd8e-92a77d484e9c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:54.228882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0ef4d-c487-4801-bd8e-92a77d484e9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:54.230348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0ef4d-c487-4801-bd8e-92a77d484e9c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:54.249530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 317/641] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Sep 6 00:59:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:54.250634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0ef4d-c487-4801-bd8e-92a77d484e9c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:54.297479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794f3c0-b77d-4a91-a3e4-8f188030014b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:54.332454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05418d88-9fa0-4823-97b9-17af8cc1243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:54.333062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05418d88-9fa0-4823-97b9-17af8cc1243e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:54.333340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05418d88-9fa0-4823-97b9-17af8cc1243e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:54.333609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05418d88-9fa0-4823-97b9-17af8cc1243e None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:54.334275 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05418d88-9fa0-4823-97b9-17af8cc1243e None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:54.334582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05418d88-9fa0-4823-97b9-17af8cc1243e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:54.336001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05418d88-9fa0-4823-97b9-17af8cc1243e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:54.349014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 325/642] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:54.349014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05418d88-9fa0-4823-97b9-17af8cc1243e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:54.351315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:54.368139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0ef4d-c487-4801-bd8e-92a77d484e9c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:54.404636 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060a93f-0110-4ef4-a5ae-a7360d214463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:54.405329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a93f-0110-4ef4-a5ae-a7360d214463 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:54.405605 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a93f-0110-4ef4-a5ae-a7360d214463 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:54.405877 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a93f-0110-4ef4-a5ae-a7360d214463 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:54.406601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060a93f-0110-4ef4-a5ae-a7360d214463 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:54.406905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060a93f-0110-4ef4-a5ae-a7360d214463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:54.408433 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060a93f-0110-4ef4-a5ae-a7360d214463 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:54.428789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 318/643] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 6 00:59:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:54.429352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060a93f-0110-4ef4-a5ae-a7360d214463 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:54.442163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:54.462373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05418d88-9fa0-4823-97b9-17af8cc1243e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:54.500188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f60201-6b5e-4317-b06c-c0f5d84ff767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:54.500868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f60201-6b5e-4317-b06c-c0f5d84ff767 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:54.501152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f60201-6b5e-4317-b06c-c0f5d84ff767 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:54.501429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f60201-6b5e-4317-b06c-c0f5d84ff767 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:54.502109 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f60201-6b5e-4317-b06c-c0f5d84ff767 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:54.502433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f60201-6b5e-4317-b06c-c0f5d84ff767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:54.503841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f60201-6b5e-4317-b06c-c0f5d84ff767 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:54.512463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 326/644] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:54.513267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f60201-6b5e-4317-b06c-c0f5d84ff767 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:54.538031 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060a93f-0110-4ef4-a5ae-a7360d214463 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:54.573238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a02fe-855b-49d8-83db-1c0d20a2a9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:54.573853 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a02fe-855b-49d8-83db-1c0d20a2a9cc None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:54.574129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a02fe-855b-49d8-83db-1c0d20a2a9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:54.574404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a02fe-855b-49d8-83db-1c0d20a2a9cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:54.593617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:54.629219 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f60201-6b5e-4317-b06c-c0f5d84ff767 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:54.647367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a02fe-855b-49d8-83db-1c0d20a2a9cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:54.649306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a02fe-855b-49d8-83db-1c0d20a2a9cc None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:54.666347 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82446e98-b3ed-4a74-9265-3b5658e57368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:54.666891 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82446e98-b3ed-4a74-9265-3b5658e57368 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:54.667164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82446e98-b3ed-4a74-9265-3b5658e57368 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:54.667450 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82446e98-b3ed-4a74-9265-3b5658e57368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:54.678650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82446e98-b3ed-4a74-9265-3b5658e57368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:54.680728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82446e98-b3ed-4a74-9265-3b5658e57368 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:54.683679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-82446e98-b3ed-4a74-9265-3b5658e57368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:54.697773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:54.698800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:54.699882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:54.699882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:54.699882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:54.699882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 327/645] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:54.699882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82446e98-b3ed-4a74-9265-3b5658e57368 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:54.764487 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 319/646] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:54.765336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a02fe-855b-49d8-83db-1c0d20a2a9cc None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:54.811553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82446e98-b3ed-4a74-9265-3b5658e57368 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:54.820450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:54.845820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e4832-9de9-40e7-95a2-7923392f0499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:54.846444 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e4832-9de9-40e7-95a2-7923392f0499 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:54.846717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e4832-9de9-40e7-95a2-7923392f0499 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:54.846986 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e4832-9de9-40e7-95a2-7923392f0499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:54.872072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a02fe-855b-49d8-83db-1c0d20a2a9cc None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:54.905841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6180-b9ee-4650-9819-b5862acff98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:54.906474 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6180-b9ee-4650-9819-b5862acff98a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:54.906754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6180-b9ee-4650-9819-b5862acff98a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:54.907030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6180-b9ee-4650-9819-b5862acff98a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:54.907620 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:54.915508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e4832-9de9-40e7-95a2-7923392f0499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:54.917044 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e4832-9de9-40e7-95a2-7923392f0499 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:54.917379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d6180-b9ee-4650-9819-b5862acff98a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:54.918845 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d6180-b9ee-4650-9819-b5862acff98a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-760d6180-b9ee-4650-9819-b5862acff98a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:54.933447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:54.934671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:54.936058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:54.936058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:54.936058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:54.936058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 320/647] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:54.936058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6180-b9ee-4650-9819-b5862acff98a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:55.018775 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 328/648] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:55.020059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472e155-8446-4a18-b54f-c4b41c71e3ef None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:55.020378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472e155-8446-4a18-b54f-c4b41c71e3ef None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:55.020658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472e155-8446-4a18-b54f-c4b41c71e3ef None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:55.024416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 329/649] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:55.025188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472e155-8446-4a18-b54f-c4b41c71e3ef None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:55.041913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6180-b9ee-4650-9819-b5862acff98a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:55.044139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:55.078493 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64539a67-3006-4a85-a26b-53ca17e268d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:55.079107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539a67-3006-4a85-a26b-53ca17e268d4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:55.079382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539a67-3006-4a85-a26b-53ca17e268d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:55.079654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539a67-3006-4a85-a26b-53ca17e268d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:55.080315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64539a67-3006-4a85-a26b-53ca17e268d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:55.080622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64539a67-3006-4a85-a26b-53ca17e268d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:55.082044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64539a67-3006-4a85-a26b-53ca17e268d4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:55.093244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 321/650] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:55.094034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64539a67-3006-4a85-a26b-53ca17e268d4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:55.120051 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:55.127707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472e155-8446-4a18-b54f-c4b41c71e3ef None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:55.167060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628ce23-3d0f-4034-b456-1fb748fc8619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:55.167782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628ce23-3d0f-4034-b456-1fb748fc8619 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:55.168131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628ce23-3d0f-4034-b456-1fb748fc8619 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:55.168495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628ce23-3d0f-4034-b456-1fb748fc8619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:55.179056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628ce23-3d0f-4034-b456-1fb748fc8619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:55.180591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628ce23-3d0f-4034-b456-1fb748fc8619 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9628ce23-3d0f-4034-b456-1fb748fc8619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:55.195122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:55.200790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:55.201976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:55.201976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:55.201976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:55.201976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 330/651] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:55.201976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628ce23-3d0f-4034-b456-1fb748fc8619 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:55.203657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64539a67-3006-4a85-a26b-53ca17e268d4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:55.237352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c8c2b-a13b-4b6b-a0ae-66e8daa1006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:55.237960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8c2b-a13b-4b6b-a0ae-66e8daa1006d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:55.238237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8c2b-a13b-4b6b-a0ae-66e8daa1006d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:55.239162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8c2b-a13b-4b6b-a0ae-66e8daa1006d None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:55.239162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c8c2b-a13b-4b6b-a0ae-66e8daa1006d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:55.239431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c8c2b-a13b-4b6b-a0ae-66e8daa1006d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:55.240919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c8c2b-a13b-4b6b-a0ae-66e8daa1006d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:55.252601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 322/652] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:55.253791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86efef-e956-493f-9792-116b2a3faa43 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:55.254018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86efef-e956-493f-9792-116b2a3faa43 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:55.254303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86efef-e956-493f-9792-116b2a3faa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:55.271626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6e86efef-e956-493f-9792-116b2a3faa43 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:55.272894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6e86efef-e956-493f-9792-116b2a3faa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:55.289419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:55.308941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628ce23-3d0f-4034-b456-1fb748fc8619 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:55.340930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 323/653] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:55.341789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86efef-e956-493f-9792-116b2a3faa43 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:55.342060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3000b49-ea46-4320-8f6f-4a060c9947a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:55.342763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3000b49-ea46-4320-8f6f-4a060c9947a4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:55.343045 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3000b49-ea46-4320-8f6f-4a060c9947a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:55.343293 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3000b49-ea46-4320-8f6f-4a060c9947a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:55.355230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3000b49-ea46-4320-8f6f-4a060c9947a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:55.357338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3000b49-ea46-4320-8f6f-4a060c9947a4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:55.365936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d3000b49-ea46-4320-8f6f-4a060c9947a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:55.374238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:55.375206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:55.376107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:55.376107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:55.376107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:55.377665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 331/654] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:55.378579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3000b49-ea46-4320-8f6f-4a060c9947a4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:55.457282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86efef-e956-493f-9792-116b2a3faa43 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:55.485877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3000b49-ea46-4320-8f6f-4a060c9947a4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:55.495928 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdfc31-6c07-48cc-a54e-4dfda4951742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:55.497138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdfc31-6c07-48cc-a54e-4dfda4951742 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:55.498081 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdfc31-6c07-48cc-a54e-4dfda4951742 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:55.498743 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdfc31-6c07-48cc-a54e-4dfda4951742 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:55.507649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdfc31-6c07-48cc-a54e-4dfda4951742 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:55.509192 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdfc31-6c07-48cc-a54e-4dfda4951742 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-a0fdfc31-6c07-48cc-a54e-4dfda4951742 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:55.522359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:55.523399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:55.524404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:55.524404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:55.524404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:55.524404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:55.524404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:55.524404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:55.524404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:55.524404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:55.524404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 00:59:55.524404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:55.524404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 324/655] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:55.524404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdfc31-6c07-48cc-a54e-4dfda4951742 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:55.527895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94e5ba-f6ce-4548-9647-97ceb3db2618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:55.528790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94e5ba-f6ce-4548-9647-97ceb3db2618 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:55.529257 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94e5ba-f6ce-4548-9647-97ceb3db2618 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:55.529610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94e5ba-f6ce-4548-9647-97ceb3db2618 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:55.531199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94e5ba-f6ce-4548-9647-97ceb3db2618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:55.531199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94e5ba-f6ce-4548-9647-97ceb3db2618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:55.532151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94e5ba-f6ce-4548-9647-97ceb3db2618 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:55.544701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:55.545304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 332/656] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:55.546298 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94e5ba-f6ce-4548-9647-97ceb3db2618 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:55.609735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:55.645904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdfc31-6c07-48cc-a54e-4dfda4951742 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:55.651893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94e5ba-f6ce-4548-9647-97ceb3db2618 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:55.680416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e79c30-0734-40c6-9c40-ca292dc7ee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:55.681070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e79c30-0734-40c6-9c40-ca292dc7ee20 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:55.681331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e79c30-0734-40c6-9c40-ca292dc7ee20 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:55.681606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e79c30-0734-40c6-9c40-ca292dc7ee20 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:55.686269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10669d-8eac-4ea4-991b-e16f4b989d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:55.686872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10669d-8eac-4ea4-991b-e16f4b989d3f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:55.687151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10669d-8eac-4ea4-991b-e16f4b989d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:55.687430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10669d-8eac-4ea4-991b-e16f4b989d3f None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:55.688070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10669d-8eac-4ea4-991b-e16f4b989d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:55.688404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10669d-8eac-4ea4-991b-e16f4b989d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:55.689605 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e79c30-0734-40c6-9c40-ca292dc7ee20 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:55.689832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10669d-8eac-4ea4-991b-e16f4b989d3f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:55.691077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e79c30-0734-40c6-9c40-ca292dc7ee20 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:55.701043 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 333/657] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:55.702034 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10669d-8eac-4ea4-991b-e16f4b989d3f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-b4e79c30-0734-40c6-9c40-ca292dc7ee20 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:55.702748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:55.703837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:55.705004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:55.705004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:55.705004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:55.705004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:55.705004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:55.705004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:55.705004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:55.705004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:55.705004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 00:59:55.705004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:55.705004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 325/658] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:55.705004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e79c30-0734-40c6-9c40-ca292dc7ee20 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:55.777790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:55.807961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10669d-8eac-4ea4-991b-e16f4b989d3f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:55.809722 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e79c30-0734-40c6-9c40-ca292dc7ee20 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:55.828026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:55.843883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7536a2-bb60-4fb4-98d1-46a0b181466a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:55.844524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7536a2-bb60-4fb4-98d1-46a0b181466a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:55.844802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7536a2-bb60-4fb4-98d1-46a0b181466a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:55.845074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7536a2-bb60-4fb4-98d1-46a0b181466a None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:55.845360 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b4ebb-84ac-434c-aa87-00305f0d8be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:55.845805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7536a2-bb60-4fb4-98d1-46a0b181466a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:55.845995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b4ebb-84ac-434c-aa87-00305f0d8be4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:55.846109 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7536a2-bb60-4fb4-98d1-46a0b181466a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:55.846254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b4ebb-84ac-434c-aa87-00305f0d8be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:55.846523 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b4ebb-84ac-434c-aa87-00305f0d8be4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:55.847574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7536a2-bb60-4fb4-98d1-46a0b181466a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:55.853584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b4ebb-84ac-434c-aa87-00305f0d8be4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:55.855080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b4ebb-84ac-434c-aa87-00305f0d8be4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:55.865127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 334/659] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Sep 6 00:59:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:55.865922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7536a2-bb60-4fb4-98d1-46a0b181466a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-0e5b4ebb-84ac-434c-aa87-00305f0d8be4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:55.867827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:55.868790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:55.869678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:55.869678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:55.869678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:55.869678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:55.869678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:55.869678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:55.869678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:55.869678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:55.869678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 326/660] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:55.869678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b4ebb-84ac-434c-aa87-00305f0d8be4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:55.970503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7536a2-bb60-4fb4-98d1-46a0b181466a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:55.972711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b4ebb-84ac-434c-aa87-00305f0d8be4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:56.001863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:56.004828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d96c56-2896-421f-8094-86c7fb2efc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:56.005498 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d96c56-2896-421f-8094-86c7fb2efc76 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:56.005777 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d96c56-2896-421f-8094-86c7fb2efc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:56.006514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d96c56-2896-421f-8094-86c7fb2efc76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:56.010587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b853b57-f470-41f6-a2b1-6c7c6bfb019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:56.011202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b853b57-f470-41f6-a2b1-6c7c6bfb019a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:56.011480 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b853b57-f470-41f6-a2b1-6c7c6bfb019a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:56.011752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b853b57-f470-41f6-a2b1-6c7c6bfb019a None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:56.012496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b853b57-f470-41f6-a2b1-6c7c6bfb019a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:56.012800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b853b57-f470-41f6-a2b1-6c7c6bfb019a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:56.014340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b853b57-f470-41f6-a2b1-6c7c6bfb019a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:56.019089 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d96c56-2896-421f-8094-86c7fb2efc76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-17d96c56-2896-421f-8094-86c7fb2efc76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:56.023938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:56.024972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 335/661] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 00:59:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:56.025842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d96c56-2896-421f-8094-86c7fb2efc76 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:56.032141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 327/662] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Sep 6 00:59:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:56.032924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b853b57-f470-41f6-a2b1-6c7c6bfb019a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:56.069654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:56.130400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d96c56-2896-421f-8094-86c7fb2efc76 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:56.133012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b853b57-f470-41f6-a2b1-6c7c6bfb019a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:56.164065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df9ac0-5da6-4b5f-a1c0-b7b0ea8d5c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:56.164744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df9ac0-5da6-4b5f-a1c0-b7b0ea8d5c7c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:56.165018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df9ac0-5da6-4b5f-a1c0-b7b0ea8d5c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:56.165289 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df9ac0-5da6-4b5f-a1c0-b7b0ea8d5c7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:56.167007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ab027-250f-49d6-ab44-89760047b4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:56.167621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ab027-250f-49d6-ab44-89760047b4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:56.167902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ab027-250f-49d6-ab44-89760047b4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:56.168175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ab027-250f-49d6-ab44-89760047b4d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:56.171987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df9ac0-5da6-4b5f-a1c0-b7b0ea8d5c7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:56.173581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df9ac0-5da6-4b5f-a1c0-b7b0ea8d5c7c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-97df9ac0-5da6-4b5f-a1c0-b7b0ea8d5c7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:56.184750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:56.185844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:56.186747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:56.186747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:56.186747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:56.186747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:56.186747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:56.186747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:56.186747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:56.186747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:56.186747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 336/663] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:56.187396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df9ac0-5da6-4b5f-a1c0-b7b0ea8d5c7c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:56.230676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:56.242078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ab027-250f-49d6-ab44-89760047b4d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:56.243578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ab027-250f-49d6-ab44-89760047b4d2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:56.287074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:56.291303 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df9ac0-5da6-4b5f-a1c0-b7b0ea8d5c7c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:56.325030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d140339-6f32-4220-ad7d-d630a808d616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:56.325634 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d140339-6f32-4220-ad7d-d630a808d616 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:56.326126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d140339-6f32-4220-ad7d-d630a808d616 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:56.326398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d140339-6f32-4220-ad7d-d630a808d616 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:56.327088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d140339-6f32-4220-ad7d-d630a808d616 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:56.327384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d140339-6f32-4220-ad7d-d630a808d616 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:56.328901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d140339-6f32-4220-ad7d-d630a808d616 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:56.345589 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 337/664] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:56.345589 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d140339-6f32-4220-ad7d-d630a808d616 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:56.345859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 328/665] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:56.345859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ab027-250f-49d6-ab44-89760047b4d2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:56.431963 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:56.441526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ab027-250f-49d6-ab44-89760047b4d2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:56.444883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d140339-6f32-4220-ad7d-d630a808d616 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:56.475008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27bd29-e10f-4ffc-85db-3981178036a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:56.475603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27bd29-e10f-4ffc-85db-3981178036a0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:56.475864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27bd29-e10f-4ffc-85db-3981178036a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:56.476132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27bd29-e10f-4ffc-85db-3981178036a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:56.480726 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458abe3-912d-4287-a8b5-75162ddc6760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:56.481356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458abe3-912d-4287-a8b5-75162ddc6760 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:56.481625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458abe3-912d-4287-a8b5-75162ddc6760 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:56.481895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458abe3-912d-4287-a8b5-75162ddc6760 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:56.482917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458abe3-912d-4287-a8b5-75162ddc6760 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:56.483227 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458abe3-912d-4287-a8b5-75162ddc6760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:56.484680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458abe3-912d-4287-a8b5-75162ddc6760 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:56.492652 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 338/666] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 00:59:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:56.493431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458abe3-912d-4287-a8b5-75162ddc6760 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:56.514689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:56.545648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27bd29-e10f-4ffc-85db-3981178036a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:56.547100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27bd29-e10f-4ffc-85db-3981178036a0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:56.592467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458abe3-912d-4287-a8b5-75162ddc6760 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:56.628235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684960-50b6-4380-9f69-7c1c484cc8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:56.628872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684960-50b6-4380-9f69-7c1c484cc8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:56.629152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684960-50b6-4380-9f69-7c1c484cc8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:56.629419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684960-50b6-4380-9f69-7c1c484cc8f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:56.630107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684960-50b6-4380-9f69-7c1c484cc8f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:56.630409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684960-50b6-4380-9f69-7c1c484cc8f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:56.631887 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684960-50b6-4380-9f69-7c1c484cc8f9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:56.639157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:56.644230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 339/667] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:56.645827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684960-50b6-4380-9f69-7c1c484cc8f9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:56.653240 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 329/668] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:56.654095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27bd29-e10f-4ffc-85db-3981178036a0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:56.725722 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:56.745579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684960-50b6-4380-9f69-7c1c484cc8f9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:56.753871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27bd29-e10f-4ffc-85db-3981178036a0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:56.781009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71952c98-8ba4-4744-92a5-c2ac09be7def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:56.781622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71952c98-8ba4-4744-92a5-c2ac09be7def None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:56.781904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71952c98-8ba4-4744-92a5-c2ac09be7def None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:56.782174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71952c98-8ba4-4744-92a5-c2ac09be7def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:56.782903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71952c98-8ba4-4744-92a5-c2ac09be7def None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=31ebbadd69da4bc6ad25b5c882962ea4) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:56.783234 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71952c98-8ba4-4744-92a5-c2ac09be7def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:56.784797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71952c98-8ba4-4744-92a5-c2ac09be7def None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:56.787710 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb9aaa-110e-42b1-837f-c48415caa99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:56.788367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb9aaa-110e-42b1-837f-c48415caa99e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:56.788642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb9aaa-110e-42b1-837f-c48415caa99e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:56.788911 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb9aaa-110e-42b1-837f-c48415caa99e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:56.796743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 340/669] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:56 2022] GET /identity/v3/role_assignments?user.id=31ebbadd69da4bc6ad25b5c882962ea4&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:56.796743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71952c98-8ba4-4744-92a5-c2ac09be7def None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:56.805070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb9aaa-110e-42b1-837f-c48415caa99e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:56.806615 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb9aaa-110e-42b1-837f-c48415caa99e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e4eb9aaa-110e-42b1-837f-c48415caa99e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:56.823158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:56.824403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:56.825317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:56.825317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:56.825317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:56.825317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 330/670] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:56.825317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb9aaa-110e-42b1-837f-c48415caa99e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:56.878849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:56.918731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71952c98-8ba4-4744-92a5-c2ac09be7def None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:56.943719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb9aaa-110e-42b1-837f-c48415caa99e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:56.958660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239453f-f448-4e08-bbc9-e1761a8fdc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:56.959302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239453f-f448-4e08-bbc9-e1761a8fdc11 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:56.959578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239453f-f448-4e08-bbc9-e1761a8fdc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:56.959847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239453f-f448-4e08-bbc9-e1761a8fdc11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:56.972888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239453f-f448-4e08-bbc9-e1761a8fdc11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:56.974400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239453f-f448-4e08-bbc9-e1761a8fdc11 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:56.977810 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:56.987379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ad915-c480-476e-9d9b-6e090e4e9c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:56.988023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ad915-c480-476e-9d9b-6e090e4e9c53 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:56.988278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ad915-c480-476e-9d9b-6e090e4e9c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:56.988579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ad915-c480-476e-9d9b-6e090e4e9c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:56.989317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ad915-c480-476e-9d9b-6e090e4e9c53 None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=42b9c25e98fe4b1bbc33a601d4150071) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:56.989627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ad915-c480-476e-9d9b-6e090e4e9c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d239453f-f448-4e08-bbc9-e1761a8fdc11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:56.990632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:56.991593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:56.992555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:56.992555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:56.992555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:56.992737 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ad915-c480-476e-9d9b-6e090e4e9c53 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:56.992813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 341/671] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:56.993338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239453f-f448-4e08-bbc9-e1761a8fdc11 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:56.998964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 331/672] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:56 2022] GET /identity/v3/role_assignments?user.id=42b9c25e98fe4b1bbc33a601d4150071&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:56.999566 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ad915-c480-476e-9d9b-6e090e4e9c53 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:57.124143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239453f-f448-4e08-bbc9-e1761a8fdc11 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:57.125066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ad915-c480-476e-9d9b-6e090e4e9c53 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:57.136769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:57.164552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03c6c8-b9ed-4b27-932b-aeeaf12aebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:57.164947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0a36c-9d04-442b-8e82-9082da3cadb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:57.165608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03c6c8-b9ed-4b27-932b-aeeaf12aebdf None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:57.165746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0a36c-9d04-442b-8e82-9082da3cadb4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:57.166078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0a36c-9d04-442b-8e82-9082da3cadb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:57.166293 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03c6c8-b9ed-4b27-932b-aeeaf12aebdf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:57.166535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0a36c-9d04-442b-8e82-9082da3cadb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:57.166839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03c6c8-b9ed-4b27-932b-aeeaf12aebdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:57.167369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0a36c-9d04-442b-8e82-9082da3cadb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:57.167692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0a36c-9d04-442b-8e82-9082da3cadb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:57.169117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0a36c-9d04-442b-8e82-9082da3cadb4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:57.179673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03c6c8-b9ed-4b27-932b-aeeaf12aebdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:57.181383 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03c6c8-b9ed-4b27-932b-aeeaf12aebdf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:57.186528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 332/673] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:57.187745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0a36c-9d04-442b-8e82-9082da3cadb4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-af03c6c8-b9ed-4b27-932b-aeeaf12aebdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:57.197270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:57.198462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:57.199602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:57.199602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:57.199602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:57.199602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 342/674] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:57.199602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03c6c8-b9ed-4b27-932b-aeeaf12aebdf None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:57.272447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:57.324930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0a36c-9d04-442b-8e82-9082da3cadb4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:57.334798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03c6c8-b9ed-4b27-932b-aeeaf12aebdf None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:57.372187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d31aa0-5fe3-4757-9789-3c467467db81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:57.372947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d31aa0-5fe3-4757-9789-3c467467db81 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:57.373542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d31aa0-5fe3-4757-9789-3c467467db81 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:57.373924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d31aa0-5fe3-4757-9789-3c467467db81 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:57.374727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d31aa0-5fe3-4757-9789-3c467467db81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:57.374973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d31aa0-5fe3-4757-9789-3c467467db81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:57.376460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d31aa0-5fe3-4757-9789-3c467467db81 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:57.380456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdb65a-65a9-478d-a684-3a97ff2c5048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:57.381289 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdb65a-65a9-478d-a684-3a97ff2c5048 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:57.381712 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdb65a-65a9-478d-a684-3a97ff2c5048 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:57.382140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdb65a-65a9-478d-a684-3a97ff2c5048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:57.389014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 333/675] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:57.389686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d31aa0-5fe3-4757-9789-3c467467db81 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:57.391868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdb65a-65a9-478d-a684-3a97ff2c5048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:57.394760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdb65a-65a9-478d-a684-3a97ff2c5048 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-64cdb65a-65a9-478d-a684-3a97ff2c5048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:57.410326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:57.411827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:57.412953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:57.412953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:57.412953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:57.412953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:57.412953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:57.412953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:57.412953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:57.412953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:57.415767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 343/676] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:57.421271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdb65a-65a9-478d-a684-3a97ff2c5048 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:57.427351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:57.520408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d31aa0-5fe3-4757-9789-3c467467db81 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:57.542713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdb65a-65a9-478d-a684-3a97ff2c5048 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:57.556131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:57.558866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2d427-223e-40fe-bca0-97329ddced48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:57.559677 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2d427-223e-40fe-bca0-97329ddced48 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:57.560128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2d427-223e-40fe-bca0-97329ddced48 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:57.560662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2d427-223e-40fe-bca0-97329ddced48 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:57.562098 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2d427-223e-40fe-bca0-97329ddced48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:57.562544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2d427-223e-40fe-bca0-97329ddced48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:57.564814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2d427-223e-40fe-bca0-97329ddced48 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:57.582595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 334/677] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:57.583682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2d427-223e-40fe-bca0-97329ddced48 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:57.588815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2f30b-8e72-4a5b-9a85-573122e5e1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:57.589573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f30b-8e72-4a5b-9a85-573122e5e1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:57.589950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f30b-8e72-4a5b-9a85-573122e5e1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:57.590490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f30b-8e72-4a5b-9a85-573122e5e1f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:57.601193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2f30b-8e72-4a5b-9a85-573122e5e1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:57.603333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2f30b-8e72-4a5b-9a85-573122e5e1f7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3df2f30b-8e72-4a5b-9a85-573122e5e1f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 00:59:57.619423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:57.620543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:57.621519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:57.621519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:57.621519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 00:59:57.621519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 00:59:57.621519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 00:59:57.621519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 00:59:57.621519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 00:59:57.621519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 00:59:57.621519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 00:59:57.621519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:57.621519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 344/678] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:59:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:57.622359 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2f30b-8e72-4a5b-9a85-573122e5e1f7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:57.678562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:57.696672 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2d427-223e-40fe-bca0-97329ddced48 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:57.745125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92663e-102b-4feb-9754-4202b870535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:57.745847 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92663e-102b-4feb-9754-4202b870535b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:57.746318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92663e-102b-4feb-9754-4202b870535b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:57.746793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92663e-102b-4feb-9754-4202b870535b None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:57.747608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92663e-102b-4feb-9754-4202b870535b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:57.748364 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92663e-102b-4feb-9754-4202b870535b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:57.749161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2f30b-8e72-4a5b-9a85-573122e5e1f7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:57.750099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92663e-102b-4feb-9754-4202b870535b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:57.768449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 335/679] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:57.769607 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92663e-102b-4feb-9754-4202b870535b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:57.790379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b902882-eb33-48a0-ba0b-815568ab523d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:57.791423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b902882-eb33-48a0-ba0b-815568ab523d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:57.791876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b902882-eb33-48a0-ba0b-815568ab523d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:57.792396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b902882-eb33-48a0-ba0b-815568ab523d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:57.799787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b902882-eb33-48a0-ba0b-815568ab523d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:57.801631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b902882-eb33-48a0-ba0b-815568ab523d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3b902882-eb33-48a0-ba0b-815568ab523d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:57.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:57.814601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:57.815513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:57.815513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:57.815513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:57.815513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:57.815513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:57.815513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:57.815513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:57.815513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:57.822581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 345/680] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:57.823658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b902882-eb33-48a0-ba0b-815568ab523d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:57.860222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:57.904784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92663e-102b-4feb-9754-4202b870535b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:57.935455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b902882-eb33-48a0-ba0b-815568ab523d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:57.948615 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ef30f-02ed-4110-bc63-18fd04fca8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:57.949241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ef30f-02ed-4110-bc63-18fd04fca8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:57.949531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ef30f-02ed-4110-bc63-18fd04fca8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:57.949802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ef30f-02ed-4110-bc63-18fd04fca8b2 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:57.951500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ef30f-02ed-4110-bc63-18fd04fca8b2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:57.951811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ef30f-02ed-4110-bc63-18fd04fca8b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:57.953613 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ef30f-02ed-4110-bc63-18fd04fca8b2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:57.972750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c06129-7ba0-4f47-a642-737eb4580105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:57.973679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c06129-7ba0-4f47-a642-737eb4580105 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:57.974146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c06129-7ba0-4f47-a642-737eb4580105 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:57.974668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c06129-7ba0-4f47-a642-737eb4580105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:57.975576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 336/681] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Sep 6 00:59:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:57.975897 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c06129-7ba0-4f47-a642-737eb4580105 None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=eae9814386a444678a292becdfe07332) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:57.980518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ef30f-02ed-4110-bc63-18fd04fca8b2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:57.980518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:57.981772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c06129-7ba0-4f47-a642-737eb4580105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:57.983960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c06129-7ba0-4f47-a642-737eb4580105 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:57.991974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 346/682] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:57 2022] GET /identity/v3/role_assignments?user.id=eae9814386a444678a292becdfe07332&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:57.993335 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c06129-7ba0-4f47-a642-737eb4580105 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:58.107759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ef30f-02ed-4110-bc63-18fd04fca8b2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:58.149112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d073d55-f380-4233-8c44-c827fb607fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:58.149741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d073d55-f380-4233-8c44-c827fb607fcf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:58.150021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d073d55-f380-4233-8c44-c827fb607fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:58.150352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d073d55-f380-4233-8c44-c827fb607fcf None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:58.156340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d073d55-f380-4233-8c44-c827fb607fcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:58.156340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d073d55-f380-4233-8c44-c827fb607fcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:58.156340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d073d55-f380-4233-8c44-c827fb607fcf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:58.168732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 337/683] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:58.175440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d073d55-f380-4233-8c44-c827fb607fcf None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:58.205356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:58.222625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c06129-7ba0-4f47-a642-737eb4580105 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:58.252269 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:58.304360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa2cb4-04cd-4111-8c4b-4a4fae251e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:58.305565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa2cb4-04cd-4111-8c4b-4a4fae251e90 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:58.306039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa2cb4-04cd-4111-8c4b-4a4fae251e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:58.306500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa2cb4-04cd-4111-8c4b-4a4fae251e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:58.318893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d073d55-f380-4233-8c44-c827fb607fcf None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:58.358823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8c734-62de-4bad-ab20-a490ac90147f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:58.359158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c734-62de-4bad-ab20-a490ac90147f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:58.359380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c734-62de-4bad-ab20-a490ac90147f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:58.359663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c734-62de-4bad-ab20-a490ac90147f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:58.360483 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8c734-62de-4bad-ab20-a490ac90147f None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=2fc30f3a335f428082e9178227dcb4e5) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:58.360793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8c734-62de-4bad-ab20-a490ac90147f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:58.362403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8c734-62de-4bad-ab20-a490ac90147f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:58.368848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 338/684] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:58 2022] GET /identity/v3/role_assignments?user.id=2fc30f3a335f428082e9178227dcb4e5&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:58.394078 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa2cb4-04cd-4111-8c4b-4a4fae251e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:58.396067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa2cb4-04cd-4111-8c4b-4a4fae251e90 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:58.502555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:58.514486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 347/685] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 00:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 00:59:58.520010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8c734-62de-4bad-ab20-a490ac90147f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:58.641132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8c734-62de-4bad-ab20-a490ac90147f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:58.669942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:58.683564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f54913-78be-4a88-913c-e7d385ce837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:58.684213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f54913-78be-4a88-913c-e7d385ce837c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:58.684513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f54913-78be-4a88-913c-e7d385ce837c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:58.684778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f54913-78be-4a88-913c-e7d385ce837c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:58.697794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f54913-78be-4a88-913c-e7d385ce837c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:58.699484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f54913-78be-4a88-913c-e7d385ce837c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c6f54913-78be-4a88-913c-e7d385ce837c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:58.720988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:58.721990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:58.723302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:58.723302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:58.723302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:58.723302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 339/686] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:58.729526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa2cb4-04cd-4111-8c4b-4a4fae251e90 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:58.867267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa2cb4-04cd-4111-8c4b-4a4fae251e90 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:58.903316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681ac79-c36a-4334-8e33-e7c76a734928 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:58.903729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681ac79-c36a-4334-8e33-e7c76a734928 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:58.903900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681ac79-c36a-4334-8e33-e7c76a734928 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:58.905795 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 340/687] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 00:59:58.909054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5f9b6-ebcd-48c5-881b-c39800df12a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:58.909681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5f9b6-ebcd-48c5-881b-c39800df12a8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:58.909962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5f9b6-ebcd-48c5-881b-c39800df12a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:58.910232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5f9b6-ebcd-48c5-881b-c39800df12a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:58.911223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5f9b6-ebcd-48c5-881b-c39800df12a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:58.911520 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5f9b6-ebcd-48c5-881b-c39800df12a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:58.912326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3004c-af4e-4918-9280-4043e47281c4 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:58.912806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3004c-af4e-4918-9280-4043e47281c4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:58.912975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5f9b6-ebcd-48c5-881b-c39800df12a8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:58.913446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3004c-af4e-4918-9280-4043e47281c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:58.930686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 348/688] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:58.933733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5f9b6-ebcd-48c5-881b-c39800df12a8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:58.937187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-17a3004c-af4e-4918-9280-4043e47281c4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:58.938655 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-17a3004c-af4e-4918-9280-4043e47281c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:59.027958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:59.058382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 341/689] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 00:59:59.113173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5f9b6-ebcd-48c5-881b-c39800df12a8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:59.150787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d22933-1076-4a8c-af80-81d73bc8ded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:59.151338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d22933-1076-4a8c-af80-81d73bc8ded3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:59.151610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d22933-1076-4a8c-af80-81d73bc8ded3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:59.151877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d22933-1076-4a8c-af80-81d73bc8ded3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:59.159399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d22933-1076-4a8c-af80-81d73bc8ded3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:59.161287 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d22933-1076-4a8c-af80-81d73bc8ded3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c6d22933-1076-4a8c-af80-81d73bc8ded3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 00:59:59.173563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:59.174487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:59.175385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 00:59:59.175385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 00:59:59.175385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 00:59:59.175385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 00:59:59.175385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 00:59:59.175385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 00:59:59.175385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 00:59:59.175385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:59.175385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 349/690] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 00:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:59.180507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3004c-af4e-4918-9280-4043e47281c4 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:59.261719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f168e-55e5-43c5-9641-4caea22d6963 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:59.262164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f168e-55e5-43c5-9641-4caea22d6963 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:59.262543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f168e-55e5-43c5-9641-4caea22d6963 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:59.265056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 350/691] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 00:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 00:59:59.269990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b278a6-83a1-4648-a7c8-0431e1e42fa1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:59.270377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b278a6-83a1-4648-a7c8-0431e1e42fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:59.270742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b278a6-83a1-4648-a7c8-0431e1e42fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:59.306038 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-31b278a6-83a1-4648-a7c8-0431e1e42fa1 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 00:59:59.308248 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-31b278a6-83a1-4648-a7c8-0431e1e42fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 00:59:59.342070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3004c-af4e-4918-9280-4043e47281c4 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:59.368641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:59.399845 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2c3bb-f292-4d21-95f7-ac53c8ff2db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:59.400759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c3bb-f292-4d21-95f7-ac53c8ff2db7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:59.401263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c3bb-f292-4d21-95f7-ac53c8ff2db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:59.401812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c3bb-f292-4d21-95f7-ac53c8ff2db7 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:59.402785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2c3bb-f292-4d21-95f7-ac53c8ff2db7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:59.403237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2c3bb-f292-4d21-95f7-ac53c8ff2db7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:59.405258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2c3bb-f292-4d21-95f7-ac53c8ff2db7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:59.416315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 351/692] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 00:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 00:59:59.416315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b278a6-83a1-4648-a7c8-0431e1e42fa1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:59.421741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 342/693] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 00:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 00:59:59.430767 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2c3bb-f292-4d21-95f7-ac53c8ff2db7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:59.500653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:59.553933 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2c3bb-f292-4d21-95f7-ac53c8ff2db7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:59.601172 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c47ff-2dc9-4671-8ab1-a7825753a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:59.604315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c47ff-2dc9-4671-8ab1-a7825753a4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:59.604315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c47ff-2dc9-4671-8ab1-a7825753a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:59.604315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c47ff-2dc9-4671-8ab1-a7825753a4a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:59.604315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c47ff-2dc9-4671-8ab1-a7825753a4a8 None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=d7e2ea2ab4ae4a14be9bd35af20080c6) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:59.604315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c47ff-2dc9-4671-8ab1-a7825753a4a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:59.604840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c47ff-2dc9-4671-8ab1-a7825753a4a8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:59.621233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 343/694] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 00:59:59 2022] GET /identity/v3/role_assignments?user.id=d7e2ea2ab4ae4a14be9bd35af20080c6&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 00:59:59.632832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b278a6-83a1-4648-a7c8-0431e1e42fa1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:59.694629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcb62c-268f-4c8e-afa9-4589f8993b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:59.695218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcb62c-268f-4c8e-afa9-4589f8993b49 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:59.695499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcb62c-268f-4c8e-afa9-4589f8993b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:59.695771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcb62c-268f-4c8e-afa9-4589f8993b49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:59.714767 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c47ff-2dc9-4671-8ab1-a7825753a4a8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:59.718169 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcb62c-268f-4c8e-afa9-4589f8993b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:59.719734 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcb62c-268f-4c8e-afa9-4589f8993b49 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-50dcb62c-268f-4c8e-afa9-4589f8993b49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 00:59:59.754071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:59.755119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 00:59:59.756473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 00:59:59.756473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 00:59:59.756473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 00:59:59.756473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 352/695] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 00:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:59.758987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:59.765321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcb62c-268f-4c8e-afa9-4589f8993b49 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:59.846836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c47ff-2dc9-4671-8ab1-a7825753a4a8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:59.902266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858472b-7cc1-477b-81b7-3e2efda50f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:59.903817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858472b-7cc1-477b-81b7-3e2efda50f9f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:59.904393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858472b-7cc1-477b-81b7-3e2efda50f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:59.904901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858472b-7cc1-477b-81b7-3e2efda50f9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:59.921258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858472b-7cc1-477b-81b7-3e2efda50f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 00:59:59.926325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-9858472b-7cc1-477b-81b7-3e2efda50f9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 00:59:59.931713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 00:59:59.932730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 00:59:59.933582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 00:59:59.933582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 00:59:59.933582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 00:59:59.933582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 00:59:59.933582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 00:59:59.933582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 00:59:59.933582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 00:59:59.933582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 00:59:59.933582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 00:59:59.933582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 00:59:59.933582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 00:59:59.933582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 00:59:59.934238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcb62c-268f-4c8e-afa9-4589f8993b49 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 00:59:59.944440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 344/696] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 00:59:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 00:59:59.950047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858472b-7cc1-477b-81b7-3e2efda50f9f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 00:59:59.982659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd29fd3-50fa-4681-ab0f-a4f756022f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 00:59:59.983608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd29fd3-50fa-4681-ab0f-a4f756022f28 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 00:59:59.983889 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd29fd3-50fa-4681-ab0f-a4f756022f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 00:59:59.984160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd29fd3-50fa-4681-ab0f-a4f756022f28 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 00:59:59.984857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd29fd3-50fa-4681-ab0f-a4f756022f28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 00:59:59.985159 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd29fd3-50fa-4681-ab0f-a4f756022f28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 00:59:59.989603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd29fd3-50fa-4681-ab0f-a4f756022f28 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:00.023909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 353/697] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 00:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:00.029917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd29fd3-50fa-4681-ab0f-a4f756022f28 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:00.145254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:00.170695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858472b-7cc1-477b-81b7-3e2efda50f9f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:00.190217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd29fd3-50fa-4681-ab0f-a4f756022f28 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:00.253900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d1718-a354-4ff5-807e-3d5edb02cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:00.254817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d1718-a354-4ff5-807e-3d5edb02cdeb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:00.255232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d1718-a354-4ff5-807e-3d5edb02cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:00.255642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d1718-a354-4ff5-807e-3d5edb02cdeb None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:00.256646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d1718-a354-4ff5-807e-3d5edb02cdeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:00.257119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d1718-a354-4ff5-807e-3d5edb02cdeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:00.259389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d1718-a354-4ff5-807e-3d5edb02cdeb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:00.270273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484ea8d-eb4a-42a0-ac4b-5b3644fe803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:00.271295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484ea8d-eb4a-42a0-ac4b-5b3644fe803f None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:00.271707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484ea8d-eb4a-42a0-ac4b-5b3644fe803f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:00.272109 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484ea8d-eb4a-42a0-ac4b-5b3644fe803f None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:00.273140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484ea8d-eb4a-42a0-ac4b-5b3644fe803f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:00.275537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484ea8d-eb4a-42a0-ac4b-5b3644fe803f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:00.293594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 345/698] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 00:59:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:00.294638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d1718-a354-4ff5-807e-3d5edb02cdeb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:00.333077 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 354/699] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 01:00:00 2022] POST /identity/v3/users => generated 254 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:00:00.421897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d1718-a354-4ff5-807e-3d5edb02cdeb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:00.459210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68377f7-3d3b-4b6b-88b0-4fc84f32a7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:00.459853 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68377f7-3d3b-4b6b-88b0-4fc84f32a7ed None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:00.460127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68377f7-3d3b-4b6b-88b0-4fc84f32a7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:00.460430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68377f7-3d3b-4b6b-88b0-4fc84f32a7ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:00.472362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68377f7-3d3b-4b6b-88b0-4fc84f32a7ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:00.473884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68377f7-3d3b-4b6b-88b0-4fc84f32a7ed None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e68377f7-3d3b-4b6b-88b0-4fc84f32a7ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:00.490216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:00.491258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:00.492832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:00.492832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:00.492832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:00.492832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 346/700] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:00.501481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484ea8d-eb4a-42a0-ac4b-5b3644fe803f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:00.521408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:00.640758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484ea8d-eb4a-42a0-ac4b-5b3644fe803f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:00.683420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2faf0f-3f6e-44ae-b22b-0a0516ecb877 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:00.683420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2faf0f-3f6e-44ae-b22b-0a0516ecb877 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:00.683420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2faf0f-3f6e-44ae-b22b-0a0516ecb877 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:00.683830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f1413-74b1-4a50-949e-f6fcafe9579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:00.683830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f1413-74b1-4a50-949e-f6fcafe9579d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:00.683981 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 347/701] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:00.684061 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f1413-74b1-4a50-949e-f6fcafe9579d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:00.684061 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f1413-74b1-4a50-949e-f6fcafe9579d None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:00.684586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f1413-74b1-4a50-949e-f6fcafe9579d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:00.684919 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f1413-74b1-4a50-949e-f6fcafe9579d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:00.686304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f1413-74b1-4a50-949e-f6fcafe9579d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:00.689524 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b87d90-a8b0-44f4-93fe-4136459eab5d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:00.689800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b87d90-a8b0-44f4-93fe-4136459eab5d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:00.690072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b87d90-a8b0-44f4-93fe-4136459eab5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:00.701950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 355/702] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:00.709341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f1413-74b1-4a50-949e-f6fcafe9579d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:00.711342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-79b87d90-a8b0-44f4-93fe-4136459eab5d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:00.712749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-79b87d90-a8b0-44f4-93fe-4136459eab5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:00.715724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:00.784808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:00.808392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 348/703] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 01:00:00.820081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f1413-74b1-4a50-949e-f6fcafe9579d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:00.856006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b166f51-5ac3-4f73-84fd-6c3ad3fdacb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:00.856761 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b166f51-5ac3-4f73-84fd-6c3ad3fdacb2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:00.857065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b166f51-5ac3-4f73-84fd-6c3ad3fdacb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:00.857349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b166f51-5ac3-4f73-84fd-6c3ad3fdacb2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:00.865024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b166f51-5ac3-4f73-84fd-6c3ad3fdacb2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:00.866539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b166f51-5ac3-4f73-84fd-6c3ad3fdacb2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-0b166f51-5ac3-4f73-84fd-6c3ad3fdacb2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:00.879968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:00.881017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:00.883473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:00.883473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:00.883473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:00.883473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:00.883473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:00.883473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:00.883473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:00.883473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:00.883473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 01:00:00.883473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:00.883473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 356/704] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 6 01:00:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:00.886755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b87d90-a8b0-44f4-93fe-4136459eab5d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:01.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b87d90-a8b0-44f4-93fe-4136459eab5d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:01.042220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f07da-e542-40a2-98ef-ce299e5c9ce4 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:01.042825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f07da-e542-40a2-98ef-ce299e5c9ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:01.042825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f07da-e542-40a2-98ef-ce299e5c9ce4 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:01.044962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 357/705] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:01.050894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e54762-822f-4448-b2c9-b6402ab7ba84 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:01.050894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e54762-822f-4448-b2c9-b6402ab7ba84 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:01.050894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e54762-822f-4448-b2c9-b6402ab7ba84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:01.076371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ed19f-b07f-4795-943c-17aa21d873b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:01.076371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ed19f-b07f-4795-943c-17aa21d873b7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:01.076371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ed19f-b07f-4795-943c-17aa21d873b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:01.076371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ed19f-b07f-4795-943c-17aa21d873b7 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:01.076795 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ed19f-b07f-4795-943c-17aa21d873b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:01.076795 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ed19f-b07f-4795-943c-17aa21d873b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:01.077891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ed19f-b07f-4795-943c-17aa21d873b7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:01.086437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:01.097355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-42e54762-822f-4448-b2c9-b6402ab7ba84 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:01.097707 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 349/706] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 6 01:00:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:01.098522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-42e54762-822f-4448-b2c9-b6402ab7ba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:01.105276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ed19f-b07f-4795-943c-17aa21d873b7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:01.189934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 358/707] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 01:00:01.191052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e54762-822f-4448-b2c9-b6402ab7ba84 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:01.230171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ed19f-b07f-4795-943c-17aa21d873b7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:01.286598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51d3d3-f594-47f0-95e1-d2ce47d9116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:01.287503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51d3d3-f594-47f0-95e1-d2ce47d9116d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:01.287782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51d3d3-f594-47f0-95e1-d2ce47d9116d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:01.288057 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51d3d3-f594-47f0-95e1-d2ce47d9116d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:01.297351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:01.361464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:01.371107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51d3d3-f594-47f0-95e1-d2ce47d9116d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:01.374207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51d3d3-f594-47f0-95e1-d2ce47d9116d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:01.384177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e54762-822f-4448-b2c9-b6402ab7ba84 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:01.472454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87104ad1-b473-4e46-b105-83628dd1eb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:01.473482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87104ad1-b473-4e46-b105-83628dd1eb15 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:01.473762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87104ad1-b473-4e46-b105-83628dd1eb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:01.474037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87104ad1-b473-4e46-b105-83628dd1eb15 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:01.474638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87104ad1-b473-4e46-b105-83628dd1eb15 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:01.476611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87104ad1-b473-4e46-b105-83628dd1eb15 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:01.489204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 350/708] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 01:00:01.490241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51d3d3-f594-47f0-95e1-d2ce47d9116d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-87104ad1-b473-4e46-b105-83628dd1eb15 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:01.493711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:01.495651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 359/709] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Sep 6 01:00:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:01.500139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87104ad1-b473-4e46-b105-83628dd1eb15 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:01.603318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:01.610841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51d3d3-f594-47f0-95e1-d2ce47d9116d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:01.622821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87104ad1-b473-4e46-b105-83628dd1eb15 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:01.646950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d9b12-8448-437c-8760-967661d54584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:01.647940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d9b12-8448-437c-8760-967661d54584 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:01.648482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d9b12-8448-437c-8760-967661d54584 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:01.648953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d9b12-8448-437c-8760-967661d54584 None admin] PATH_INFO: `/v3/services/network` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:01.649728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d9b12-8448-437c-8760-967661d54584 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:01.651347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d9b12-8448-437c-8760-967661d54584 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:01.656671 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-3c2d9b12-8448-437c-8760-967661d54584 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:01.664258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:01.665445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 01:00:01.666317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:01.667072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ab2e5-cde0-4959-b4cd-024db98c1736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:01.667072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ab2e5-cde0-4959-b4cd-024db98c1736 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:01.667072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ab2e5-cde0-4959-b4cd-024db98c1736 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:01.667072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ab2e5-cde0-4959-b4cd-024db98c1736 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:01.667842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ab2e5-cde0-4959-b4cd-024db98c1736 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:01.667842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ab2e5-cde0-4959-b4cd-024db98c1736 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:01.669406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ab2e5-cde0-4959-b4cd-024db98c1736 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:01.675295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 360/710] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Sep 6 01:00:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:01.675295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ab2e5-cde0-4959-b4cd-024db98c1736 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:01.675851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 351/711] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:01 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:01.676956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d9b12-8448-437c-8760-967661d54584 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:01.792362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ab2e5-cde0-4959-b4cd-024db98c1736 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:01.808412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d9b12-8448-437c-8760-967661d54584 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:01.838044 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8336e0c-c0d5-4fd5-8248-caedf2ff1907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:01.839071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336e0c-c0d5-4fd5-8248-caedf2ff1907 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:01.839509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336e0c-c0d5-4fd5-8248-caedf2ff1907 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:01.840048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336e0c-c0d5-4fd5-8248-caedf2ff1907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:01.849122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a10e2f-9699-4eaf-bc37-fa6f6a4de61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:01.849867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a10e2f-9699-4eaf-bc37-fa6f6a4de61b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:01.850249 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a10e2f-9699-4eaf-bc37-fa6f6a4de61b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:01.851076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a10e2f-9699-4eaf-bc37-fa6f6a4de61b None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:01.851867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a10e2f-9699-4eaf-bc37-fa6f6a4de61b None admin] RBAC: Adding query filter params (name=network) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:01.852277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a10e2f-9699-4eaf-bc37-fa6f6a4de61b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:01.854593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a10e2f-9699-4eaf-bc37-fa6f6a4de61b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:01.855211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8336e0c-c0d5-4fd5-8248-caedf2ff1907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:01.857416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8336e0c-c0d5-4fd5-8248-caedf2ff1907 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:01.864653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 352/712] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:01.864653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a10e2f-9699-4eaf-bc37-fa6f6a4de61b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f8336e0c-c0d5-4fd5-8248-caedf2ff1907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:01.882522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:01.883650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:01.884659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:01.884659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:01.884659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:01.890386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 361/713] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:01.890386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8336e0c-c0d5-4fd5-8248-caedf2ff1907 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:01.904046 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:01.939498 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:01.995222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a10e2f-9699-4eaf-bc37-fa6f6a4de61b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:02.006106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8336e0c-c0d5-4fd5-8248-caedf2ff1907 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:02.047120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb70d0-8dcd-47d6-a8aa-d9e258c16ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:02.047890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb70d0-8dcd-47d6-a8aa-d9e258c16ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:02.048007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb70d0-8dcd-47d6-a8aa-d9e258c16ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:02.048302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb70d0-8dcd-47d6-a8aa-d9e258c16ec9 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:02.048956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb70d0-8dcd-47d6-a8aa-d9e258c16ec9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:02.049259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb70d0-8dcd-47d6-a8aa-d9e258c16ec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:02.050796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb70d0-8dcd-47d6-a8aa-d9e258c16ec9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:02.057384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 362/714] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:02.057744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2d870-35ce-4557-852e-3f9c8a623f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:02.058179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb70d0-8dcd-47d6-a8aa-d9e258c16ec9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:02.058947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2d870-35ce-4557-852e-3f9c8a623f48 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:02.059439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2d870-35ce-4557-852e-3f9c8a623f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:02.060014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2d870-35ce-4557-852e-3f9c8a623f48 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:02.061420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2d870-35ce-4557-852e-3f9c8a623f48 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:02.062269 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2d870-35ce-4557-852e-3f9c8a623f48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:02.065150 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2d870-35ce-4557-852e-3f9c8a623f48 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:02.073773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 353/715] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Sep 6 01:00:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:02.178837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb70d0-8dcd-47d6-a8aa-d9e258c16ec9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:02.181551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:02.217487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea29c-cc90-434e-8721-ced3ace9b202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:02.218120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea29c-cc90-434e-8721-ced3ace9b202 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:02.218400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea29c-cc90-434e-8721-ced3ace9b202 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:02.218672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea29c-cc90-434e-8721-ced3ace9b202 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:02.219333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dea29c-cc90-434e-8721-ced3ace9b202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:02.219635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dea29c-cc90-434e-8721-ced3ace9b202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:02.221113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dea29c-cc90-434e-8721-ced3ace9b202 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:02.235703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 363/716] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:02.237340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1f87e-7a94-4199-af79-0275e1495717 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:02.237784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1f87e-7a94-4199-af79-0275e1495717 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:02.238185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1f87e-7a94-4199-af79-0275e1495717 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:02.240071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 354/717] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:02.242058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea29c-cc90-434e-8721-ced3ace9b202 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:02.245692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada697f-8a28-4887-a7a7-5622e7ea3f74 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:02.246280 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada697f-8a28-4887-a7a7-5622e7ea3f74 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:02.246689 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada697f-8a28-4887-a7a7-5622e7ea3f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:02.277709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-eada697f-8a28-4887-a7a7-5622e7ea3f74 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:02.279202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-eada697f-8a28-4887-a7a7-5622e7ea3f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:02.363851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea29c-cc90-434e-8721-ced3ace9b202 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:02.376340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 355/718] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 01:00:02.406104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1013ba-9f17-43ee-b1e6-bf355ed0e908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:02.407080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1013ba-9f17-43ee-b1e6-bf355ed0e908 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:02.407539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1013ba-9f17-43ee-b1e6-bf355ed0e908 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:02.408017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1013ba-9f17-43ee-b1e6-bf355ed0e908 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:02.415881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1013ba-9f17-43ee-b1e6-bf355ed0e908 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:02.417750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1013ba-9f17-43ee-b1e6-bf355ed0e908 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-bd1013ba-9f17-43ee-b1e6-bf355ed0e908 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:02.431428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:02.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:02.433843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:02.433843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:02.433843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:02.433843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:02.433843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:02.433843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:02.433843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:02.433843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:02.436933 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 364/719] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:02.443917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada697f-8a28-4887-a7a7-5622e7ea3f74 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:02.477290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:02.582070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada697f-8a28-4887-a7a7-5622e7ea3f74 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:02.623875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033aaae-f78b-4836-bd59-ff916510921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:02.624521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033aaae-f78b-4836-bd59-ff916510921f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:02.624800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033aaae-f78b-4836-bd59-ff916510921f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:02.625070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033aaae-f78b-4836-bd59-ff916510921f None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:02.625763 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033aaae-f78b-4836-bd59-ff916510921f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:02.626066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033aaae-f78b-4836-bd59-ff916510921f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:02.627561 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033aaae-f78b-4836-bd59-ff916510921f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:02.640053 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 356/720] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:02.645917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1013ba-9f17-43ee-b1e6-bf355ed0e908 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:02.701591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:02.810694 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033aaae-f78b-4836-bd59-ff916510921f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:02.817130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1013ba-9f17-43ee-b1e6-bf355ed0e908 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:02.866014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d848ee9-4217-45a5-a2a9-865f04a5e6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:02.866647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d848ee9-4217-45a5-a2a9-865f04a5e6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:02.867009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d848ee9-4217-45a5-a2a9-865f04a5e6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:02.867194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d848ee9-4217-45a5-a2a9-865f04a5e6f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:02.867910 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d848ee9-4217-45a5-a2a9-865f04a5e6f6 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=42b9c25e98fe4b1bbc33a601d4150071) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:02.868217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d848ee9-4217-45a5-a2a9-865f04a5e6f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:02.869806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d848ee9-4217-45a5-a2a9-865f04a5e6f6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:02.884984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 365/721] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:02 2022] GET /identity/v3/role_assignments?user.id=42b9c25e98fe4b1bbc33a601d4150071&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:02.908176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:02.916618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b84ee-e750-46ab-883c-cd9da5d904fb None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:02.917078 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b84ee-e750-46ab-883c-cd9da5d904fb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:02.917194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b84ee-e750-46ab-883c-cd9da5d904fb None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:02.918513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 366/722] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:00:02.923760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508607c-38fe-40f1-b10e-bd5565b71286 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:02.928537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508607c-38fe-40f1-b10e-bd5565b71286 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:02.928537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508607c-38fe-40f1-b10e-bd5565b71286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:02.953509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033aaae-f78b-4836-bd59-ff916510921f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:02.956205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5508607c-38fe-40f1-b10e-bd5565b71286 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:02.957485 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5508607c-38fe-40f1-b10e-bd5565b71286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:03.057490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 367/723] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 01:00:03.065324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bdb8f-36e0-4163-8590-f87e94ccdc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:03.066011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bdb8f-36e0-4163-8590-f87e94ccdc83 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:03.066291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bdb8f-36e0-4163-8590-f87e94ccdc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:03.066571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bdb8f-36e0-4163-8590-f87e94ccdc83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:03.086511 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bdb8f-36e0-4163-8590-f87e94ccdc83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-297bdb8f-36e0-4163-8590-f87e94ccdc83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:03.097645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:03.099175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:03.100653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:03.100653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:03.100653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:03.100653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:03.100653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:03.100653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:03.100653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:03.100653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:03.100653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:03.100653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:03.100653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:03.100653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:03.103141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 357/724] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:00:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:03.109725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508607c-38fe-40f1-b10e-bd5565b71286 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:03.129989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:03.217968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508607c-38fe-40f1-b10e-bd5565b71286 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:03.253469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac5871-91cb-48c5-9c6d-152084f3414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:03.254090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac5871-91cb-48c5-9c6d-152084f3414c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:03.254365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac5871-91cb-48c5-9c6d-152084f3414c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:03.254635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac5871-91cb-48c5-9c6d-152084f3414c None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:03.255305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac5871-91cb-48c5-9c6d-152084f3414c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:03.255604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac5871-91cb-48c5-9c6d-152084f3414c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:03.257067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac5871-91cb-48c5-9c6d-152084f3414c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:03.266046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 368/725] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:00:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:03.271629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bdb8f-36e0-4163-8590-f87e94ccdc83 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:03.409843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bdb8f-36e0-4163-8590-f87e94ccdc83 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:03.451882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fd764-b963-4872-8b23-2ff1c2402dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:03.452589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fd764-b963-4872-8b23-2ff1c2402dda None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:03.452831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fd764-b963-4872-8b23-2ff1c2402dda None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:03.453101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fd764-b963-4872-8b23-2ff1c2402dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:03.463007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:03.467646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fd764-b963-4872-8b23-2ff1c2402dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:03.469308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fd764-b963-4872-8b23-2ff1c2402dda None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-dc5fd764-b963-4872-8b23-2ff1c2402dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:03.487191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:03.488179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:03.489134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:03.489134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:03.489134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:03.489134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 358/726] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:03.489367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac5871-91cb-48c5-9c6d-152084f3414c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:03.496993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fd764-b963-4872-8b23-2ff1c2402dda None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:03.612039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fd764-b963-4872-8b23-2ff1c2402dda None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:03.655779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fbeb1-4f6c-4d38-bb79-fb2ce0d4b3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:03.656421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fbeb1-4f6c-4d38-bb79-fb2ce0d4b3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:03.656705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fbeb1-4f6c-4d38-bb79-fb2ce0d4b3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:03.656975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fbeb1-4f6c-4d38-bb79-fb2ce0d4b3b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:03.659015 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fbeb1-4f6c-4d38-bb79-fb2ce0d4b3b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:03.659124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:03.659320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fbeb1-4f6c-4d38-bb79-fb2ce0d4b3b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:03.661135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fbeb1-4f6c-4d38-bb79-fb2ce0d4b3b7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:03.688353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 359/727] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:03.691229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac5871-91cb-48c5-9c6d-152084f3414c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:03.693604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fbeb1-4f6c-4d38-bb79-fb2ce0d4b3b7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:03.765587 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f66e73-a686-4a91-8bbf-42903081ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:03.766243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f66e73-a686-4a91-8bbf-42903081ec79 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:03.766526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f66e73-a686-4a91-8bbf-42903081ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:03.766800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f66e73-a686-4a91-8bbf-42903081ec79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:03.773949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:03.793813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f66e73-a686-4a91-8bbf-42903081ec79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b1f66e73-a686-4a91-8bbf-42903081ec79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:03.799331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:03.800318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:03.801215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:03.801215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:03.801215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:03.801215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:03.801215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:03.801215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:03.801215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:03.801215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:03.801215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:03.801215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:03.801215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 01:00:03.801215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:03.808873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 369/728] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 01:00:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:03.814443 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f66e73-a686-4a91-8bbf-42903081ec79 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:03.826764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fbeb1-4f6c-4d38-bb79-fb2ce0d4b3b7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:03.860897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b76535-0c96-4664-87f8-cbb88b11919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:03.861532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b76535-0c96-4664-87f8-cbb88b11919c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:03.861813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b76535-0c96-4664-87f8-cbb88b11919c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:03.862085 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b76535-0c96-4664-87f8-cbb88b11919c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:03.869897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b76535-0c96-4664-87f8-cbb88b11919c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:03.871417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b76535-0c96-4664-87f8-cbb88b11919c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f6b76535-0c96-4664-87f8-cbb88b11919c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:03.882964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:03.883905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:03.884893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:03.884893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:03.884893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:03.884893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:03.884893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:03.884893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:03.884893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:03.884893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:03.884893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 01:00:03.884893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:03.884893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 360/729] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:00:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:03.900674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b76535-0c96-4664-87f8-cbb88b11919c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:03.993833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f66e73-a686-4a91-8bbf-42903081ec79 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:04.060483 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54d59c-3d17-43ce-9234-556973b506f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:04.061125 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54d59c-3d17-43ce-9234-556973b506f8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:04.061362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54d59c-3d17-43ce-9234-556973b506f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:04.061630 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54d59c-3d17-43ce-9234-556973b506f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:04.062297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54d59c-3d17-43ce-9234-556973b506f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:04.062591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54d59c-3d17-43ce-9234-556973b506f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:04.064009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54d59c-3d17-43ce-9234-556973b506f8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:04.079010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 370/730] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 01:00:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:04.084648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54d59c-3d17-43ce-9234-556973b506f8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:04.095733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:04.099419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b76535-0c96-4664-87f8-cbb88b11919c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:04.116897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:04.163210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ad1ce-5f57-41d0-9059-cacd38ea0ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:04.163823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ad1ce-5f57-41d0-9059-cacd38ea0ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:04.164093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ad1ce-5f57-41d0-9059-cacd38ea0ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:04.164387 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ad1ce-5f57-41d0-9059-cacd38ea0ec7 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:04.165113 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ad1ce-5f57-41d0-9059-cacd38ea0ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:04.165409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ad1ce-5f57-41d0-9059-cacd38ea0ec7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:04.166872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ad1ce-5f57-41d0-9059-cacd38ea0ec7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:04.199297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 361/731] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Sep 6 01:00:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:04.204846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ad1ce-5f57-41d0-9059-cacd38ea0ec7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:04.265550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54d59c-3d17-43ce-9234-556973b506f8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:04.323685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75741a4-109b-493d-a04e-39d10e8f61ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:04.324235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75741a4-109b-493d-a04e-39d10e8f61ab None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:04.324536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75741a4-109b-493d-a04e-39d10e8f61ab None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:04.324802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75741a4-109b-493d-a04e-39d10e8f61ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:04.343931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75741a4-109b-493d-a04e-39d10e8f61ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:04.345492 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75741a4-109b-493d-a04e-39d10e8f61ab None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e75741a4-109b-493d-a04e-39d10e8f61ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:04.369945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:04.370981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:04.371896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:04.371896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:04.371896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:04.373535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 371/732] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:04.377325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75741a4-109b-493d-a04e-39d10e8f61ab None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:04.389047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ad1ce-5f57-41d0-9059-cacd38ea0ec7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:04.439064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d4fa1-32ca-4e78-b012-697fb2426fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:04.439739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d4fa1-32ca-4e78-b012-697fb2426fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:04.439971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d4fa1-32ca-4e78-b012-697fb2426fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:04.440196 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d4fa1-32ca-4e78-b012-697fb2426fb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:04.462838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:04.479796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:04.516171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d4fa1-32ca-4e78-b012-697fb2426fb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:04.517893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d4fa1-32ca-4e78-b012-697fb2426fb7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:04.530941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75741a4-109b-493d-a04e-39d10e8f61ab None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:04.576116 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cee959-05fd-4fb5-ad8f-b25b468e3a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:04.577247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cee959-05fd-4fb5-ad8f-b25b468e3a18 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:04.577672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cee959-05fd-4fb5-ad8f-b25b468e3a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:04.578251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cee959-05fd-4fb5-ad8f-b25b468e3a18 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:04.579465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cee959-05fd-4fb5-ad8f-b25b468e3a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:04.579913 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cee959-05fd-4fb5-ad8f-b25b468e3a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:04.581926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cee959-05fd-4fb5-ad8f-b25b468e3a18 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:04.599703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 372/733] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:04.601599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fa8ac-5d88-4048-a986-ce5565068ef3 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:04.602181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fa8ac-5d88-4048-a986-ce5565068ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:04.602598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fa8ac-5d88-4048-a986-ce5565068ef3 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:04.604887 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 373/734] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:04.605882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fa8ac-5d88-4048-a986-ce5565068ef3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:04.623255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 362/735] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 01:00:04.624387 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b549-a6e4-4a57-b52c-e959028c661f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:04.624773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b549-a6e4-4a57-b52c-e959028c661f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:04.625133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b549-a6e4-4a57-b52c-e959028c661f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:04.643539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-95b5b549-a6e4-4a57-b52c-e959028c661f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:04.644756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-95b5b549-a6e4-4a57-b52c-e959028c661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:04.716192 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:04.723502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 363/736] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 01:00:04.724953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf95eb5-73fc-4458-918b-a422bf583830 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:04.725234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf95eb5-73fc-4458-918b-a422bf583830 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:04.725507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf95eb5-73fc-4458-918b-a422bf583830 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:04.726858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 364/737] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:04.727411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf95eb5-73fc-4458-918b-a422bf583830 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:04.733629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fa8ac-5d88-4048-a986-ce5565068ef3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:04.753706 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:04.782442 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f03d4-780a-4024-bb7c-440031e9d143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:04.783077 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f03d4-780a-4024-bb7c-440031e9d143 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:04.783349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f03d4-780a-4024-bb7c-440031e9d143 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:04.783614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f03d4-780a-4024-bb7c-440031e9d143 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:04.795044 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f03d4-780a-4024-bb7c-440031e9d143 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:04.797419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f03d4-780a-4024-bb7c-440031e9d143 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6a6f03d4-780a-4024-bb7c-440031e9d143 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:04.815197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:04.816395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:04.817599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:04.817599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:04.817599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:04.817599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:04.817599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:04.817599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:04.817599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:04.817599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:04.817599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 01:00:04.817599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:04.820209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 374/738] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 6 01:00:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:04.822239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270dda7-6a10-4e60-88c4-58944ac2f915 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:04.822666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270dda7-6a10-4e60-88c4-58944ac2f915 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:04.823335 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270dda7-6a10-4e60-88c4-58944ac2f915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:04.849039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d270dda7-6a10-4e60-88c4-58944ac2f915 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:04.850466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d270dda7-6a10-4e60-88c4-58944ac2f915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:04.865328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf95eb5-73fc-4458-918b-a422bf583830 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:04.906014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b37efd-0605-4b69-ade1-c1e0b6f111c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:04.906795 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37efd-0605-4b69-ade1-c1e0b6f111c0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:04.907162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37efd-0605-4b69-ade1-c1e0b6f111c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:04.907530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37efd-0605-4b69-ade1-c1e0b6f111c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:04.918888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b37efd-0605-4b69-ade1-c1e0b6f111c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:04.920654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b37efd-0605-4b69-ade1-c1e0b6f111c0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c8b37efd-0605-4b69-ade1-c1e0b6f111c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:04.936815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:04.938016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:04.939161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:04.939161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:04.939161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:04.940540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 365/739] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:04.941481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b37efd-0605-4b69-ade1-c1e0b6f111c0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:04.956801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 375/740] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 01:00:04.957387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270dda7-6a10-4e60-88c4-58944ac2f915 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:05.028053 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:05.091371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b37efd-0605-4b69-ade1-c1e0b6f111c0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:05.095600 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270dda7-6a10-4e60-88c4-58944ac2f915 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:05.098508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:05.126245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9452b4e-eac9-4145-9145-21b2c382f37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:05.126783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9452b4e-eac9-4145-9145-21b2c382f37e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:05.127062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9452b4e-eac9-4145-9145-21b2c382f37e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:05.127336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9452b4e-eac9-4145-9145-21b2c382f37e None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:05.128068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9452b4e-eac9-4145-9145-21b2c382f37e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:05.128406 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9452b4e-eac9-4145-9145-21b2c382f37e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:05.129946 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9452b4e-eac9-4145-9145-21b2c382f37e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:05.134588 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76fef-11ed-4994-bed5-4c10aeb55fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:05.135356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76fef-11ed-4994-bed5-4c10aeb55fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:05.135791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76fef-11ed-4994-bed5-4c10aeb55fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:05.136225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76fef-11ed-4994-bed5-4c10aeb55fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:05.137025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd76fef-11ed-4994-bed5-4c10aeb55fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:05.137479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd76fef-11ed-4994-bed5-4c10aeb55fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:05.139208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd76fef-11ed-4994-bed5-4c10aeb55fb8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:05.147701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 366/741] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Sep 6 01:00:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:05.148742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9452b4e-eac9-4145-9145-21b2c382f37e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:05.155615 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 376/742] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:05.157111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7be963-56f3-4e2d-9e69-0d83d6660db1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:05.157531 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7be963-56f3-4e2d-9e69-0d83d6660db1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:05.157951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7be963-56f3-4e2d-9e69-0d83d6660db1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:05.159183 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 377/743] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:05.159857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7be963-56f3-4e2d-9e69-0d83d6660db1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:05.249646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9452b4e-eac9-4145-9145-21b2c382f37e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:05.258975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:05.264794 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7be963-56f3-4e2d-9e69-0d83d6660db1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:05.284022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c3b8e-201d-4584-a392-36585fd9d012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:05.284672 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c3b8e-201d-4584-a392-36585fd9d012 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:05.284953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c3b8e-201d-4584-a392-36585fd9d012 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:05.285226 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c3b8e-201d-4584-a392-36585fd9d012 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:05.286231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c3b8e-201d-4584-a392-36585fd9d012 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:05.287680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c3b8e-201d-4584-a392-36585fd9d012 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:05.299259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24322e-4b7b-493e-9dda-5398f98a014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:05.299822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24322e-4b7b-493e-9dda-5398f98a014e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:05.300103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24322e-4b7b-493e-9dda-5398f98a014e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:05.300439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24322e-4b7b-493e-9dda-5398f98a014e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:05.308342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 367/744] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 01:00:05 2022] POST /identity/v3/services => generated 251 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:05.308342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c3b8e-201d-4584-a392-36585fd9d012 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:05.340683 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:05.385827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24322e-4b7b-493e-9dda-5398f98a014e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:05.387351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24322e-4b7b-493e-9dda-5398f98a014e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:05.436440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c3b8e-201d-4584-a392-36585fd9d012 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:05.480502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a296f3-6578-4937-bbd2-a1f56ada4f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:05.481264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a296f3-6578-4937-bbd2-a1f56ada4f71 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:05.481891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a296f3-6578-4937-bbd2-a1f56ada4f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:05.482182 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a296f3-6578-4937-bbd2-a1f56ada4f71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:05.490152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a296f3-6578-4937-bbd2-a1f56ada4f71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:05.491784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a296f3-6578-4937-bbd2-a1f56ada4f71 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:05.502167 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 378/745] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 01:00:05.503579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7991e2-e8d6-4409-a80c-7426e51a518c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:05.503863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7991e2-e8d6-4409-a80c-7426e51a518c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:05.504134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7991e2-e8d6-4409-a80c-7426e51a518c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-14a296f3-6578-4937-bbd2-a1f56ada4f71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:05.504954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:05.505817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:05.506718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:05.506718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:05.506718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:05.506718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:05.506718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:05.506718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:05.506718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:05.506718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:05.508441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 368/746] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:05.509322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a296f3-6578-4937-bbd2-a1f56ada4f71 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:05.523631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3a7991e2-e8d6-4409-a80c-7426e51a518c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:05.524864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3a7991e2-e8d6-4409-a80c-7426e51a518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:05.538526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:05.592451 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:05.602345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 379/747] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 01:00:05.603412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7991e2-e8d6-4409-a80c-7426e51a518c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:05.627372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a296f3-6578-4937-bbd2-a1f56ada4f71 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:05.670126 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da407b6-0ade-47f6-925c-e288b845fd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:05.670656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da407b6-0ade-47f6-925c-e288b845fd35 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:05.670935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da407b6-0ade-47f6-925c-e288b845fd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:05.671197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da407b6-0ade-47f6-925c-e288b845fd35 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:05.672012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da407b6-0ade-47f6-925c-e288b845fd35 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:05.674051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da407b6-0ade-47f6-925c-e288b845fd35 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:05.696439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 369/748] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 01:00:05 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:05.697745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da407b6-0ade-47f6-925c-e288b845fd35 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:05.740168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7991e2-e8d6-4409-a80c-7426e51a518c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:05.822059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd82a7a-585d-44ce-8e13-2ae889f47f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:05.824527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd82a7a-585d-44ce-8e13-2ae889f47f4e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:05.825357 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd82a7a-585d-44ce-8e13-2ae889f47f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:05.826559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd82a7a-585d-44ce-8e13-2ae889f47f4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:05.849406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd82a7a-585d-44ce-8e13-2ae889f47f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:05.851508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd82a7a-585d-44ce-8e13-2ae889f47f4e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-abd82a7a-585d-44ce-8e13-2ae889f47f4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:05.882064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:05.883386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:05.884355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:05.884355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:05.884355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:05.884537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:05.887973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 380/749] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:05.888990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd82a7a-585d-44ce-8e13-2ae889f47f4e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:05.906596 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da407b6-0ade-47f6-925c-e288b845fd35 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:05.942578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:05.960397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0ba57-21cf-407b-ad26-cdfd6f413f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:05.960397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0ba57-21cf-407b-ad26-cdfd6f413f2d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:05.960397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0ba57-21cf-407b-ad26-cdfd6f413f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:05.960397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0ba57-21cf-407b-ad26-cdfd6f413f2d None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:05.960841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0ba57-21cf-407b-ad26-cdfd6f413f2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:05.960841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0ba57-21cf-407b-ad26-cdfd6f413f2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:05.960841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0ba57-21cf-407b-ad26-cdfd6f413f2d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:05.976633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 370/750] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:05.977820 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0ba57-21cf-407b-ad26-cdfd6f413f2d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:06.020942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd82a7a-585d-44ce-8e13-2ae889f47f4e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:06.068465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040f963-0d8c-40ee-81be-ea9c5d61e1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:06.069405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040f963-0d8c-40ee-81be-ea9c5d61e1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:06.069864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040f963-0d8c-40ee-81be-ea9c5d61e1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:06.070340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040f963-0d8c-40ee-81be-ea9c5d61e1d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:06.081543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040f963-0d8c-40ee-81be-ea9c5d61e1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3040f963-0d8c-40ee-81be-ea9c5d61e1d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:06.087158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:06.088112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:06.089053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:06.089053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:06.089053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:06.089053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:06.089053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:06.089053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:06.089053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:06.089053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:06.089053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:06.089053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:06.089053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:06.089053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:06.091524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 381/751] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:00:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:06.092675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040f963-0d8c-40ee-81be-ea9c5d61e1d9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:06.094454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0ba57-21cf-407b-ad26-cdfd6f413f2d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:06.131569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ea1bf-535e-4a26-b1a4-6a1ae01629df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:06.132209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea1bf-535e-4a26-b1a4-6a1ae01629df None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:06.132525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea1bf-535e-4a26-b1a4-6a1ae01629df None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:06.132796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea1bf-535e-4a26-b1a4-6a1ae01629df None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:06.133435 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ea1bf-535e-4a26-b1a4-6a1ae01629df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:06.133739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ea1bf-535e-4a26-b1a4-6a1ae01629df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:06.135148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ea1bf-535e-4a26-b1a4-6a1ae01629df None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:06.152925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 371/752] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:06.152925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ea1bf-535e-4a26-b1a4-6a1ae01629df None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:06.153202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:06.204965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040f963-0d8c-40ee-81be-ea9c5d61e1d9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:06.207221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:06.243299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d4070-8a71-46af-a4e7-93244cf76a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:06.244331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d4070-8a71-46af-a4e7-93244cf76a69 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:06.244865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d4070-8a71-46af-a4e7-93244cf76a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:06.245334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d4070-8a71-46af-a4e7-93244cf76a69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:06.246302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d4070-8a71-46af-a4e7-93244cf76a69 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=d7e2ea2ab4ae4a14be9bd35af20080c6) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:06.246828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d4070-8a71-46af-a4e7-93244cf76a69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:06.248666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d4070-8a71-46af-a4e7-93244cf76a69 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:06.260739 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 382/753] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:06 2022] GET /identity/v3/role_assignments?user.id=d7e2ea2ab4ae4a14be9bd35af20080c6&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:06.262022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d4070-8a71-46af-a4e7-93244cf76a69 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:06.265270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ea1bf-535e-4a26-b1a4-6a1ae01629df None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:06.305169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1b6c0-a144-44ec-b3d1-92ee06f1be78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:06.305808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1b6c0-a144-44ec-b3d1-92ee06f1be78 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:06.306080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1b6c0-a144-44ec-b3d1-92ee06f1be78 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:06.306354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1b6c0-a144-44ec-b3d1-92ee06f1be78 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:06.307024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1b6c0-a144-44ec-b3d1-92ee06f1be78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:06.307339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1b6c0-a144-44ec-b3d1-92ee06f1be78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:06.308793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1b6c0-a144-44ec-b3d1-92ee06f1be78 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:06.320449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 372/754] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:00:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:06.329493 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1b6c0-a144-44ec-b3d1-92ee06f1be78 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:06.430610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d4070-8a71-46af-a4e7-93244cf76a69 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:06.475430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae4db5-45fc-4d71-82d8-21e69dffec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:06.476326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae4db5-45fc-4d71-82d8-21e69dffec20 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:06.476775 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae4db5-45fc-4d71-82d8-21e69dffec20 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:06.477191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae4db5-45fc-4d71-82d8-21e69dffec20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:06.487115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae4db5-45fc-4d71-82d8-21e69dffec20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:06.488783 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae4db5-45fc-4d71-82d8-21e69dffec20 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:06.489246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-32ae4db5-45fc-4d71-82d8-21e69dffec20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:06.502835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:06.503976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:06.505232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:06.505232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:06.505232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:06.505232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:06.505232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:06.505232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:06.505232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:06.505232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:06.506847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 383/755] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:06.515327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae4db5-45fc-4d71-82d8-21e69dffec20 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:06.538938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1b6c0-a144-44ec-b3d1-92ee06f1be78 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:06.571000 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:06.608399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1340aae-1ae0-486d-976c-3c988e3e1df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:06.609544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1340aae-1ae0-486d-976c-3c988e3e1df9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:06.610926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1340aae-1ae0-486d-976c-3c988e3e1df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:06.612158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1340aae-1ae0-486d-976c-3c988e3e1df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:06.630026 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1340aae-1ae0-486d-976c-3c988e3e1df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:06.632691 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1340aae-1ae0-486d-976c-3c988e3e1df9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f1340aae-1ae0-486d-976c-3c988e3e1df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:06.649425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:06.650437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:06.651432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:06.651432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:06.651432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:06.653711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 373/756] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:06.662910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1340aae-1ae0-486d-976c-3c988e3e1df9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:06.728359 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae4db5-45fc-4d71-82d8-21e69dffec20 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:06.781082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff9c3d-4d45-4086-ad5c-a43d880ea965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:06.781714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff9c3d-4d45-4086-ad5c-a43d880ea965 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:06.781993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff9c3d-4d45-4086-ad5c-a43d880ea965 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:06.782267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff9c3d-4d45-4086-ad5c-a43d880ea965 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:06.782983 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff9c3d-4d45-4086-ad5c-a43d880ea965 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:06.783288 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff9c3d-4d45-4086-ad5c-a43d880ea965 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:06.784894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff9c3d-4d45-4086-ad5c-a43d880ea965 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:06.799957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 384/757] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:06.809632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff9c3d-4d45-4086-ad5c-a43d880ea965 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:06.836829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1340aae-1ae0-486d-976c-3c988e3e1df9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:06.865765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:06.932708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:06.942410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa528e-1a50-4662-8a43-9cb0de6b6904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:06.943045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa528e-1a50-4662-8a43-9cb0de6b6904 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:06.943381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff9c3d-4d45-4086-ad5c-a43d880ea965 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:06.947360 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa528e-1a50-4662-8a43-9cb0de6b6904 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:06.948052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa528e-1a50-4662-8a43-9cb0de6b6904 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:06.952698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa528e-1a50-4662-8a43-9cb0de6b6904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:06.953021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa528e-1a50-4662-8a43-9cb0de6b6904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:06.954589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa528e-1a50-4662-8a43-9cb0de6b6904 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:06.984736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 374/758] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:06.994006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa528e-1a50-4662-8a43-9cb0de6b6904 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:07.021773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47697d05-80c8-488f-8d01-a0c8f7ca5938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:07.022399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47697d05-80c8-488f-8d01-a0c8f7ca5938 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:07.022678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47697d05-80c8-488f-8d01-a0c8f7ca5938 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:07.022948 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47697d05-80c8-488f-8d01-a0c8f7ca5938 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:07.027155 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47697d05-80c8-488f-8d01-a0c8f7ca5938 None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=d56912bcbf0b4ce9b29ace7606deb827) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:07.027476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47697d05-80c8-488f-8d01-a0c8f7ca5938 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:07.030043 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47697d05-80c8-488f-8d01-a0c8f7ca5938 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:07.045202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 385/759] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:06 2022] GET /identity/v3/role_assignments?user.id=d56912bcbf0b4ce9b29ace7606deb827&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:07.134338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa528e-1a50-4662-8a43-9cb0de6b6904 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:07.173331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8a644-fd80-4acd-a54c-44d61381d68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:07.173993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8a644-fd80-4acd-a54c-44d61381d68d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:07.174271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8a644-fd80-4acd-a54c-44d61381d68d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:07.174545 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8a644-fd80-4acd-a54c-44d61381d68d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:07.183287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8a644-fd80-4acd-a54c-44d61381d68d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:07.185066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8a644-fd80-4acd-a54c-44d61381d68d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-94a8a644-fd80-4acd-a54c-44d61381d68d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:07.199045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:07.200100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:07.201831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:07.201831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:07.201831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:07.201831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:07.201831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:07.201831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:07.201831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:07.201831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:07.201831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 01:00:07.201831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:07.201831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 375/760] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 6 01:00:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:07.206360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47697d05-80c8-488f-8d01-a0c8f7ca5938 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:07.314798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47697d05-80c8-488f-8d01-a0c8f7ca5938 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:07.350088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a91017-b6c9-48e3-8816-5d09548241ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:07.350708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a91017-b6c9-48e3-8816-5d09548241ba None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:07.350989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a91017-b6c9-48e3-8816-5d09548241ba None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:07.351261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a91017-b6c9-48e3-8816-5d09548241ba None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:07.351998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a91017-b6c9-48e3-8816-5d09548241ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:07.352334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a91017-b6c9-48e3-8816-5d09548241ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:07.353841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a91017-b6c9-48e3-8816-5d09548241ba None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:07.374140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 386/761] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 6 01:00:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:07.379803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8a644-fd80-4acd-a54c-44d61381d68d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:07.424929 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:07.490537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8a644-fd80-4acd-a54c-44d61381d68d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:07.504046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56509956-001e-425d-a7ea-eaf0beb7880f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:07.504385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56509956-001e-425d-a7ea-eaf0beb7880f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:07.504648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56509956-001e-425d-a7ea-eaf0beb7880f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:07.505989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 387/762] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:00:07.511322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe725d-f34d-4fc8-9c29-27b92eae89e4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:07.511639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe725d-f34d-4fc8-9c29-27b92eae89e4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:07.511882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe725d-f34d-4fc8-9c29-27b92eae89e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:07.530587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e61f0b-e118-4a05-b82e-866bc5945840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:07.531236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e61f0b-e118-4a05-b82e-866bc5945840 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:07.531517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e61f0b-e118-4a05-b82e-866bc5945840 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:07.531797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e61f0b-e118-4a05-b82e-866bc5945840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:07.543979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e61f0b-e118-4a05-b82e-866bc5945840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:07.546179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e61f0b-e118-4a05-b82e-866bc5945840 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-a6e61f0b-e118-4a05-b82e-866bc5945840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:07.562669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:07.563685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:07.564637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:07.564637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:07.564637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:07.568449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 376/763] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:07.569336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e8fe725d-f34d-4fc8-9c29-27b92eae89e4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:07.569993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e61f0b-e118-4a05-b82e-866bc5945840 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:07.570563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e8fe725d-f34d-4fc8-9c29-27b92eae89e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:07.572881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:07.677575 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:07.686241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e61f0b-e118-4a05-b82e-866bc5945840 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:07.759055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f673-ecb8-4beb-adb9-37596fcc93c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:07.759679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f673-ecb8-4beb-adb9-37596fcc93c1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:07.759954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f673-ecb8-4beb-adb9-37596fcc93c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:07.760224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f673-ecb8-4beb-adb9-37596fcc93c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:07.760903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0f673-ecb8-4beb-adb9-37596fcc93c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:07.761207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0f673-ecb8-4beb-adb9-37596fcc93c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:07.766043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0f673-ecb8-4beb-adb9-37596fcc93c1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:07.773342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 388/764] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:07.781694 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 377/765] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:07.787519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe725d-f34d-4fc8-9c29-27b92eae89e4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:07.888517 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe725d-f34d-4fc8-9c29-27b92eae89e4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:07.933568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466722c-b6c5-4dd7-af89-f125e90c5faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:07.934227 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466722c-b6c5-4dd7-af89-f125e90c5faf None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:07.934537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466722c-b6c5-4dd7-af89-f125e90c5faf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:07.934811 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466722c-b6c5-4dd7-af89-f125e90c5faf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:07.942271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466722c-b6c5-4dd7-af89-f125e90c5faf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:07.943784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466722c-b6c5-4dd7-af89-f125e90c5faf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:07.945574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:07.957689 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dd8cd-44bc-4937-b51d-09a69a6b0e0f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:07.958024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dd8cd-44bc-4937-b51d-09a69a6b0e0f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:07.958244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dd8cd-44bc-4937-b51d-09a69a6b0e0f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e466722c-b6c5-4dd7-af89-f125e90c5faf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:07.958361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:07.959213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:07.960156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:07.960156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:07.960156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:07.960156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:07.960156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:07.960156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:07.960156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:07.960156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:07.960720 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 378/766] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:07.962656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 389/767] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:07.969016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dd8cd-44bc-4937-b51d-09a69a6b0e0f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:07.969914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2393508-43df-4eb8-815b-1a395a273dcb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:07.970404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2393508-43df-4eb8-815b-1a395a273dcb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:07.970892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2393508-43df-4eb8-815b-1a395a273dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:08.000119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a2393508-43df-4eb8-815b-1a395a273dcb None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:08.001645 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a2393508-43df-4eb8-815b-1a395a273dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:08.094207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dd8cd-44bc-4937-b51d-09a69a6b0e0f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:08.130857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e63c55-3c8f-404a-9a75-0bd6465801a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:08.131847 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e63c55-3c8f-404a-9a75-0bd6465801a2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:08.132357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e63c55-3c8f-404a-9a75-0bd6465801a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:08.132846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e63c55-3c8f-404a-9a75-0bd6465801a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:08.134606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e63c55-3c8f-404a-9a75-0bd6465801a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:08.135143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e63c55-3c8f-404a-9a75-0bd6465801a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:08.136876 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e63c55-3c8f-404a-9a75-0bd6465801a2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:08.150072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 379/768] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:08.156638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e63c55-3c8f-404a-9a75-0bd6465801a2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:08.172656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:08.225043 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 390/769] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:00:08.225796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2393508-43df-4eb8-815b-1a395a273dcb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:08.295741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e63c55-3c8f-404a-9a75-0bd6465801a2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:08.332673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2393508-43df-4eb8-815b-1a395a273dcb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:08.368784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0a2f3-a799-44c0-9049-c93544b876f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:08.369459 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a2f3-a799-44c0-9049-c93544b876f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:08.369740 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a2f3-a799-44c0-9049-c93544b876f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:08.370016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a2f3-a799-44c0-9049-c93544b876f2 None admin] PATH_INFO: `/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/42b9c25e98fe4b1bbc33a601d4150071/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:08.373550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0a2f3-a799-44c0-9049-c93544b876f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d31b0823b61d4895accd0f27e6006b08, user_id=42b9c25e98fe4b1bbc33a601d4150071, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:08.375053 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0a2f3-a799-44c0-9049-c93544b876f2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:08.385757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:08.387090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e5250-fbeb-4b47-bf66-04e5cf2dfe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:08.387852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e5250-fbeb-4b47-bf66-04e5cf2dfe4a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:08.388250 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e5250-fbeb-4b47-bf66-04e5cf2dfe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:08.388447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e5250-fbeb-4b47-bf66-04e5cf2dfe4a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:08.389123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e5250-fbeb-4b47-bf66-04e5cf2dfe4a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:08.390671 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e5250-fbeb-4b47-bf66-04e5cf2dfe4a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:08.399677 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 380/770] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 01:00:08 2022] PUT /identity/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/42b9c25e98fe4b1bbc33a601d4150071/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-955e5250-fbeb-4b47-bf66-04e5cf2dfe4a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:08.408320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:08.409395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:08.410261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 391/771] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Sep 6 01:00:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:08.416464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0a2f3-a799-44c0-9049-c93544b876f2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:08.506736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:08.549782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0a2f3-a799-44c0-9049-c93544b876f2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:08.600169 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf05ad8-3264-4342-98da-047f9ce9e5b8 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:08.600432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b3948-1da9-4c1a-afe0-d7ebaf0cc321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:08.600940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b3948-1da9-4c1a-afe0-d7ebaf0cc321 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:08.601214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf05ad8-3264-4342-98da-047f9ce9e5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:08.601350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b3948-1da9-4c1a-afe0-d7ebaf0cc321 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:08.601535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b3948-1da9-4c1a-afe0-d7ebaf0cc321 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:08.601631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf05ad8-3264-4342-98da-047f9ce9e5b8 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:08.602115 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b3948-1da9-4c1a-afe0-d7ebaf0cc321 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:08.602413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b3948-1da9-4c1a-afe0-d7ebaf0cc321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:08.602951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 392/772] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:08.607857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b3948-1da9-4c1a-afe0-d7ebaf0cc321 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:08.608252 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fe1f9-1c37-4640-8598-0e78a00aafa7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:08.608555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fe1f9-1c37-4640-8598-0e78a00aafa7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:08.608824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fe1f9-1c37-4640-8598-0e78a00aafa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:08.613541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 381/773] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Sep 6 01:00:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:08.618796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b3948-1da9-4c1a-afe0-d7ebaf0cc321 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:08.634219 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-841fe1f9-1c37-4640-8598-0e78a00aafa7 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:08.635772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-841fe1f9-1c37-4640-8598-0e78a00aafa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:08.717403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 393/774] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:00:08.724630 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fe1f9-1c37-4640-8598-0e78a00aafa7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:08.744758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b3948-1da9-4c1a-afe0-d7ebaf0cc321 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:08.796328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61a37-d87c-4e91-b691-8ee49cf28e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:08.796955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61a37-d87c-4e91-b691-8ee49cf28e10 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:08.797234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61a37-d87c-4e91-b691-8ee49cf28e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:08.797503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61a37-d87c-4e91-b691-8ee49cf28e10 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:08.798146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c61a37-d87c-4e91-b691-8ee49cf28e10 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:08.798451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c61a37-d87c-4e91-b691-8ee49cf28e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:08.799874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c61a37-d87c-4e91-b691-8ee49cf28e10 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:08.801429 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:08.810684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 382/775] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Sep 6 01:00:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:08.818579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61a37-d87c-4e91-b691-8ee49cf28e10 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:08.919357 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fe1f9-1c37-4640-8598-0e78a00aafa7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:08.955004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:08.969928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19628b6f-2fb3-4579-a72f-18edd405e790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:08.971034 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19628b6f-2fb3-4579-a72f-18edd405e790 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:08.971534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19628b6f-2fb3-4579-a72f-18edd405e790 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:08.972015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19628b6f-2fb3-4579-a72f-18edd405e790 None admin] PATH_INFO: `/v3/services/network` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:08.972831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19628b6f-2fb3-4579-a72f-18edd405e790 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:08.974449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19628b6f-2fb3-4579-a72f-18edd405e790 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-19628b6f-2fb3-4579-a72f-18edd405e790 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:08.985420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:08.986530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 01:00:08.987418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:08.990894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 394/776] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:08 2022] GET /identity/v3/services/network => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:08.997248 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19628b6f-2fb3-4579-a72f-18edd405e790 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:09.046775 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61a37-d87c-4e91-b691-8ee49cf28e10 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:09.090634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b4d3d-5328-4d23-a1e6-44a94e20ede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:09.092079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b4d3d-5328-4d23-a1e6-44a94e20ede0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:09.092531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b4d3d-5328-4d23-a1e6-44a94e20ede0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:09.092940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b4d3d-5328-4d23-a1e6-44a94e20ede0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:09.094179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b4d3d-5328-4d23-a1e6-44a94e20ede0 None admin] RBAC: Adding query filter params (interface=public, service_id=17812e6df27d4531bdebde1c3b0ef7f5, region_id=RegionOne) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:09.094925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b4d3d-5328-4d23-a1e6-44a94e20ede0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:09.096749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b4d3d-5328-4d23-a1e6-44a94e20ede0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:09.105967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 383/777] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 6 01:00:08 2022] GET /identity/v3/endpoints?service_id=17812e6df27d4531bdebde1c3b0ef7f5&interface=public®ion_id=RegionOne => generated 194 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:09.107036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b4d3d-5328-4d23-a1e6-44a94e20ede0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:09.120347 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19628b6f-2fb3-4579-a72f-18edd405e790 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:09.157194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc01921-695e-42a8-8251-ca82cd50bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:09.158416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc01921-695e-42a8-8251-ca82cd50bdac None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:09.158868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc01921-695e-42a8-8251-ca82cd50bdac None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:09.159458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc01921-695e-42a8-8251-ca82cd50bdac None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:09.160927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc01921-695e-42a8-8251-ca82cd50bdac None admin] RBAC: Adding query filter params (name=network) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:09.161253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc01921-695e-42a8-8251-ca82cd50bdac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:09.162699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc01921-695e-42a8-8251-ca82cd50bdac None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:09.169079 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 395/778] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:09.170678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc01921-695e-42a8-8251-ca82cd50bdac None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:09.212705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:09.222980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b4d3d-5328-4d23-a1e6-44a94e20ede0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:09.234565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:09.259751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85676d-3635-4149-9de2-07197230cc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:09.260414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85676d-3635-4149-9de2-07197230cc75 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:09.260686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85676d-3635-4149-9de2-07197230cc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:09.260954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85676d-3635-4149-9de2-07197230cc75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:09.273828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85676d-3635-4149-9de2-07197230cc75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1f85676d-3635-4149-9de2-07197230cc75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:09.279220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:09.280410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:09.281471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 384/779] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:00:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:09.285635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85676d-3635-4149-9de2-07197230cc75 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:09.295013 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc01921-695e-42a8-8251-ca82cd50bdac None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:09.329456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbf9fa-6616-491a-b438-df0cf86479ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:09.330259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbf9fa-6616-491a-b438-df0cf86479ed None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:09.330368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbf9fa-6616-491a-b438-df0cf86479ed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:09.330602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbf9fa-6616-491a-b438-df0cf86479ed None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:09.331207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbf9fa-6616-491a-b438-df0cf86479ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:09.332658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbf9fa-6616-491a-b438-df0cf86479ed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:09.337922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 396/780] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 6 01:00:09 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:09.341967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26fb35-26bb-4368-89bd-7f6d34e2073f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:09.342824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26fb35-26bb-4368-89bd-7f6d34e2073f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:09.343411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26fb35-26bb-4368-89bd-7f6d34e2073f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:09.345795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 397/781] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:09.346930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26fb35-26bb-4368-89bd-7f6d34e2073f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:09.419718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85676d-3635-4149-9de2-07197230cc75 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:09.448110 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:09.463176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e90c44-f6ee-4d4b-8a8b-5444171720c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:09.463814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e90c44-f6ee-4d4b-8a8b-5444171720c7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:09.464093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e90c44-f6ee-4d4b-8a8b-5444171720c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:09.464469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e90c44-f6ee-4d4b-8a8b-5444171720c7 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:09.465108 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e90c44-f6ee-4d4b-8a8b-5444171720c7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:09.465410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e90c44-f6ee-4d4b-8a8b-5444171720c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:09.466917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e90c44-f6ee-4d4b-8a8b-5444171720c7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:09.473642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 385/782] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:09.474916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7f3dd-1381-4d7a-a293-de4d6d3f3e86 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:09.475204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7f3dd-1381-4d7a-a293-de4d6d3f3e86 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:09.475480 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7f3dd-1381-4d7a-a293-de4d6d3f3e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:09.481107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26fb35-26bb-4368-89bd-7f6d34e2073f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:09.498866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d7c7f3dd-1381-4d7a-a293-de4d6d3f3e86 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:09.499066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:09.499273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d7c7f3dd-1381-4d7a-a293-de4d6d3f3e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:09.532315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b0c60-94ea-440e-9fcb-209ab14c8d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:09.532315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b0c60-94ea-440e-9fcb-209ab14c8d2f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:09.532315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b0c60-94ea-440e-9fcb-209ab14c8d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:09.532315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b0c60-94ea-440e-9fcb-209ab14c8d2f None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:09.532740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b0c60-94ea-440e-9fcb-209ab14c8d2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:09.532740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b0c60-94ea-440e-9fcb-209ab14c8d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:09.534464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b0c60-94ea-440e-9fcb-209ab14c8d2f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:09.546787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 398/783] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:00:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:09.548090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b0c60-94ea-440e-9fcb-209ab14c8d2f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:09.577419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 386/784] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:09.578383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7f3dd-1381-4d7a-a293-de4d6d3f3e86 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:09.663015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b0c60-94ea-440e-9fcb-209ab14c8d2f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:09.712276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7f3dd-1381-4d7a-a293-de4d6d3f3e86 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:09.738740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eb968-1c17-49c3-bbeb-44524630201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:09.740668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eb968-1c17-49c3-bbeb-44524630201b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:09.740950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eb968-1c17-49c3-bbeb-44524630201b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:09.741223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eb968-1c17-49c3-bbeb-44524630201b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:09.741936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eb968-1c17-49c3-bbeb-44524630201b None admin] RBAC: Adding query filter params (interface=public, service_id=5e23465f5195439a982288b9459365c0, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:09.742247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eb968-1c17-49c3-bbeb-44524630201b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:09.743674 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eb968-1c17-49c3-bbeb-44524630201b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:09.749420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:09.768524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 399/785] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 6 01:00:09 2022] GET /identity/v3/endpoints?service_id=5e23465f5195439a982288b9459365c0&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:09.776825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eb968-1c17-49c3-bbeb-44524630201b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:09.788547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517a511-e9cd-40ad-99cd-1fbf9de91fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:09.789200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517a511-e9cd-40ad-99cd-1fbf9de91fdd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:09.789534 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517a511-e9cd-40ad-99cd-1fbf9de91fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:09.789841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517a511-e9cd-40ad-99cd-1fbf9de91fdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:09.810997 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517a511-e9cd-40ad-99cd-1fbf9de91fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:09.812958 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517a511-e9cd-40ad-99cd-1fbf9de91fdd None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-4517a511-e9cd-40ad-99cd-1fbf9de91fdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:09.843119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:09.844132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:09.845050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:09.845050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:09.845050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:09.845708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 387/786] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:09.851220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517a511-e9cd-40ad-99cd-1fbf9de91fdd None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:09.855732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:09.948703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eb968-1c17-49c3-bbeb-44524630201b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:09.979578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517a511-e9cd-40ad-99cd-1fbf9de91fdd None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:09.989777 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce634c8-353f-4b2f-be6f-8104f5be460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:09.990646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce634c8-353f-4b2f-be6f-8104f5be460a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:09.991473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce634c8-353f-4b2f-be6f-8104f5be460a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:09.992073 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce634c8-353f-4b2f-be6f-8104f5be460a None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:09.992951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce634c8-353f-4b2f-be6f-8104f5be460a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:09.995262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce634c8-353f-4b2f-be6f-8104f5be460a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:10.008328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 400/787] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 6 01:00:09 2022] GET /identity/v3/services => generated 772 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:10.008328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce634c8-353f-4b2f-be6f-8104f5be460a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:10.045547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44aa0a-0430-4f1e-8349-c6a17f60da0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:10.046179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44aa0a-0430-4f1e-8349-c6a17f60da0f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:10.046502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44aa0a-0430-4f1e-8349-c6a17f60da0f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:10.046776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44aa0a-0430-4f1e-8349-c6a17f60da0f None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:10.047431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44aa0a-0430-4f1e-8349-c6a17f60da0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:10.047729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44aa0a-0430-4f1e-8349-c6a17f60da0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:10.049189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44aa0a-0430-4f1e-8349-c6a17f60da0f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:10.089461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 388/788] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:10.096358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44aa0a-0430-4f1e-8349-c6a17f60da0f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:10.128779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:10.216367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce634c8-353f-4b2f-be6f-8104f5be460a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:10.220139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:10.235606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44aa0a-0430-4f1e-8349-c6a17f60da0f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:10.255936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f32029-41a2-4747-9c71-b4153182b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:10.256619 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f32029-41a2-4747-9c71-b4153182b482 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:10.256872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f32029-41a2-4747-9c71-b4153182b482 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:10.257139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f32029-41a2-4747-9c71-b4153182b482 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:10.268101 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f32029-41a2-4747-9c71-b4153182b482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-12f32029-41a2-4747-9c71-b4153182b482 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:10.273354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:10.274310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:10.275786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 401/789] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 01:00:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:10.281013 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f32029-41a2-4747-9c71-b4153182b482 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:10.282035 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ed3e1-d4ea-4ed9-acfa-85a0c683938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:10.282684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ed3e1-d4ea-4ed9-acfa-85a0c683938c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:10.282954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ed3e1-d4ea-4ed9-acfa-85a0c683938c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:10.283220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ed3e1-d4ea-4ed9-acfa-85a0c683938c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:10.295867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ed3e1-d4ea-4ed9-acfa-85a0c683938c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:10.297469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ed3e1-d4ea-4ed9-acfa-85a0c683938c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f20ed3e1-d4ea-4ed9-acfa-85a0c683938c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:10.313302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:10.314358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:10.315316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:10.315316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:10.315316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:10.315316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:10.315316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:10.315316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:10.315316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:10.315316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:10.315316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 01:00:10.315316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:10.319312 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 389/790] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:00:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:10.320639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ed3e1-d4ea-4ed9-acfa-85a0c683938c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:10.412429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f32029-41a2-4747-9c71-b4153182b482 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:10.459335 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5868b-d688-4d3f-80b5-5167bb3967eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:10.460385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5868b-d688-4d3f-80b5-5167bb3967eb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:10.461693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5868b-d688-4d3f-80b5-5167bb3967eb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:10.462178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5868b-d688-4d3f-80b5-5167bb3967eb None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:10.463817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5868b-d688-4d3f-80b5-5167bb3967eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:10.464508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5868b-d688-4d3f-80b5-5167bb3967eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:10.467451 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5868b-d688-4d3f-80b5-5167bb3967eb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:10.473224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:10.483096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 402/791] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 01:00:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:10.488348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5868b-d688-4d3f-80b5-5167bb3967eb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:10.494519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ed3e1-d4ea-4ed9-acfa-85a0c683938c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:10.533058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4aa26-2b4c-4534-b4d2-035629849d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:10.533993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4aa26-2b4c-4534-b4d2-035629849d90 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:10.534269 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4aa26-2b4c-4534-b4d2-035629849d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:10.534539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4aa26-2b4c-4534-b4d2-035629849d90 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:10.535598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4aa26-2b4c-4534-b4d2-035629849d90 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:10.535909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4aa26-2b4c-4534-b4d2-035629849d90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:10.538238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4aa26-2b4c-4534-b4d2-035629849d90 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:10.558436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:10.559032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 390/792] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Sep 6 01:00:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:10.564150 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4aa26-2b4c-4534-b4d2-035629849d90 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:10.659738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5868b-d688-4d3f-80b5-5167bb3967eb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:10.689736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4aa26-2b4c-4534-b4d2-035629849d90 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:10.706836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6a377-9db4-4e35-a764-3766854b1054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:10.707490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6a377-9db4-4e35-a764-3766854b1054 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:10.708049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6a377-9db4-4e35-a764-3766854b1054 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:10.708351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6a377-9db4-4e35-a764-3766854b1054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:10.722443 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6a377-9db4-4e35-a764-3766854b1054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:10.723968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6a377-9db4-4e35-a764-3766854b1054 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:10.725924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ca824-ffca-4fae-bd71-d4f945bf94bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:10.726664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ca824-ffca-4fae-bd71-d4f945bf94bf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:10.727025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ca824-ffca-4fae-bd71-d4f945bf94bf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:10.727381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ca824-ffca-4fae-bd71-d4f945bf94bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:10.737938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ca824-ffca-4fae-bd71-d4f945bf94bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:10.739561 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ca824-ffca-4fae-bd71-d4f945bf94bf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-42b6a377-9db4-4e35-a764-3766854b1054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:10.740220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:10.741251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:10.742182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:10.742182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:10.742182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:10.742182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 403/793] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:10.742855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce851-1c2e-4e3f-8190-124b51f1ace1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:10.743139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce851-1c2e-4e3f-8190-124b51f1ace1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:10.743411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce851-1c2e-4e3f-8190-124b51f1ace1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:10.749311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 404/794] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:10.749311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ce851-1c2e-4e3f-8190-124b51f1ace1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-cc6ca824-ffca-4fae-bd71-d4f945bf94bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:10.763797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:10.765055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:10.765978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:10.765978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:10.765978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:10.767953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 391/795] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:10.768128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:10.769716 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899a3a9-e8cc-4d33-b081-a1d19ece0ec6 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:10.770222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899a3a9-e8cc-4d33-b081-a1d19ece0ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:10.770684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899a3a9-e8cc-4d33-b081-a1d19ece0ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:10.791068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c899a3a9-e8cc-4d33-b081-a1d19ece0ec6 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:10.792724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c899a3a9-e8cc-4d33-b081-a1d19ece0ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:10.849719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:10.876062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 392/796] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:10.877398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899a3a9-e8cc-4d33-b081-a1d19ece0ec6 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:10.884313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ce851-1c2e-4e3f-8190-124b51f1ace1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:10.920580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87505f-25b7-4cd8-9b53-80e2795c1fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:10.921274 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87505f-25b7-4cd8-9b53-80e2795c1fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:10.921555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87505f-25b7-4cd8-9b53-80e2795c1fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:10.921831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87505f-25b7-4cd8-9b53-80e2795c1fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:10.922943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87505f-25b7-4cd8-9b53-80e2795c1fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:10.923253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87505f-25b7-4cd8-9b53-80e2795c1fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:10.924864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87505f-25b7-4cd8-9b53-80e2795c1fe5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:10.939597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 405/797] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:10.945098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87505f-25b7-4cd8-9b53-80e2795c1fe5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:11.075582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87505f-25b7-4cd8-9b53-80e2795c1fe5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:11.102283 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899a3a9-e8cc-4d33-b081-a1d19ece0ec6 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:11.116751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918cc54-7943-4780-8540-58f2ebba592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:11.117523 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918cc54-7943-4780-8540-58f2ebba592b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:11.117872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918cc54-7943-4780-8540-58f2ebba592b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:11.118214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918cc54-7943-4780-8540-58f2ebba592b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:11.126986 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918cc54-7943-4780-8540-58f2ebba592b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:11.128657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918cc54-7943-4780-8540-58f2ebba592b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:11.130883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6918cc54-7943-4780-8540-58f2ebba592b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:11.144232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:11.145320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:11.146299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:11.146299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:11.146299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:11.146299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:11.146299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:11.146299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:11.146299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:11.146299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:11.146299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 01:00:11.146299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:11.149096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 406/798] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 6 01:00:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:11.157762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918cc54-7943-4780-8540-58f2ebba592b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:11.272947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:11.282809 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8a730-12f7-456f-ae40-01aa6cba7d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:11.283431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a730-12f7-456f-ae40-01aa6cba7d03 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:11.283702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a730-12f7-456f-ae40-01aa6cba7d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:11.283970 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a730-12f7-456f-ae40-01aa6cba7d03 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:11.284645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8a730-12f7-456f-ae40-01aa6cba7d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:11.284946 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8a730-12f7-456f-ae40-01aa6cba7d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:11.286925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8a730-12f7-456f-ae40-01aa6cba7d03 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:11.307042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 393/799] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:11.307992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8a730-12f7-456f-ae40-01aa6cba7d03 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:11.326289 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918cc54-7943-4780-8540-58f2ebba592b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:11.363742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618eb98f-b38e-481d-a227-fe795cd07c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:11.364640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eb98f-b38e-481d-a227-fe795cd07c17 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:11.365063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eb98f-b38e-481d-a227-fe795cd07c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:11.365478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eb98f-b38e-481d-a227-fe795cd07c17 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:11.366495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618eb98f-b38e-481d-a227-fe795cd07c17 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:11.366950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618eb98f-b38e-481d-a227-fe795cd07c17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:11.368622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618eb98f-b38e-481d-a227-fe795cd07c17 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:11.388190 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 407/800] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Sep 6 01:00:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:11.389284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618eb98f-b38e-481d-a227-fe795cd07c17 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:11.418023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8a730-12f7-456f-ae40-01aa6cba7d03 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:11.453289 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:11.459168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d46e7-acdb-40ea-814c-64a9f483873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:11.459819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d46e7-acdb-40ea-814c-64a9f483873b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:11.460098 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d46e7-acdb-40ea-814c-64a9f483873b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:11.460399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d46e7-acdb-40ea-814c-64a9f483873b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:11.471495 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d46e7-acdb-40ea-814c-64a9f483873b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-de5d46e7-acdb-40ea-814c-64a9f483873b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:11.476308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:11.477475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 394/801] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:11.478883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d46e7-acdb-40ea-814c-64a9f483873b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:11.506673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618eb98f-b38e-481d-a227-fe795cd07c17 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:11.529138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:11.545769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af0263-d8f0-4284-99ba-0e9b816688bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:11.546533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af0263-d8f0-4284-99ba-0e9b816688bd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:11.546911 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af0263-d8f0-4284-99ba-0e9b816688bd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:11.547281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af0263-d8f0-4284-99ba-0e9b816688bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:11.554255 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af0263-d8f0-4284-99ba-0e9b816688bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:11.555874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af0263-d8f0-4284-99ba-0e9b816688bd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f3af0263-d8f0-4284-99ba-0e9b816688bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:11.567583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:11.568708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:11.569815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:11.569815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:11.569815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:11.569815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:11.569815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:11.569815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:11.569815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:11.569815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:11.575471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 408/802] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:11.575471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1296b7-d57a-45ce-aaaf-80c39e0e2954 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:11.575471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1296b7-d57a-45ce-aaaf-80c39e0e2954 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:11.575471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1296b7-d57a-45ce-aaaf-80c39e0e2954 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:11.575471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 409/803] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:11.575471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1296b7-d57a-45ce-aaaf-80c39e0e2954 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:11.592768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d46e7-acdb-40ea-814c-64a9f483873b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:11.627121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559999b-9e48-47bc-ab01-59696d49f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:11.627804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559999b-9e48-47bc-ab01-59696d49f5bf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:11.628082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559999b-9e48-47bc-ab01-59696d49f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:11.628402 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559999b-9e48-47bc-ab01-59696d49f5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:11.639559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559999b-9e48-47bc-ab01-59696d49f5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:11.641100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559999b-9e48-47bc-ab01-59696d49f5bf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-3559999b-9e48-47bc-ab01-59696d49f5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:11.655404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:11.656381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:11.662274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:11.662274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:11.662274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:11.662274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 395/804] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:11.662274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559999b-9e48-47bc-ab01-59696d49f5bf None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:11.690990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1296b7-d57a-45ce-aaaf-80c39e0e2954 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:11.708410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:11.729128 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d91cf-ca51-4e64-8bc0-d16d42232006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:11.729740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d91cf-ca51-4e64-8bc0-d16d42232006 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:11.730037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d91cf-ca51-4e64-8bc0-d16d42232006 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:11.730307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d91cf-ca51-4e64-8bc0-d16d42232006 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:11.730975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d91cf-ca51-4e64-8bc0-d16d42232006 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:11.731351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d91cf-ca51-4e64-8bc0-d16d42232006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:11.732948 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d91cf-ca51-4e64-8bc0-d16d42232006 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:11.742468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 410/805] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:11.743617 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39064a0e-64d3-4fd4-b87f-fb0fdfcb5296 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:11.743901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39064a0e-64d3-4fd4-b87f-fb0fdfcb5296 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:11.744178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39064a0e-64d3-4fd4-b87f-fb0fdfcb5296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:11.762638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:11.764997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-39064a0e-64d3-4fd4-b87f-fb0fdfcb5296 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:11.765878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559999b-9e48-47bc-ab01-59696d49f5bf None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:11.766285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-39064a0e-64d3-4fd4-b87f-fb0fdfcb5296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:11.802473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c8034-3102-4f31-b86d-8427cfdb4496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:11.803091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c8034-3102-4f31-b86d-8427cfdb4496 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:11.803369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c8034-3102-4f31-b86d-8427cfdb4496 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:11.803642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c8034-3102-4f31-b86d-8427cfdb4496 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:11.804346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c8034-3102-4f31-b86d-8427cfdb4496 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:11.804657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c8034-3102-4f31-b86d-8427cfdb4496 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:11.806134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c8034-3102-4f31-b86d-8427cfdb4496 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:11.818464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 396/806] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:11.819270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c8034-3102-4f31-b86d-8427cfdb4496 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:11.843171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 411/807] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:11.844452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39064a0e-64d3-4fd4-b87f-fb0fdfcb5296 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:11.943838 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c8034-3102-4f31-b86d-8427cfdb4496 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:11.985346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55554ba-02a7-4ae2-bb1e-4850e1ecd1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:11.986413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55554ba-02a7-4ae2-bb1e-4850e1ecd1da None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:11.986962 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55554ba-02a7-4ae2-bb1e-4850e1ecd1da None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:11.987436 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55554ba-02a7-4ae2-bb1e-4850e1ecd1da None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:11.988307 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55554ba-02a7-4ae2-bb1e-4850e1ecd1da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:11.988805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55554ba-02a7-4ae2-bb1e-4850e1ecd1da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:11.990653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55554ba-02a7-4ae2-bb1e-4850e1ecd1da None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:12.005752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 397/808] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:12.007484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55554ba-02a7-4ae2-bb1e-4850e1ecd1da None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:12.034906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:12.102528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39064a0e-64d3-4fd4-b87f-fb0fdfcb5296 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:12.112940 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:12.136417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55554ba-02a7-4ae2-bb1e-4850e1ecd1da None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:12.142002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f70deb-6731-48e7-91d1-dcc510aad2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:12.142651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f70deb-6731-48e7-91d1-dcc510aad2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:12.142923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f70deb-6731-48e7-91d1-dcc510aad2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:12.143191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f70deb-6731-48e7-91d1-dcc510aad2b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:12.157712 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f70deb-6731-48e7-91d1-dcc510aad2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:12.159499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f70deb-6731-48e7-91d1-dcc510aad2b6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:12.171573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fe95e-44bf-4a2c-84ce-5c043d044282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:12.172241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fe95e-44bf-4a2c-84ce-5c043d044282 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:12.172559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fe95e-44bf-4a2c-84ce-5c043d044282 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:12.172831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fe95e-44bf-4a2c-84ce-5c043d044282 None admin] PATH_INFO: `/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/d7e2ea2ab4ae4a14be9bd35af20080c6/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:12.174703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fe95e-44bf-4a2c-84ce-5c043d044282 None admin] RBAC: Authorizing `identity:create_grant(project_id=d31b0823b61d4895accd0f27e6006b08, user_id=d7e2ea2ab4ae4a14be9bd35af20080c6, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:12.176159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fe95e-44bf-4a2c-84ce-5c043d044282 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-93f70deb-6731-48e7-91d1-dcc510aad2b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:12.180017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:12.181418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:12.182376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:12.182376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:12.182376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:12.182376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 412/809] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:12.182980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f70deb-6731-48e7-91d1-dcc510aad2b6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:12.204511 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 398/810] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 01:00:12 2022] PUT /identity/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/d7e2ea2ab4ae4a14be9bd35af20080c6/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:00:12.204511 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fe95e-44bf-4a2c-84ce-5c043d044282 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:12.299484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f70deb-6731-48e7-91d1-dcc510aad2b6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:12.320225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:12.340810 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11674c-0cc1-44a9-b270-4fa2a66c5d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:12.341586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11674c-0cc1-44a9-b270-4fa2a66c5d86 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:12.341827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11674c-0cc1-44a9-b270-4fa2a66c5d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:12.342148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11674c-0cc1-44a9-b270-4fa2a66c5d86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:12.346391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fe95e-44bf-4a2c-84ce-5c043d044282 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:12.351242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11674c-0cc1-44a9-b270-4fa2a66c5d86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:12.351775 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11674c-0cc1-44a9-b270-4fa2a66c5d86 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-cd11674c-0cc1-44a9-b270-4fa2a66c5d86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:12.367955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:12.368905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:12.370401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:12.370401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:12.370401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:12.370401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:12.370401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:12.370401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:12.370401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:12.370401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:12.370401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 413/811] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:12.370401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11674c-0cc1-44a9-b270-4fa2a66c5d86 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:12.387424 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3080161-5026-4c63-be74-bbddab86c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:12.388128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3080161-5026-4c63-be74-bbddab86c961 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:12.388428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3080161-5026-4c63-be74-bbddab86c961 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:12.388712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3080161-5026-4c63-be74-bbddab86c961 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:12.389279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3080161-5026-4c63-be74-bbddab86c961 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:12.391051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3080161-5026-4c63-be74-bbddab86c961 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:12.394546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c3080161-5026-4c63-be74-bbddab86c961 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:12.400104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:12.401168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:12.402043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 399/812] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Sep 6 01:00:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:12.402943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1c984-6a44-42c3-b086-a3123fd9e753 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:12.403714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1c984-6a44-42c3-b086-a3123fd9e753 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:12.403714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1c984-6a44-42c3-b086-a3123fd9e753 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:12.404874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 400/813] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:12.405732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1c984-6a44-42c3-b086-a3123fd9e753 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:12.489001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11674c-0cc1-44a9-b270-4fa2a66c5d86 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:12.516965 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1c984-6a44-42c3-b086-a3123fd9e753 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:12.525575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955388f-2668-4bcb-bd10-58677056a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:12.526187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955388f-2668-4bcb-bd10-58677056a747 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:12.526785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955388f-2668-4bcb-bd10-58677056a747 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:12.526785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955388f-2668-4bcb-bd10-58677056a747 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:12.527437 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955388f-2668-4bcb-bd10-58677056a747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:12.527731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955388f-2668-4bcb-bd10-58677056a747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:12.529265 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955388f-2668-4bcb-bd10-58677056a747 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:12.541341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 414/814] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:12.546585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955388f-2668-4bcb-bd10-58677056a747 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:12.553538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2247e1e-10ff-4b18-b64c-055b7e619727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:12.554283 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2247e1e-10ff-4b18-b64c-055b7e619727 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:12.554659 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2247e1e-10ff-4b18-b64c-055b7e619727 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:12.555061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2247e1e-10ff-4b18-b64c-055b7e619727 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:12.555857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2247e1e-10ff-4b18-b64c-055b7e619727 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:12.556250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2247e1e-10ff-4b18-b64c-055b7e619727 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:12.557884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2247e1e-10ff-4b18-b64c-055b7e619727 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:12.575464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 401/815] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:12.575464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68eaed-624a-430f-92f6-994a11cd9b5b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:12.575464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68eaed-624a-430f-92f6-994a11cd9b5b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:12.575464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68eaed-624a-430f-92f6-994a11cd9b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:12.579870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:12.591464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3c68eaed-624a-430f-92f6-994a11cd9b5b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:12.592780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3c68eaed-624a-430f-92f6-994a11cd9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:12.641854 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:12.665676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955388f-2668-4bcb-bd10-58677056a747 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:12.672759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 402/816] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:12.674371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68eaed-624a-430f-92f6-994a11cd9b5b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:12.702744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fdbae-e00a-40a3-836f-52c462fc7350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:12.703444 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fdbae-e00a-40a3-836f-52c462fc7350 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:12.703708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fdbae-e00a-40a3-836f-52c462fc7350 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:12.703976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fdbae-e00a-40a3-836f-52c462fc7350 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:12.704668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fdbae-e00a-40a3-836f-52c462fc7350 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:12.704963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fdbae-e00a-40a3-836f-52c462fc7350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:12.706364 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fdbae-e00a-40a3-836f-52c462fc7350 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:12.716359 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 415/817] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Sep 6 01:00:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:12.717262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fdbae-e00a-40a3-836f-52c462fc7350 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:12.786805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68eaed-624a-430f-92f6-994a11cd9b5b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:12.821639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cc7df-5b04-47fd-978e-858645681cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:12.822622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cc7df-5b04-47fd-978e-858645681cec None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:12.823089 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cc7df-5b04-47fd-978e-858645681cec None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:12.823551 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cc7df-5b04-47fd-978e-858645681cec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:12.825732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:12.827135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fdbae-e00a-40a3-836f-52c462fc7350 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:12.833126 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cc7df-5b04-47fd-978e-858645681cec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:12.835388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cc7df-5b04-47fd-978e-858645681cec None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-515cc7df-5b04-47fd-978e-858645681cec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:12.847977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:12.849019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:12.849968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:12.849968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:12.849968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:12.849968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:12.849968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:12.849968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:12.849968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:12.849968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:12.849968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 01:00:12.849968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:12.856895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 403/818] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 6 01:00:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:12.857997 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cc7df-5b04-47fd-978e-858645681cec None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:12.865276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c70ce-45a9-4755-ba28-ab088b398755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:12.865983 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c70ce-45a9-4755-ba28-ab088b398755 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:12.866257 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c70ce-45a9-4755-ba28-ab088b398755 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:12.866522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c70ce-45a9-4755-ba28-ab088b398755 None admin] PATH_INFO: `/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/d56912bcbf0b4ce9b29ace7606deb827/roles/200ce779351e41d0b4f43970f4008cd0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:12.882209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c70ce-45a9-4755-ba28-ab088b398755 None admin] RBAC: Authorizing `identity:create_grant(project_id=d31b0823b61d4895accd0f27e6006b08, user_id=d56912bcbf0b4ce9b29ace7606deb827, role_id=200ce779351e41d0b4f43970f4008cd0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:12.883910 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c70ce-45a9-4755-ba28-ab088b398755 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:12.886070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:12.901792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 416/819] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 01:00:12 2022] PUT /identity/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/d56912bcbf0b4ce9b29ace7606deb827/roles/200ce779351e41d0b4f43970f4008cd0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:00:12.902511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c70ce-45a9-4755-ba28-ab088b398755 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:12.971453 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cc7df-5b04-47fd-978e-858645681cec None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:13.012610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fc804-1128-4b2e-b42e-0f869fb45974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:13.013666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fc804-1128-4b2e-b42e-0f869fb45974 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:13.014164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fc804-1128-4b2e-b42e-0f869fb45974 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:13.014624 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fc804-1128-4b2e-b42e-0f869fb45974 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:13.015478 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fc804-1128-4b2e-b42e-0f869fb45974 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:13.015974 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fc804-1128-4b2e-b42e-0f869fb45974 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:13.017673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fc804-1128-4b2e-b42e-0f869fb45974 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:13.023786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 404/820] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Sep 6 01:00:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:13.025045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fc804-1128-4b2e-b42e-0f869fb45974 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:13.037971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c70ce-45a9-4755-ba28-ab088b398755 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:13.078810 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354b6ca-14c6-4ae7-8f51-84c7063b41a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:13.079431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354b6ca-14c6-4ae7-8f51-84c7063b41a8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:13.079702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354b6ca-14c6-4ae7-8f51-84c7063b41a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:13.079965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354b6ca-14c6-4ae7-8f51-84c7063b41a8 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:13.081782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354b6ca-14c6-4ae7-8f51-84c7063b41a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:13.081782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354b6ca-14c6-4ae7-8f51-84c7063b41a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:13.082508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354b6ca-14c6-4ae7-8f51-84c7063b41a8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:13.095831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:13.110056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 417/821] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 6 01:00:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:13.110961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354b6ca-14c6-4ae7-8f51-84c7063b41a8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:13.153663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fc804-1128-4b2e-b42e-0f869fb45974 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:13.174514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:13.197648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882852b-a993-42d7-96a5-968b888c6c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:13.198378 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882852b-a993-42d7-96a5-968b888c6c82 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:13.198720 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882852b-a993-42d7-96a5-968b888c6c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:13.199051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882852b-a993-42d7-96a5-968b888c6c82 None admin] PATH_INFO: `/v3/services/network` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:13.200091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882852b-a993-42d7-96a5-968b888c6c82 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:13.201371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882852b-a993-42d7-96a5-968b888c6c82 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-3882852b-a993-42d7-96a5-968b888c6c82 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:13.213290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:13.214535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 01:00:13.215625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:13.217250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 405/822] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:13 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:13.217419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882852b-a993-42d7-96a5-968b888c6c82 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:13.234924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354b6ca-14c6-4ae7-8f51-84c7063b41a8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:13.274660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82b4e7-c453-44d3-89c1-f9618deca1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:13.275274 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b4e7-c453-44d3-89c1-f9618deca1dc None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:13.275545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b4e7-c453-44d3-89c1-f9618deca1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:13.276047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b4e7-c453-44d3-89c1-f9618deca1dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:13.276755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82b4e7-c453-44d3-89c1-f9618deca1dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:13.278954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82b4e7-c453-44d3-89c1-f9618deca1dc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:13.314248 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 418/823] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:00:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:13.315114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82b4e7-c453-44d3-89c1-f9618deca1dc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:13.360154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882852b-a993-42d7-96a5-968b888c6c82 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:13.396513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:13.433750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675f033-b3b7-45c8-9aa8-26f770bff9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:13.434399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675f033-b3b7-45c8-9aa8-26f770bff9ed None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:13.434681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675f033-b3b7-45c8-9aa8-26f770bff9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:13.434997 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675f033-b3b7-45c8-9aa8-26f770bff9ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:13.495961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82b4e7-c453-44d3-89c1-f9618deca1dc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:13.505772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:13.533629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4631d7-8bde-4c6a-9ac5-97ca417f9e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:13.534687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4631d7-8bde-4c6a-9ac5-97ca417f9e87 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:13.535148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4631d7-8bde-4c6a-9ac5-97ca417f9e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:13.536197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4631d7-8bde-4c6a-9ac5-97ca417f9e87 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:13.536627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675f033-b3b7-45c8-9aa8-26f770bff9ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:13.537180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4631d7-8bde-4c6a-9ac5-97ca417f9e87 None admin] RBAC: Adding query filter params (name=network) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:13.537630 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4631d7-8bde-4c6a-9ac5-97ca417f9e87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:13.538408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675f033-b3b7-45c8-9aa8-26f770bff9ed None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:13.539327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4631d7-8bde-4c6a-9ac5-97ca417f9e87 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:13.545738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 419/824] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:13.550827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4631d7-8bde-4c6a-9ac5-97ca417f9e87 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:13.649048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 406/825] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:00:13.657126 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675f033-b3b7-45c8-9aa8-26f770bff9ed None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:13.667681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4631d7-8bde-4c6a-9ac5-97ca417f9e87 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:13.677452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:13.707707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7b7d6-b6ba-4128-af5c-31f3d5e4ae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:13.708232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7b7d6-b6ba-4128-af5c-31f3d5e4ae26 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:13.708526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7b7d6-b6ba-4128-af5c-31f3d5e4ae26 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:13.708792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7b7d6-b6ba-4128-af5c-31f3d5e4ae26 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:13.709515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7b7d6-b6ba-4128-af5c-31f3d5e4ae26 None admin] RBAC: Adding query filter params (type=network) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:13.709816 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7b7d6-b6ba-4128-af5c-31f3d5e4ae26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:13.711315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7b7d6-b6ba-4128-af5c-31f3d5e4ae26 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:13.717534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 420/826] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:13.729274 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7b7d6-b6ba-4128-af5c-31f3d5e4ae26 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:13.771353 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:13.808604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675f033-b3b7-45c8-9aa8-26f770bff9ed None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:13.877028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6d35a-377a-4b56-96fd-b3584503514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:13.877672 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6d35a-377a-4b56-96fd-b3584503514b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:13.877943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6d35a-377a-4b56-96fd-b3584503514b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:13.878210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6d35a-377a-4b56-96fd-b3584503514b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:13.897513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7b7d6-b6ba-4128-af5c-31f3d5e4ae26 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:13.907588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6d35a-377a-4b56-96fd-b3584503514b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:13.909166 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6d35a-377a-4b56-96fd-b3584503514b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-00b6d35a-377a-4b56-96fd-b3584503514b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:13.930667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:13.931679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:13.932642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:13.932642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:13.932642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:13.939526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 407/827] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:13.940455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6d35a-377a-4b56-96fd-b3584503514b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:13.966679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d1e03-bf47-44aa-a22b-a6a88ad20ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:13.967695 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d1e03-bf47-44aa-a22b-a6a88ad20ac3 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:13.967967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d1e03-bf47-44aa-a22b-a6a88ad20ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:13.968233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d1e03-bf47-44aa-a22b-a6a88ad20ac3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:13.968926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d1e03-bf47-44aa-a22b-a6a88ad20ac3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:13.970342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d1e03-bf47-44aa-a22b-a6a88ad20ac3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:14.016767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 421/828] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:00:13 2022] POST /identity/v3/endpoints => generated 337 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:14.035844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:14.072633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6d35a-377a-4b56-96fd-b3584503514b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:14.119786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5418dc0-ef91-4dc6-96e7-d96249bcc479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:14.120438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5418dc0-ef91-4dc6-96e7-d96249bcc479 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:14.120713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5418dc0-ef91-4dc6-96e7-d96249bcc479 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:14.120983 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5418dc0-ef91-4dc6-96e7-d96249bcc479 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:14.121665 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5418dc0-ef91-4dc6-96e7-d96249bcc479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:14.122032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5418dc0-ef91-4dc6-96e7-d96249bcc479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:14.123490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5418dc0-ef91-4dc6-96e7-d96249bcc479 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:14.138354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 408/829] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:14.144190 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d1e03-bf47-44aa-a22b-a6a88ad20ac3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:14.240526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058acb55-89f7-4333-aac2-20f72f1d884b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:14.241042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058acb55-89f7-4333-aac2-20f72f1d884b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:14.241469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058acb55-89f7-4333-aac2-20f72f1d884b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:14.243299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 409/830] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:14.248610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64059-1ff8-4a02-849f-4dfe2b863852 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:14.249139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64059-1ff8-4a02-849f-4dfe2b863852 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:14.249682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64059-1ff8-4a02-849f-4dfe2b863852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:14.269970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:14.275870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-beb64059-1ff8-4a02-849f-4dfe2b863852 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:14.277365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-beb64059-1ff8-4a02-849f-4dfe2b863852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:14.280178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d1e03-bf47-44aa-a22b-a6a88ad20ac3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:14.316770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c175f-3da0-490b-9cb4-adac911a4a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:14.317440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c175f-3da0-490b-9cb4-adac911a4a4f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:14.317693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c175f-3da0-490b-9cb4-adac911a4a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:14.317960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c175f-3da0-490b-9cb4-adac911a4a4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:14.327490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c175f-3da0-490b-9cb4-adac911a4a4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:14.328973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c175f-3da0-490b-9cb4-adac911a4a4f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-014c175f-3da0-490b-9cb4-adac911a4a4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:14.341832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:14.342755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:14.343657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:14.343657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:14.343657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:14.343657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:14.343657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:14.343657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:14.343657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:14.343657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:14.343657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 422/831] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:14.348999 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c175f-3da0-490b-9cb4-adac911a4a4f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:14.364495 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 410/832] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:14.450582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c175f-3da0-490b-9cb4-adac911a4a4f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:14.484923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb8782-8c52-43a0-bb1c-150609a88308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:14.485541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb8782-8c52-43a0-bb1c-150609a88308 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:14.485817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb8782-8c52-43a0-bb1c-150609a88308 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:14.486089 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb8782-8c52-43a0-bb1c-150609a88308 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:14.486782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb8782-8c52-43a0-bb1c-150609a88308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:14.487084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb8782-8c52-43a0-bb1c-150609a88308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:14.488621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb8782-8c52-43a0-bb1c-150609a88308 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:14.501622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 423/833] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:14.507644 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb64059-1ff8-4a02-849f-4dfe2b863852 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:14.565554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:14.609723 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb64059-1ff8-4a02-849f-4dfe2b863852 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:14.644613 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cd7e6-4a7a-4bed-9362-71dd9d7535b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:14.645222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cd7e6-4a7a-4bed-9362-71dd9d7535b9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:14.645491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cd7e6-4a7a-4bed-9362-71dd9d7535b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:14.645758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cd7e6-4a7a-4bed-9362-71dd9d7535b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:14.646479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cd7e6-4a7a-4bed-9362-71dd9d7535b9 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=42b9c25e98fe4b1bbc33a601d4150071) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:14.646787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cd7e6-4a7a-4bed-9362-71dd9d7535b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:14.648249 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cd7e6-4a7a-4bed-9362-71dd9d7535b9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:14.654690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 411/834] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:14 2022] GET /identity/v3/role_assignments?user.id=42b9c25e98fe4b1bbc33a601d4150071&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:14.662450 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb8782-8c52-43a0-bb1c-150609a88308 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:14.680744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:14.774045 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb8782-8c52-43a0-bb1c-150609a88308 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:14.813184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1714f-621d-47b9-b3ef-7f6e283d860e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:14.813824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1714f-621d-47b9-b3ef-7f6e283d860e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:14.814098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1714f-621d-47b9-b3ef-7f6e283d860e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:14.814365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1714f-621d-47b9-b3ef-7f6e283d860e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:14.825220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1714f-621d-47b9-b3ef-7f6e283d860e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-89f1714f-621d-47b9-b3ef-7f6e283d860e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:14.830002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:14.830942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:14.831806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 424/835] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:00:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:14.837806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cd7e6-4a7a-4bed-9362-71dd9d7535b9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:14.950520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cd7e6-4a7a-4bed-9362-71dd9d7535b9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:14.970907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:14.984920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400fb07-c1d8-41d9-ab12-110fd3653539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:14.985535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400fb07-c1d8-41d9-ab12-110fd3653539 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:14.985805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400fb07-c1d8-41d9-ab12-110fd3653539 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:14.986078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400fb07-c1d8-41d9-ab12-110fd3653539 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:14.986899 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400fb07-c1d8-41d9-ab12-110fd3653539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:14.987257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400fb07-c1d8-41d9-ab12-110fd3653539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:14.988929 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400fb07-c1d8-41d9-ab12-110fd3653539 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:14.998409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 412/836] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:00:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:15.003809 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1714f-621d-47b9-b3ef-7f6e283d860e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:15.027349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e9dfc-9c0d-4bfd-b0df-dded0bc4edd2 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:15.027534 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e9dfc-9c0d-4bfd-b0df-dded0bc4edd2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:15.027861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e9dfc-9c0d-4bfd-b0df-dded0bc4edd2 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:15.033002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 413/837] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:00:15.034447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b59c9-3a27-4240-b941-f07e0779f958 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:15.034725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b59c9-3a27-4240-b941-f07e0779f958 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:15.034995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b59c9-3a27-4240-b941-f07e0779f958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:15.056321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-759b59c9-3a27-4240-b941-f07e0779f958 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:15.057582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-759b59c9-3a27-4240-b941-f07e0779f958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:15.089674 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:15.131859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1714f-621d-47b9-b3ef-7f6e283d860e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:15.143044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 414/838] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:00:15.168541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e909d-03bb-4304-9ad0-f4d89995987d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:15.169198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e909d-03bb-4304-9ad0-f4d89995987d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:15.169469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e909d-03bb-4304-9ad0-f4d89995987d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:15.169734 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e909d-03bb-4304-9ad0-f4d89995987d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:15.180572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e909d-03bb-4304-9ad0-f4d89995987d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:15.182065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e909d-03bb-4304-9ad0-f4d89995987d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-000e909d-03bb-4304-9ad0-f4d89995987d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:15.196329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:15.197334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:15.198269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:15.198269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:15.198269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:15.198269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 425/839] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:15.204118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b59c9-3a27-4240-b941-f07e0779f958 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:15.311941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b59c9-3a27-4240-b941-f07e0779f958 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:15.325705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:15.346976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfb8a7-5bf2-461f-8b14-094de734d02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:15.347588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfb8a7-5bf2-461f-8b14-094de734d02b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:15.347859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfb8a7-5bf2-461f-8b14-094de734d02b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:15.348128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfb8a7-5bf2-461f-8b14-094de734d02b None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:15.348794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfb8a7-5bf2-461f-8b14-094de734d02b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:15.349091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfb8a7-5bf2-461f-8b14-094de734d02b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:15.350496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfb8a7-5bf2-461f-8b14-094de734d02b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:15.362726 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 415/840] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:15.373496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e909d-03bb-4304-9ad0-f4d89995987d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:15.433573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfb8a7-5bf2-461f-8b14-094de734d02b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:15.487842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e909d-03bb-4304-9ad0-f4d89995987d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:15.524320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:15.531431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8eb36-2a2f-43cf-aef9-4ce8b09ffe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:15.532675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8eb36-2a2f-43cf-aef9-4ce8b09ffe50 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:15.533433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8eb36-2a2f-43cf-aef9-4ce8b09ffe50 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:15.533716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8eb36-2a2f-43cf-aef9-4ce8b09ffe50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:15.540016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfb8a7-5bf2-461f-8b14-094de734d02b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:15.544041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8eb36-2a2f-43cf-aef9-4ce8b09ffe50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:15.545576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8eb36-2a2f-43cf-aef9-4ce8b09ffe50 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-43e8eb36-2a2f-43cf-aef9-4ce8b09ffe50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:15.559545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:15.560778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:15.562173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:15.562173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:15.562173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:15.562173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:15.562173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:15.562173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:15.562173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:15.562173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:15.562173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 01:00:15.562173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:15.565858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 426/841] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:00:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:15.566765 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8eb36-2a2f-43cf-aef9-4ce8b09ffe50 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:15.580790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939ea07-e864-448e-82a6-07c774785529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:15.581804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939ea07-e864-448e-82a6-07c774785529 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:15.582291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939ea07-e864-448e-82a6-07c774785529 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:15.582749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939ea07-e864-448e-82a6-07c774785529 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:15.595198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939ea07-e864-448e-82a6-07c774785529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-b939ea07-e864-448e-82a6-07c774785529 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:15.601223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:15.602175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:15.603014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:15.603014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:15.603014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:15.603014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:15.603014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:15.603014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:15.603014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:15.603014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:15.603014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:15.603014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:15.603014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 01:00:15.603014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:15.610656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 416/842] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 01:00:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:15.612232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939ea07-e864-448e-82a6-07c774785529 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:15.648145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:15.686891 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8eb36-2a2f-43cf-aef9-4ce8b09ffe50 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:15.728009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803523fe-5390-4c9a-924a-c09db4a9193c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:15.729070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803523fe-5390-4c9a-924a-c09db4a9193c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:15.729566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803523fe-5390-4c9a-924a-c09db4a9193c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:15.729753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939ea07-e864-448e-82a6-07c774785529 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:15.730240 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803523fe-5390-4c9a-924a-c09db4a9193c None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:15.731384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803523fe-5390-4c9a-924a-c09db4a9193c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:15.731990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803523fe-5390-4c9a-924a-c09db4a9193c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:15.733777 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803523fe-5390-4c9a-924a-c09db4a9193c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:15.752718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 427/843] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Sep 6 01:00:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:15.754414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a953-6459-4ef6-a9f8-20d9d3a5d745 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:15.754697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a953-6459-4ef6-a9f8-20d9d3a5d745 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:15.754964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a953-6459-4ef6-a9f8-20d9d3a5d745 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:15.756248 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 428/844] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:15.760746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19a953-6459-4ef6-a9f8-20d9d3a5d745 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:15.769303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5c3ec-0163-4772-8d23-73e79ce958ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:15.769975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5c3ec-0163-4772-8d23-73e79ce958ea None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:15.770247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5c3ec-0163-4772-8d23-73e79ce958ea None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:15.770515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5c3ec-0163-4772-8d23-73e79ce958ea None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:15.771216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5c3ec-0163-4772-8d23-73e79ce958ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:15.771514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5c3ec-0163-4772-8d23-73e79ce958ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:15.772975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5c3ec-0163-4772-8d23-73e79ce958ea None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:15.781556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 417/845] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 01:00:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:15.782734 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff74b4-de41-483a-b279-918bf75f38fd None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:15.783014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff74b4-de41-483a-b279-918bf75f38fd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:15.783282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff74b4-de41-483a-b279-918bf75f38fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:15.802586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a2ff74b4-de41-483a-b279-918bf75f38fd None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:15.804164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a2ff74b4-de41-483a-b279-918bf75f38fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:15.813310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:15.875078 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19a953-6459-4ef6-a9f8-20d9d3a5d745 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:15.884358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 418/846] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:15.884358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff74b4-de41-483a-b279-918bf75f38fd None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:15.913746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:15.923286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dbcc0-20c0-40af-be57-486592b28137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:15.924577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dbcc0-20c0-40af-be57-486592b28137 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:15.925995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dbcc0-20c0-40af-be57-486592b28137 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:15.925995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dbcc0-20c0-40af-be57-486592b28137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:16.009929 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dbcc0-20c0-40af-be57-486592b28137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:16.011618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dbcc0-20c0-40af-be57-486592b28137 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:16.019612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff74b4-de41-483a-b279-918bf75f38fd None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:16.054224 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:16.063528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ccb3a-cceb-423a-b8ea-f0e665345000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:16.064576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ccb3a-cceb-423a-b8ea-f0e665345000 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:16.065010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ccb3a-cceb-423a-b8ea-f0e665345000 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:16.065437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ccb3a-cceb-423a-b8ea-f0e665345000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:16.076852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ccb3a-cceb-423a-b8ea-f0e665345000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:16.078533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ccb3a-cceb-423a-b8ea-f0e665345000 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-674ccb3a-cceb-423a-b8ea-f0e665345000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:16.096329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:16.097554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:16.098686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:16.098686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:16.098686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:16.104645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 419/847] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:16.106383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ccb3a-cceb-423a-b8ea-f0e665345000 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:16.123108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 429/848] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:00:16.124210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dbcc0-20c0-40af-be57-486592b28137 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:16.189777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:16.215043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ccb3a-cceb-423a-b8ea-f0e665345000 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:16.225444 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dbcc0-20c0-40af-be57-486592b28137 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:16.250847 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15173b20-097e-4a68-bad0-f6d6d3787573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:16.251634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173b20-097e-4a68-bad0-f6d6d3787573 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:16.252068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173b20-097e-4a68-bad0-f6d6d3787573 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:16.252454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173b20-097e-4a68-bad0-f6d6d3787573 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:16.253263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15173b20-097e-4a68-bad0-f6d6d3787573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:16.253653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15173b20-097e-4a68-bad0-f6d6d3787573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:16.255302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15173b20-097e-4a68-bad0-f6d6d3787573 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:16.260402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5b442-be15-447d-aabe-0393d165c5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:16.261098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b442-be15-447d-aabe-0393d165c5ba None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:16.261435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b442-be15-447d-aabe-0393d165c5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:16.261799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b442-be15-447d-aabe-0393d165c5ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:16.273605 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 420/849] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:16.273605 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15173b20-097e-4a68-bad0-f6d6d3787573 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:16.276325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5b442-be15-447d-aabe-0393d165c5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:16.277897 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5b442-be15-447d-aabe-0393d165c5ba None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:16.280357 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9ff5b442-be15-447d-aabe-0393d165c5ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:16.297560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:16.298596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:16.299525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:16.299525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:16.299525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:16.299525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 430/850] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:16.299525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5b442-be15-447d-aabe-0393d165c5ba None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:16.381281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15173b20-097e-4a68-bad0-f6d6d3787573 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:16.410640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5b442-be15-447d-aabe-0393d165c5ba None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:16.415809 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0631cf6-abb4-49b5-adb0-b43a09ca4ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:16.416470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0631cf6-abb4-49b5-adb0-b43a09ca4ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:16.416745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0631cf6-abb4-49b5-adb0-b43a09ca4ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:16.417014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0631cf6-abb4-49b5-adb0-b43a09ca4ea5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:16.417598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0631cf6-abb4-49b5-adb0-b43a09ca4ea5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:16.419027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0631cf6-abb4-49b5-adb0-b43a09ca4ea5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:16.421634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e0631cf6-abb4-49b5-adb0-b43a09ca4ea5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:16.429711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:16.435953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:16.436949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 421/851] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 01:00:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:16.437939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0631cf6-abb4-49b5-adb0-b43a09ca4ea5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:16.457488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6799153-a363-47a5-ae6e-36c566c96970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:16.458360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6799153-a363-47a5-ae6e-36c566c96970 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:16.458728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6799153-a363-47a5-ae6e-36c566c96970 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:16.459080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6799153-a363-47a5-ae6e-36c566c96970 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:16.467396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6799153-a363-47a5-ae6e-36c566c96970 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:16.469273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6799153-a363-47a5-ae6e-36c566c96970 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c6799153-a363-47a5-ae6e-36c566c96970 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:16.481890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:16.482963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:16.484068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:16.484068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:16.484068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:16.484068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:16.484068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:16.484068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:16.484068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:16.484068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:16.484068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 01:00:16.484068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:16.486105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 431/852] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 6 01:00:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:16.486992 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6799153-a363-47a5-ae6e-36c566c96970 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:16.547566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:16.549622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0631cf6-abb4-49b5-adb0-b43a09ca4ea5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:16.588930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0aca9-c5a2-4d6b-aa25-4a294f1bfefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:16.589553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0aca9-c5a2-4d6b-aa25-4a294f1bfefe None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:16.589827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0aca9-c5a2-4d6b-aa25-4a294f1bfefe None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:16.590096 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0aca9-c5a2-4d6b-aa25-4a294f1bfefe None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:16.590862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0aca9-c5a2-4d6b-aa25-4a294f1bfefe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:16.591206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0aca9-c5a2-4d6b-aa25-4a294f1bfefe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:16.592662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0aca9-c5a2-4d6b-aa25-4a294f1bfefe None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:16.602138 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6799153-a363-47a5-ae6e-36c566c96970 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:16.604485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 422/853] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:16.605285 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0aca9-c5a2-4d6b-aa25-4a294f1bfefe None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:16.643921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27e5d-d5e8-4cbf-bca2-e41a61069e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:16.644934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27e5d-d5e8-4cbf-bca2-e41a61069e08 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:16.645403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27e5d-d5e8-4cbf-bca2-e41a61069e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:16.645857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27e5d-d5e8-4cbf-bca2-e41a61069e08 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:16.646667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d27e5d-d5e8-4cbf-bca2-e41a61069e08 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:16.647172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d27e5d-d5e8-4cbf-bca2-e41a61069e08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:16.648835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d27e5d-d5e8-4cbf-bca2-e41a61069e08 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:16.654287 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 432/854] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 01:00:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:16.655363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27e5d-d5e8-4cbf-bca2-e41a61069e08 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:16.673775 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:16.720103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0aca9-c5a2-4d6b-aa25-4a294f1bfefe None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:16.755455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d47cd-adb6-432b-b8ed-114373b0951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:16.756059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d47cd-adb6-432b-b8ed-114373b0951a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:16.756356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d47cd-adb6-432b-b8ed-114373b0951a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:16.756626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d47cd-adb6-432b-b8ed-114373b0951a None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:16.756738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27e5d-d5e8-4cbf-bca2-e41a61069e08 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:16.757342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d47cd-adb6-432b-b8ed-114373b0951a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:16.757643 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d47cd-adb6-432b-b8ed-114373b0951a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:16.759221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d47cd-adb6-432b-b8ed-114373b0951a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:16.773177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:16.777349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 423/855] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Sep 6 01:00:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:16.778805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d47cd-adb6-432b-b8ed-114373b0951a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:16.791593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f046ad-2259-4833-908a-6252fdc705c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:16.792240 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f046ad-2259-4833-908a-6252fdc705c3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:16.792557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f046ad-2259-4833-908a-6252fdc705c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:16.792828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f046ad-2259-4833-908a-6252fdc705c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:16.799610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f046ad-2259-4833-908a-6252fdc705c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:16.801126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f046ad-2259-4833-908a-6252fdc705c3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c3f046ad-2259-4833-908a-6252fdc705c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:16.812680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:16.813682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:16.814583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:16.814583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:16.814583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:16.814583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:16.814583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:16.814583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:16.814583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:16.814583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:16.814583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 433/856] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:16.815275 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6850d4e-83be-4173-a995-cf4f166dd331 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:16.815275 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6850d4e-83be-4173-a995-cf4f166dd331 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:16.815398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6850d4e-83be-4173-a995-cf4f166dd331 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:16.816594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 434/857] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:16.817327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6850d4e-83be-4173-a995-cf4f166dd331 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:16.885305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d47cd-adb6-432b-b8ed-114373b0951a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:16.902157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:16.922390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6850d4e-83be-4173-a995-cf4f166dd331 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:16.922591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7239f8-6ba4-4af4-b142-1bd289aed3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:16.923042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7239f8-6ba4-4af4-b142-1bd289aed3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:16.923316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7239f8-6ba4-4af4-b142-1bd289aed3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:16.923584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7239f8-6ba4-4af4-b142-1bd289aed3b6 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:16.924215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7239f8-6ba4-4af4-b142-1bd289aed3b6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:16.924550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7239f8-6ba4-4af4-b142-1bd289aed3b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:16.926018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7239f8-6ba4-4af4-b142-1bd289aed3b6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:16.930357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 424/858] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 01:00:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:16.931124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7239f8-6ba4-4af4-b142-1bd289aed3b6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:16.969300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939bd77-9fe5-446c-b977-ba05ab946b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:16.969927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939bd77-9fe5-446c-b977-ba05ab946b0c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:16.970207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939bd77-9fe5-446c-b977-ba05ab946b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:16.970495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939bd77-9fe5-446c-b977-ba05ab946b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:17.032032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:17.042571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7239f8-6ba4-4af4-b142-1bd289aed3b6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:17.063738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939bd77-9fe5-446c-b977-ba05ab946b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:17.065797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939bd77-9fe5-446c-b977-ba05ab946b0c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:17.080864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdb058-b689-4c16-b9bf-2a2aa9afc2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:17.081483 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdb058-b689-4c16-b9bf-2a2aa9afc2af None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:17.081757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdb058-b689-4c16-b9bf-2a2aa9afc2af None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:17.082038 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdb058-b689-4c16-b9bf-2a2aa9afc2af None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:17.082904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdb058-b689-4c16-b9bf-2a2aa9afc2af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:17.083044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdb058-b689-4c16-b9bf-2a2aa9afc2af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:17.085640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdb058-b689-4c16-b9bf-2a2aa9afc2af None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:17.100730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 425/859] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:17.102296 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc8a4-3ec0-4d76-9bf2-4f2b13d6a368 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:17.102805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc8a4-3ec0-4d76-9bf2-4f2b13d6a368 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:17.103281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc8a4-3ec0-4d76-9bf2-4f2b13d6a368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:17.121975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-76bfc8a4-3ec0-4d76-9bf2-4f2b13d6a368 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:17.123267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-76bfc8a4-3ec0-4d76-9bf2-4f2b13d6a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:17.161064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:17.182750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 435/860] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:16 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:00:17.182750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939bd77-9fe5-446c-b977-ba05ab946b0c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:17.199052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 426/861] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:17.199977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfc8a4-3ec0-4d76-9bf2-4f2b13d6a368 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:17.290850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:17.316542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfc8a4-3ec0-4d76-9bf2-4f2b13d6a368 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:17.321668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939bd77-9fe5-446c-b977-ba05ab946b0c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:17.352602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc3045-928e-4e74-9a1c-e949c9e623f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:17.353347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc3045-928e-4e74-9a1c-e949c9e623f5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:17.353679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc3045-928e-4e74-9a1c-e949c9e623f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:17.354374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc3045-928e-4e74-9a1c-e949c9e623f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:17.369568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cdfdc-4a71-4e82-abe7-e8b3911ac2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:17.370737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cdfdc-4a71-4e82-abe7-e8b3911ac2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:17.370981 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc3045-928e-4e74-9a1c-e949c9e623f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:17.379720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cdfdc-4a71-4e82-abe7-e8b3911ac2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:17.379720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cdfdc-4a71-4e82-abe7-e8b3911ac2f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:17.379960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc3045-928e-4e74-9a1c-e949c9e623f5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:17.380049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cdfdc-4a71-4e82-abe7-e8b3911ac2f2 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=d7e2ea2ab4ae4a14be9bd35af20080c6) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:17.380049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cdfdc-4a71-4e82-abe7-e8b3911ac2f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:17.380049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cdfdc-4a71-4e82-abe7-e8b3911ac2f2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:17.382660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 436/862] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:17 2022] GET /identity/v3/role_assignments?user.id=d7e2ea2ab4ae4a14be9bd35af20080c6&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-80dc3045-928e-4e74-9a1c-e949c9e623f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:17.398656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:17.399703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:17.400662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:17.400662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:17.400662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:17.402779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 427/863] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:17.409275 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cdfdc-4a71-4e82-abe7-e8b3911ac2f2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:17.470457 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc3045-928e-4e74-9a1c-e949c9e623f5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:17.503246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:17.536552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cdfdc-4a71-4e82-abe7-e8b3911ac2f2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:17.584746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce07c0e-67bd-49d2-9de1-89e7e960946c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:17.585689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce07c0e-67bd-49d2-9de1-89e7e960946c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:17.585689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce07c0e-67bd-49d2-9de1-89e7e960946c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:17.585943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce07c0e-67bd-49d2-9de1-89e7e960946c None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:17.586539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce07c0e-67bd-49d2-9de1-89e7e960946c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:17.586852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce07c0e-67bd-49d2-9de1-89e7e960946c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:17.588392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce07c0e-67bd-49d2-9de1-89e7e960946c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:17.601578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 437/864] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:17.601912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc3045-928e-4e74-9a1c-e949c9e623f5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:17.610029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce07c0e-67bd-49d2-9de1-89e7e960946c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:17.613131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:17.645417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325ea70-a07c-4480-be8e-42c830753e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:17.646061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325ea70-a07c-4480-be8e-42c830753e21 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:17.646338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325ea70-a07c-4480-be8e-42c830753e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:17.646778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325ea70-a07c-4480-be8e-42c830753e21 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:17.648201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325ea70-a07c-4480-be8e-42c830753e21 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:17.649727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325ea70-a07c-4480-be8e-42c830753e21 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c325ea70-a07c-4480-be8e-42c830753e21 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:17.661394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:17.662362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:17.663468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 428/865] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Sep 6 01:00:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:17.668976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325ea70-a07c-4480-be8e-42c830753e21 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:17.724871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce07c0e-67bd-49d2-9de1-89e7e960946c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:17.761124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bf352-a01e-446f-9338-d839a28cf9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:17.761920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bf352-a01e-446f-9338-d839a28cf9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:17.762333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bf352-a01e-446f-9338-d839a28cf9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:17.762701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bf352-a01e-446f-9338-d839a28cf9f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:17.769878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bf352-a01e-446f-9338-d839a28cf9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:17.771568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bf352-a01e-446f-9338-d839a28cf9f1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:17.779170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7c9bf352-a01e-446f-9338-d839a28cf9f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:17.784146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:17.785476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:17.786408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:17.786408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:17.786408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:17.786408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:17.786408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:17.786408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:17.786408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:17.786408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:17.790897 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 438/866] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:17.791999 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bf352-a01e-446f-9338-d839a28cf9f1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:17.797688 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325ea70-a07c-4480-be8e-42c830753e21 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:17.843856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c003f2e-c661-4bdf-89d3-16246f8693c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:17.845092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c003f2e-c661-4bdf-89d3-16246f8693c4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:17.845837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c003f2e-c661-4bdf-89d3-16246f8693c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:17.846361 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c003f2e-c661-4bdf-89d3-16246f8693c4 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:17.847511 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c003f2e-c661-4bdf-89d3-16246f8693c4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:17.848015 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c003f2e-c661-4bdf-89d3-16246f8693c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:17.850343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c003f2e-c661-4bdf-89d3-16246f8693c4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:17.862456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 429/867] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 6 01:00:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:17.863041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:17.863220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c003f2e-c661-4bdf-89d3-16246f8693c4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:17.909444 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bf352-a01e-446f-9338-d839a28cf9f1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:17.946076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15047c-72de-4450-a646-76833afa4060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:17.946719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15047c-72de-4450-a646-76833afa4060 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:17.947100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15047c-72de-4450-a646-76833afa4060 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:17.947377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15047c-72de-4450-a646-76833afa4060 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:17.948081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15047c-72de-4450-a646-76833afa4060 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:17.948499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15047c-72de-4450-a646-76833afa4060 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:17.950052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15047c-72de-4450-a646-76833afa4060 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:17.965973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 439/868] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:17.970882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c003f2e-c661-4bdf-89d3-16246f8693c4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:17.972084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15047c-72de-4450-a646-76833afa4060 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:18.017338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eea297-c348-42d0-a27d-fd50e35649fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:18.018030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eea297-c348-42d0-a27d-fd50e35649fb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:18.018302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eea297-c348-42d0-a27d-fd50e35649fb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:18.018570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eea297-c348-42d0-a27d-fd50e35649fb None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:18.019207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eea297-c348-42d0-a27d-fd50e35649fb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:18.019504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eea297-c348-42d0-a27d-fd50e35649fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:18.020957 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eea297-c348-42d0-a27d-fd50e35649fb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:18.026548 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 430/869] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 6 01:00:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:18.096255 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15047c-72de-4450-a646-76833afa4060 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:18.123055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:18.136423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711b627-58a1-4272-b616-738827e82472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:18.137075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711b627-58a1-4272-b616-738827e82472 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:18.137447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711b627-58a1-4272-b616-738827e82472 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:18.137619 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711b627-58a1-4272-b616-738827e82472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:18.138582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711b627-58a1-4272-b616-738827e82472 None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=d56912bcbf0b4ce9b29ace7606deb827) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:18.138958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711b627-58a1-4272-b616-738827e82472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:18.140852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711b627-58a1-4272-b616-738827e82472 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:18.147917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 440/870] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:17 2022] GET /identity/v3/role_assignments?user.id=d56912bcbf0b4ce9b29ace7606deb827&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:18.881806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabee5d1-f9c1-4a06-b736-41c7d9c04db2 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:18.881806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabee5d1-f9c1-4a06-b736-41c7d9c04db2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:18.881806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabee5d1-f9c1-4a06-b736-41c7d9c04db2 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:18.882396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 431/871] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:18.887982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da231ac2-cc8b-48f7-8c23-9c5c2928807e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:18.888890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da231ac2-cc8b-48f7-8c23-9c5c2928807e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:18.889376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da231ac2-cc8b-48f7-8c23-9c5c2928807e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:18.907636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-da231ac2-cc8b-48f7-8c23-9c5c2928807e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:18.909161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-da231ac2-cc8b-48f7-8c23-9c5c2928807e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:18.976664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 441/872] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:19.239067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabee5d1-f9c1-4a06-b736-41c7d9c04db2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:19.258559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:19.345871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabee5d1-f9c1-4a06-b736-41c7d9c04db2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:19.379786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777b7e4-fd27-4803-8d96-9f32fd6e3d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:19.380775 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777b7e4-fd27-4803-8d96-9f32fd6e3d13 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:19.381245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777b7e4-fd27-4803-8d96-9f32fd6e3d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:19.381703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777b7e4-fd27-4803-8d96-9f32fd6e3d13 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:19.382547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777b7e4-fd27-4803-8d96-9f32fd6e3d13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:19.384233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777b7e4-fd27-4803-8d96-9f32fd6e3d13 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:19.403576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 432/873] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 01:00:19 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:19.483233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354b66e-39ed-43f4-8ecf-a2f68e7008d2 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:19.483524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354b66e-39ed-43f4-8ecf-a2f68e7008d2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:19.483802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354b66e-39ed-43f4-8ecf-a2f68e7008d2 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:19.485551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 442/874] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:19.494873 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabee31f-d610-4a94-999b-4ac49e705316 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:19.494873 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabee31f-d610-4a94-999b-4ac49e705316 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:19.494873 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabee31f-d610-4a94-999b-4ac49e705316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:19.512656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-cabee31f-d610-4a94-999b-4ac49e705316 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:19.514138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cabee31f-d610-4a94-999b-4ac49e705316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:19.592681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 433/875] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:19 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:19.863951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354b66e-39ed-43f4-8ecf-a2f68e7008d2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:19.968239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354b66e-39ed-43f4-8ecf-a2f68e7008d2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:19.985730 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:20.002799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffafe0-e19e-4a44-8e4b-8d632653beb7 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:20.003167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffafe0-e19e-4a44-8e4b-8d632653beb7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:20.003530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffafe0-e19e-4a44-8e4b-8d632653beb7 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:20.004141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f9f56-775d-46c8-b32b-2b89f65942b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:20.004951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f9f56-775d-46c8-b32b-2b89f65942b2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:20.005057 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 434/876] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:20.005149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f9f56-775d-46c8-b32b-2b89f65942b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:20.005331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f9f56-775d-46c8-b32b-2b89f65942b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:20.009314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f9f56-775d-46c8-b32b-2b89f65942b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:20.009314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f9f56-775d-46c8-b32b-2b89f65942b2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:20.013528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714c2e-f578-4040-bd33-b33846b97bd4 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:20.014097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714c2e-f578-4040-bd33-b33846b97bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:20.014570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714c2e-f578-4040-bd33-b33846b97bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-dc6f9f56-775d-46c8-b32b-2b89f65942b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:20.020848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:20.021875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:20.022729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 443/877] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 6 01:00:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:20.024574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:20.027697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f9f56-775d-46c8-b32b-2b89f65942b2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:20.047660 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a5714c2e-f578-4040-bd33-b33846b97bd4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:20.049142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a5714c2e-f578-4040-bd33-b33846b97bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:20.123760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 435/878] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:20 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:20.137957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f9f56-775d-46c8-b32b-2b89f65942b2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:20.173324 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c83854-cbb3-43e8-af26-1955d46dcdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:20.174170 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c83854-cbb3-43e8-af26-1955d46dcdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:20.174609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c83854-cbb3-43e8-af26-1955d46dcdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:20.175014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c83854-cbb3-43e8-af26-1955d46dcdf5 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:20.175952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c83854-cbb3-43e8-af26-1955d46dcdf5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:20.176415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c83854-cbb3-43e8-af26-1955d46dcdf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:20.177964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c83854-cbb3-43e8-af26-1955d46dcdf5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:20.182811 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 444/879] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 6 01:00:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:20.188589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714c2e-f578-4040-bd33-b33846b97bd4 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:20.190026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947ba78-ae47-44f4-8349-f77bc6aece3c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:20.190467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947ba78-ae47-44f4-8349-f77bc6aece3c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:20.190873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947ba78-ae47-44f4-8349-f77bc6aece3c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:20.197701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 445/880] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:00:20.200059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b1599-aa08-46fd-9504-c4e424a67686 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:20.200537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b1599-aa08-46fd-9504-c4e424a67686 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:20.201446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b1599-aa08-46fd-9504-c4e424a67686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:20.226029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-997b1599-aa08-46fd-9504-c4e424a67686 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:20.227419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-997b1599-aa08-46fd-9504-c4e424a67686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:20.283971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:20.299288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714c2e-f578-4040-bd33-b33846b97bd4 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:20.332362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 446/881] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:20 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:00:20.337008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:20.342445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a607d2-3c38-4161-b1d3-332ceebd0294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:20.343060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a607d2-3c38-4161-b1d3-332ceebd0294 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:20.343414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a607d2-3c38-4161-b1d3-332ceebd0294 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:20.343701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a607d2-3c38-4161-b1d3-332ceebd0294 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:20.344340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a607d2-3c38-4161-b1d3-332ceebd0294 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:20.345018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a607d2-3c38-4161-b1d3-332ceebd0294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:20.346781 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a607d2-3c38-4161-b1d3-332ceebd0294 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:20.352235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 436/882] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 6 01:00:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:20.390454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b1599-aa08-46fd-9504-c4e424a67686 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:20.513607 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b1599-aa08-46fd-9504-c4e424a67686 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:20.550464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7e8c1-ac61-4fc5-a50d-ab7499703b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:20.551086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7e8c1-ac61-4fc5-a50d-ab7499703b9a None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:20.551366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7e8c1-ac61-4fc5-a50d-ab7499703b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:20.551639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7e8c1-ac61-4fc5-a50d-ab7499703b9a None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:20.552332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7e8c1-ac61-4fc5-a50d-ab7499703b9a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:20.553757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7e8c1-ac61-4fc5-a50d-ab7499703b9a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:20.574624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 447/883] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 01:00:20 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:20.617227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a607d2-3c38-4161-b1d3-332ceebd0294 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:20.730502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a607d2-3c38-4161-b1d3-332ceebd0294 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:20.771301 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586b340-71c7-438b-9b3a-52828d078644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:20.771931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586b340-71c7-438b-9b3a-52828d078644 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:20.772202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586b340-71c7-438b-9b3a-52828d078644 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:20.772501 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586b340-71c7-438b-9b3a-52828d078644 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:20.783319 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586b340-71c7-438b-9b3a-52828d078644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-9586b340-71c7-438b-9b3a-52828d078644 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:20.788509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:20.789460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:20.790323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:20.790323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:20.790323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:20.790323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:20.790323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:20.790323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:20.790323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:20.790323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:20.790323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:20.790323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:20.790323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 01:00:20.790323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:20.793832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 437/884] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Sep 6 01:00:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:20.796079 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7e8c1-ac61-4fc5-a50d-ab7499703b9a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:20.831301 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:20.900307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7e8c1-ac61-4fc5-a50d-ab7499703b9a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:20.936112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fd4be-adca-400e-8915-d5b1ab2e680f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:20.936756 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fd4be-adca-400e-8915-d5b1ab2e680f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:20.937031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fd4be-adca-400e-8915-d5b1ab2e680f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:20.937299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fd4be-adca-400e-8915-d5b1ab2e680f None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:20.937965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fd4be-adca-400e-8915-d5b1ab2e680f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:20.938261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fd4be-adca-400e-8915-d5b1ab2e680f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:20.939679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fd4be-adca-400e-8915-d5b1ab2e680f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:20.952407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 448/885] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 6 01:00:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:20.954870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586b340-71c7-438b-9b3a-52828d078644 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:21.011901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:21.061090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586b340-71c7-438b-9b3a-52828d078644 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:21.104856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621f721-e6ef-41a7-bf3d-de3d776423ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:21.105834 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f721-e6ef-41a7-bf3d-de3d776423ec None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:21.106291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f721-e6ef-41a7-bf3d-de3d776423ec None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:21.106696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f721-e6ef-41a7-bf3d-de3d776423ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:21.117448 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621f721-e6ef-41a7-bf3d-de3d776423ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:21.119169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621f721-e6ef-41a7-bf3d-de3d776423ec None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-a621f721-e6ef-41a7-bf3d-de3d776423ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:21.134608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:21.135778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:21.137212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:21.137212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:21.137212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:21.138960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 438/886] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:21.145416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fd4be-adca-400e-8915-d5b1ab2e680f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:21.243260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:21.249617 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fd4be-adca-400e-8915-d5b1ab2e680f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:21.283304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946e7ea-0b9b-4f21-b233-a9f08ec0e813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:21.283826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946e7ea-0b9b-4f21-b233-a9f08ec0e813 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:21.284100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946e7ea-0b9b-4f21-b233-a9f08ec0e813 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:21.284394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946e7ea-0b9b-4f21-b233-a9f08ec0e813 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:21.285377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946e7ea-0b9b-4f21-b233-a9f08ec0e813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:21.285673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946e7ea-0b9b-4f21-b233-a9f08ec0e813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:21.287092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946e7ea-0b9b-4f21-b233-a9f08ec0e813 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:21.299655 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 449/887] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:21.305202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621f721-e6ef-41a7-bf3d-de3d776423ec None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:21.412968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621f721-e6ef-41a7-bf3d-de3d776423ec None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:21.415697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:21.450497 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63b0e-5ed4-4705-9301-5532b050cd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:21.451483 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63b0e-5ed4-4705-9301-5532b050cd4a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:21.451957 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63b0e-5ed4-4705-9301-5532b050cd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:21.452439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63b0e-5ed4-4705-9301-5532b050cd4a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:21.459524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811405e-d4dc-4ab8-bd9a-f9c57b44ff8e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:21.459886 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811405e-d4dc-4ab8-bd9a-f9c57b44ff8e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:21.460229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811405e-d4dc-4ab8-bd9a-f9c57b44ff8e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:21.460945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a63b0e-5ed4-4705-9301-5532b050cd4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:21.462002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 450/888] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:21.462840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a63b0e-5ed4-4705-9301-5532b050cd4a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:21.467207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5f7ac-51a7-4c7d-a55f-59e43b31c86f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:21.467363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5f7ac-51a7-4c7d-a55f-59e43b31c86f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:21.467586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5f7ac-51a7-4c7d-a55f-59e43b31c86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-12a63b0e-5ed4-4705-9301-5532b050cd4a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:21.477539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:21.478553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:21.479520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:21.479520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:21.479520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:21.479520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:21.479520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:21.479520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:21.479520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:21.479520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:21.479520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 01:00:21.479520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:21.482303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 439/889] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 6 01:00:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:21.487979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63b0e-5ed4-4705-9301-5532b050cd4a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:21.489001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e5c5f7ac-51a7-4c7d-a55f-59e43b31c86f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:21.491159 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e5c5f7ac-51a7-4c7d-a55f-59e43b31c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:21.583938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 451/890] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:21.594547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63b0e-5ed4-4705-9301-5532b050cd4a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:21.630690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfc587-0a78-4236-81f2-f5bb5d857d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:21.631698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfc587-0a78-4236-81f2-f5bb5d857d42 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:21.632323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfc587-0a78-4236-81f2-f5bb5d857d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:21.632788 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfc587-0a78-4236-81f2-f5bb5d857d42 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:21.633698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfc587-0a78-4236-81f2-f5bb5d857d42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:21.634202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfc587-0a78-4236-81f2-f5bb5d857d42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:21.635852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfc587-0a78-4236-81f2-f5bb5d857d42 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:21.654975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 440/891] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Sep 6 01:00:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:21.660642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5f7ac-51a7-4c7d-a55f-59e43b31c86f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:21.745075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:21.767067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5f7ac-51a7-4c7d-a55f-59e43b31c86f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:21.803162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad0053-ae21-4d14-a1ee-ae67a047959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:21.803875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad0053-ae21-4d14-a1ee-ae67a047959a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:21.804158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad0053-ae21-4d14-a1ee-ae67a047959a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:21.804495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad0053-ae21-4d14-a1ee-ae67a047959a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:21.861807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfc587-0a78-4236-81f2-f5bb5d857d42 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:21.875610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad0053-ae21-4d14-a1ee-ae67a047959a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:21.877162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad0053-ae21-4d14-a1ee-ae67a047959a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:21.888424 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:21.964720 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfc587-0a78-4236-81f2-f5bb5d857d42 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:21.967359 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:21.986049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 452/892] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:21 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:00:21.991356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad0053-ae21-4d14-a1ee-ae67a047959a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:22.004257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed32c68-3697-4aea-8ad4-7879eee513ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:22.005248 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed32c68-3697-4aea-8ad4-7879eee513ec None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.005737 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed32c68-3697-4aea-8ad4-7879eee513ec None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.006195 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed32c68-3697-4aea-8ad4-7879eee513ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.006962 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed32c68-3697-4aea-8ad4-7879eee513ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:22.008610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed32c68-3697-4aea-8ad4-7879eee513ec None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-7ed32c68-3697-4aea-8ad4-7879eee513ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:22.018417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:22.019467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 01:00:22.020348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:22.027831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 441/893] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 01:00:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:22.029490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed32c68-3697-4aea-8ad4-7879eee513ec None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:22.104764 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad0053-ae21-4d14-a1ee-ae67a047959a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:22.119094 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:22.135260 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed32c68-3697-4aea-8ad4-7879eee513ec None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:22.144555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d2114-d021-4279-93c7-eb04342ac9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:22.145190 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2114-d021-4279-93c7-eb04342ac9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.145463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2114-d021-4279-93c7-eb04342ac9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.146007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2114-d021-4279-93c7-eb04342ac9c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.160601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d2114-d021-4279-93c7-eb04342ac9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:22.162182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d2114-d021-4279-93c7-eb04342ac9c7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:22.174049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34999e-4850-4a8f-b81d-48e82faabb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:22.174973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34999e-4850-4a8f-b81d-48e82faabb1b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.175455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34999e-4850-4a8f-b81d-48e82faabb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.175912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34999e-4850-4a8f-b81d-48e82faabb1b None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.176772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34999e-4850-4a8f-b81d-48e82faabb1b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:22.177267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34999e-4850-4a8f-b81d-48e82faabb1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b20d2114-d021-4279-93c7-eb04342ac9c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:22.177901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:22.178853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:22.179754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:22.179754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:22.179754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:22.181547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34999e-4850-4a8f-b81d-48e82faabb1b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:22.184134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 453/894] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:22.185045 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d2114-d021-4279-93c7-eb04342ac9c7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:22.193680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 442/895] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 01:00:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:22.197308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34999e-4850-4a8f-b81d-48e82faabb1b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:22.232769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:22.313968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d2114-d021-4279-93c7-eb04342ac9c7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:22.330987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34999e-4850-4a8f-b81d-48e82faabb1b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:22.349720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f0bf6-e38c-4f70-9263-be6330e0a500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:22.350419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f0bf6-e38c-4f70-9263-be6330e0a500 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.350758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f0bf6-e38c-4f70-9263-be6330e0a500 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.351094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f0bf6-e38c-4f70-9263-be6330e0a500 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.351786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f0bf6-e38c-4f70-9263-be6330e0a500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:22.352146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f0bf6-e38c-4f70-9263-be6330e0a500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:22.353667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f0bf6-e38c-4f70-9263-be6330e0a500 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:22.372854 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 454/896] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:22.374048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a592e-15fc-4007-855f-b2c326ab4f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:22.374845 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a592e-15fc-4007-855f-b2c326ab4f46 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.375285 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a592e-15fc-4007-855f-b2c326ab4f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.375706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a592e-15fc-4007-855f-b2c326ab4f46 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.376528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a592e-15fc-4007-855f-b2c326ab4f46 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:22.377055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a592e-15fc-4007-855f-b2c326ab4f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:22.378352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f0bf6-e38c-4f70-9263-be6330e0a500 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:22.380067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a592e-15fc-4007-855f-b2c326ab4f46 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:22.392482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 443/897] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 01:00:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:22.393878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a592e-15fc-4007-855f-b2c326ab4f46 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:22.416074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:22.488055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:22.492136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f0bf6-e38c-4f70-9263-be6330e0a500 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:22.512063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a592e-15fc-4007-855f-b2c326ab4f46 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:22.527697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f6178-6055-4882-88f8-6bb03cd3e461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:22.528421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f6178-6055-4882-88f8-6bb03cd3e461 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.528696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f6178-6055-4882-88f8-6bb03cd3e461 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.529044 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f6178-6055-4882-88f8-6bb03cd3e461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.536192 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f6178-6055-4882-88f8-6bb03cd3e461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:22.537719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f6178-6055-4882-88f8-6bb03cd3e461 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:22.547823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d28128-e0e5-497a-bbac-238dbcd006d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:22.548461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d28128-e0e5-497a-bbac-238dbcd006d1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.548735 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d28128-e0e5-497a-bbac-238dbcd006d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.548998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d28128-e0e5-497a-bbac-238dbcd006d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-316f6178-6055-4882-88f8-6bb03cd3e461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:22.549315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:22.550243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:22.551157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:22.551157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:22.551157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:22.551157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:22.551157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:22.551157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:22.551157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:22.551157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:22.551592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d28128-e0e5-497a-bbac-238dbcd006d1 None admin] RBAC: Adding query filter params (interface=public, service_id=42125e7a352a47468adfd133f8fefd28, region_id=RegionOne) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:22.551592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d28128-e0e5-497a-bbac-238dbcd006d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:22.551730 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 455/898] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:22.551799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d28128-e0e5-497a-bbac-238dbcd006d1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:22.551875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7571e8-4e79-4eb1-9ca9-b22305923ff3 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.551875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7571e8-4e79-4eb1-9ca9-b22305923ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.552485 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7571e8-4e79-4eb1-9ca9-b22305923ff3 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.554009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 456/899] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:22.554596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea7886-236f-4d41-8d82-ec3574832d9f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.554970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea7886-236f-4d41-8d82-ec3574832d9f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.555132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea7886-236f-4d41-8d82-ec3574832d9f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.556269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 457/900] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:22.556985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 444/901] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 6 01:00:22 2022] GET /identity/v3/endpoints?service_id=42125e7a352a47468adfd133f8fefd28&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:22.561265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d28128-e0e5-497a-bbac-238dbcd006d1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:22.561887 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd2589-4b8d-4977-9a47-9de9ffa1cca7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.562179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd2589-4b8d-4977-9a47-9de9ffa1cca7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.562457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd2589-4b8d-4977-9a47-9de9ffa1cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.581278 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b5fd2589-4b8d-4977-9a47-9de9ffa1cca7 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:22.582482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b5fd2589-4b8d-4977-9a47-9de9ffa1cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:22.639733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:22.648233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 458/902] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:22.649541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc18ec-ab27-4f1b-8ac3-23eb1f5dd420 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.649819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc18ec-ab27-4f1b-8ac3-23eb1f5dd420 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.650115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc18ec-ab27-4f1b-8ac3-23eb1f5dd420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.662957 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d28128-e0e5-497a-bbac-238dbcd006d1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:22.671880 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-79bc18ec-ab27-4f1b-8ac3-23eb1f5dd420 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:22.673087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-79bc18ec-ab27-4f1b-8ac3-23eb1f5dd420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:22.700125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba93c-762b-412e-8e68-cb92d1c33b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:22.701106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba93c-762b-412e-8e68-cb92d1c33b44 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.701722 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba93c-762b-412e-8e68-cb92d1c33b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.702004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba93c-762b-412e-8e68-cb92d1c33b44 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.702848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba93c-762b-412e-8e68-cb92d1c33b44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:22.703165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba93c-762b-412e-8e68-cb92d1c33b44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:22.705249 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba93c-762b-412e-8e68-cb92d1c33b44 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:22.724150 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 445/903] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:22.725088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba93c-762b-412e-8e68-cb92d1c33b44 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:22.741505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 459/904] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:22.749667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc18ec-ab27-4f1b-8ac3-23eb1f5dd420 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:22.773810 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:22.835443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba93c-762b-412e-8e68-cb92d1c33b44 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:22.878854 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0a51b-3535-499f-9470-3453bc7e99fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:22.879890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0a51b-3535-499f-9470-3453bc7e99fc None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.881858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc18ec-ab27-4f1b-8ac3-23eb1f5dd420 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:22.882318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0a51b-3535-499f-9470-3453bc7e99fc None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.882738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0a51b-3535-499f-9470-3453bc7e99fc None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.883487 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0a51b-3535-499f-9470-3453bc7e99fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:22.886471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0a51b-3535-499f-9470-3453bc7e99fc None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:22.896505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 446/905] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 6 01:00:22 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:00:22.909112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0a51b-3535-499f-9470-3453bc7e99fc None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:22.913322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:22.934076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e937f-3fe9-49eb-919e-85b1e5f042ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:22.935061 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e937f-3fe9-49eb-919e-85b1e5f042ae None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:22.935534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e937f-3fe9-49eb-919e-85b1e5f042ae None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:22.935977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e937f-3fe9-49eb-919e-85b1e5f042ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:22.936973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e937f-3fe9-49eb-919e-85b1e5f042ae None admin] RBAC: Adding query filter params (role.id=2fa4518222bd427084475367e47d00cd, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=d56912bcbf0b4ce9b29ace7606deb827) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:22.937430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e937f-3fe9-49eb-919e-85b1e5f042ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:22.939250 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e937f-3fe9-49eb-919e-85b1e5f042ae None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:22.946407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 460/906] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:22 2022] GET /identity/v3/role_assignments?user.id=d56912bcbf0b4ce9b29ace7606deb827&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=2fa4518222bd427084475367e47d00cd => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:23.008376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e937f-3fe9-49eb-919e-85b1e5f042ae None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:23.055027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0a51b-3535-499f-9470-3453bc7e99fc None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:23.098717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614f0c3-9c00-4456-ace4-0faabfebcc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:23.099695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614f0c3-9c00-4456-ace4-0faabfebcc8a None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:23.099977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614f0c3-9c00-4456-ace4-0faabfebcc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:23.100250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614f0c3-9c00-4456-ace4-0faabfebcc8a None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:23.101144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614f0c3-9c00-4456-ace4-0faabfebcc8a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:23.102752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614f0c3-9c00-4456-ace4-0faabfebcc8a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:23.122594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 447/907] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 01:00:22 2022] POST /identity/v3/services => generated 241 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:00:23.124060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:23.144553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e937f-3fe9-49eb-919e-85b1e5f042ae None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:23.192035 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4766c-1ece-427a-ab56-bcbb4a6982c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:23.192704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4766c-1ece-427a-ab56-bcbb4a6982c3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:23.192934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4766c-1ece-427a-ab56-bcbb4a6982c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:23.193171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4766c-1ece-427a-ab56-bcbb4a6982c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:23.193828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4766c-1ece-427a-ab56-bcbb4a6982c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:23.195331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4766c-1ece-427a-ab56-bcbb4a6982c3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-22d4766c-1ece-427a-ab56-bcbb4a6982c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:23.205801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:23.206827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:23.208004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 461/908] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Sep 6 01:00:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:23.216314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614f0c3-9c00-4456-ace4-0faabfebcc8a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:23.285481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:23.330317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614f0c3-9c00-4456-ace4-0faabfebcc8a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:23.365452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dec9e5-d720-42a8-810a-540b7fbbf0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:23.366884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dec9e5-d720-42a8-810a-540b7fbbf0db None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:23.367353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dec9e5-d720-42a8-810a-540b7fbbf0db None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:23.367812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dec9e5-d720-42a8-810a-540b7fbbf0db None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:23.368658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dec9e5-d720-42a8-810a-540b7fbbf0db None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:23.369172 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dec9e5-d720-42a8-810a-540b7fbbf0db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:23.370786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dec9e5-d720-42a8-810a-540b7fbbf0db None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:23.380412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 448/909] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 6 01:00:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:23.383038 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4766c-1ece-427a-ab56-bcbb4a6982c3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:23.488564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4766c-1ece-427a-ab56-bcbb4a6982c3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:23.523392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07330a0-f8cb-40c4-a963-200351494149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:23.524009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07330a0-f8cb-40c4-a963-200351494149 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:23.524307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07330a0-f8cb-40c4-a963-200351494149 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:23.524583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07330a0-f8cb-40c4-a963-200351494149 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:23.525216 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07330a0-f8cb-40c4-a963-200351494149 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:23.525519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07330a0-f8cb-40c4-a963-200351494149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:23.526945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07330a0-f8cb-40c4-a963-200351494149 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:23.532577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 462/910] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 6 01:00:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:23.538945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dec9e5-d720-42a8-810a-540b7fbbf0db None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:23.640735 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dec9e5-d720-42a8-810a-540b7fbbf0db None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:23.667031 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:23.677713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c217f-4924-44fd-9d22-21962b35dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:23.678326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c217f-4924-44fd-9d22-21962b35dd2a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:23.678597 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c217f-4924-44fd-9d22-21962b35dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:23.678861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c217f-4924-44fd-9d22-21962b35dd2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:23.679556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c217f-4924-44fd-9d22-21962b35dd2a None admin] RBAC: Adding query filter params (interface=public, service_id=11587e9be51042d7834dc594e11b65d9, region_id=RegionOne) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:23.679862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c217f-4924-44fd-9d22-21962b35dd2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:23.681297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c217f-4924-44fd-9d22-21962b35dd2a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:23.691306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 449/911] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 6 01:00:23 2022] GET /identity/v3/endpoints?service_id=11587e9be51042d7834dc594e11b65d9&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:23.692832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07330a0-f8cb-40c4-a963-200351494149 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:23.702277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:23.796542 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07330a0-f8cb-40c4-a963-200351494149 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:23.831614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287d551-10ff-476a-ada2-8cabd62f67af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:23.832499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287d551-10ff-476a-ada2-8cabd62f67af None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:23.832912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287d551-10ff-476a-ada2-8cabd62f67af None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:23.833318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287d551-10ff-476a-ada2-8cabd62f67af None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:23.834091 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287d551-10ff-476a-ada2-8cabd62f67af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:23.835627 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287d551-10ff-476a-ada2-8cabd62f67af None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:23.847885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 463/912] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 6 01:00:23 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:00:24.906396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef66b2-b605-4c35-9551-76c106bd433d None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:24.907413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef66b2-b605-4c35-9551-76c106bd433d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:24.907687 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef66b2-b605-4c35-9551-76c106bd433d None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:24.909203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 450/913] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:24.911061 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e0be-31cb-4632-83d4-6a9624abdc1c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:24.911463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e0be-31cb-4632-83d4-6a9624abdc1c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:24.911629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e0be-31cb-4632-83d4-6a9624abdc1c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:24.913211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 464/914] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:24.918965 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e25ae2-35ed-4f16-818d-f90f72bad94e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:24.918965 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e25ae2-35ed-4f16-818d-f90f72bad94e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:24.918965 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e25ae2-35ed-4f16-818d-f90f72bad94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:24.919226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbb120-9548-443c-91e2-5d7f787ed0ee None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:24.919226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbb120-9548-443c-91e2-5d7f787ed0ee None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:24.919385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbb120-9548-443c-91e2-5d7f787ed0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:24.936427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d9e25ae2-35ed-4f16-818d-f90f72bad94e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:24.938068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d9e25ae2-35ed-4f16-818d-f90f72bad94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:24.941641 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-56fbb120-9548-443c-91e2-5d7f787ed0ee None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:24.944862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-56fbb120-9548-443c-91e2-5d7f787ed0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:25.018768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 451/915] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:25.021395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:25.032403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 465/916] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:25.122537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b7ca6-cbcc-4810-a011-69d91aa7b474 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:25.122814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b7ca6-cbcc-4810-a011-69d91aa7b474 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:25.123089 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b7ca6-cbcc-4810-a011-69d91aa7b474 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:25.124707 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 452/917] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:25.129818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990a1bf-1f3c-4321-ae30-9e324f240485 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:25.130102 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990a1bf-1f3c-4321-ae30-9e324f240485 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:25.130468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990a1bf-1f3c-4321-ae30-9e324f240485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:25.149022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5990a1bf-1f3c-4321-ae30-9e324f240485 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:25.150196 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5990a1bf-1f3c-4321-ae30-9e324f240485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:25.217391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 466/918] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:25.288900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b7ca6-cbcc-4810-a011-69d91aa7b474 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:25.305404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990a1bf-1f3c-4321-ae30-9e324f240485 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:25.410749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b7ca6-cbcc-4810-a011-69d91aa7b474 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:25.426339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990a1bf-1f3c-4321-ae30-9e324f240485 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:25.440816 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:25.456319 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52749ed3-3105-448c-bfb9-b6b88a729148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:25.456981 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52749ed3-3105-448c-bfb9-b6b88a729148 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:25.457256 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52749ed3-3105-448c-bfb9-b6b88a729148 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:25.457525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52749ed3-3105-448c-bfb9-b6b88a729148 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:25.458002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:25.466076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f22f06-9605-4bb4-ad2f-c9faad7097c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:25.466920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f22f06-9605-4bb4-ad2f-c9faad7097c2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:25.467372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f22f06-9605-4bb4-ad2f-c9faad7097c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:25.467901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f22f06-9605-4bb4-ad2f-c9faad7097c2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:25.468670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f22f06-9605-4bb4-ad2f-c9faad7097c2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:25.469362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52749ed3-3105-448c-bfb9-b6b88a729148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:25.470473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f22f06-9605-4bb4-ad2f-c9faad7097c2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-52749ed3-3105-448c-bfb9-b6b88a729148 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:25.475086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:25.476036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:25.476953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 453/919] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Sep 6 01:00:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:25.483559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52749ed3-3105-448c-bfb9-b6b88a729148 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-11f22f06-9605-4bb4-ad2f-c9faad7097c2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:25.485029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:25.486037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:25.486922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 467/920] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 01:00:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:25.488885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f22f06-9605-4bb4-ad2f-c9faad7097c2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:25.600059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f22f06-9605-4bb4-ad2f-c9faad7097c2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:25.600702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52749ed3-3105-448c-bfb9-b6b88a729148 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:25.640053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072cee2-e57f-4586-8771-c5b4ea9b2c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:25.640734 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072cee2-e57f-4586-8771-c5b4ea9b2c47 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:25.641011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072cee2-e57f-4586-8771-c5b4ea9b2c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:25.641282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072cee2-e57f-4586-8771-c5b4ea9b2c47 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:25.641867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072cee2-e57f-4586-8771-c5b4ea9b2c47 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:25.642898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb77e99-6bfd-4f60-b833-cbb3e43abc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:25.643279 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072cee2-e57f-4586-8771-c5b4ea9b2c47 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:25.643510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb77e99-6bfd-4f60-b833-cbb3e43abc58 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:25.643989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb77e99-6bfd-4f60-b833-cbb3e43abc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:25.644260 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb77e99-6bfd-4f60-b833-cbb3e43abc58 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:25.644990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb77e99-6bfd-4f60-b833-cbb3e43abc58 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:25.645566 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb77e99-6bfd-4f60-b833-cbb3e43abc58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:25.647627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb77e99-6bfd-4f60-b833-cbb3e43abc58 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7072cee2-e57f-4586-8771-c5b4ea9b2c47 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:25.652738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:25.653862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:25.654839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 468/921] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 6 01:00:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:25.657523 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072cee2-e57f-4586-8771-c5b4ea9b2c47 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:25.660636 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 454/922] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 6 01:00:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:25.661694 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb77e99-6bfd-4f60-b833-cbb3e43abc58 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:25.707226 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:25.720719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:25.765354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072cee2-e57f-4586-8771-c5b4ea9b2c47 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:25.768942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb77e99-6bfd-4f60-b833-cbb3e43abc58 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:25.800966 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5549ba-bd66-466a-9b98-9024fb5f597a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:25.801585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5549ba-bd66-466a-9b98-9024fb5f597a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:25.801862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5549ba-bd66-466a-9b98-9024fb5f597a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:25.802134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5549ba-bd66-466a-9b98-9024fb5f597a None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:25.802773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5549ba-bd66-466a-9b98-9024fb5f597a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:25.803081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5549ba-bd66-466a-9b98-9024fb5f597a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:25.804188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4dd9a-2be0-4366-aed4-66529d6fe9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:25.804535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5549ba-bd66-466a-9b98-9024fb5f597a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:25.804835 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4dd9a-2be0-4366-aed4-66529d6fe9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:25.805110 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4dd9a-2be0-4366-aed4-66529d6fe9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:25.805386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4dd9a-2be0-4366-aed4-66529d6fe9e7 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:25.806008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4dd9a-2be0-4366-aed4-66529d6fe9e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:25.806517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4dd9a-2be0-4366-aed4-66529d6fe9e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:25.807699 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4dd9a-2be0-4366-aed4-66529d6fe9e7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:25.814222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 469/923] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 01:00:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:25.814222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5549ba-bd66-466a-9b98-9024fb5f597a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:25.814489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 455/924] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 6 01:00:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:25.814489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38055d11-dfd8-414c-8812-f026f6ec2cd1 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:25.814489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38055d11-dfd8-414c-8812-f026f6ec2cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:25.814729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38055d11-dfd8-414c-8812-f026f6ec2cd1 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:25.816333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 456/925] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:25.816583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38055d11-dfd8-414c-8812-f026f6ec2cd1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:25.913269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5549ba-bd66-466a-9b98-9024fb5f597a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:25.919607 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38055d11-dfd8-414c-8812-f026f6ec2cd1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:25.926691 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:25.936690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:25.949951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d078bce-e00f-498f-9953-a06c2279f70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:25.950596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d078bce-e00f-498f-9953-a06c2279f70d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:25.950878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d078bce-e00f-498f-9953-a06c2279f70d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:25.951148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d078bce-e00f-498f-9953-a06c2279f70d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:25.954765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f5f12-be6e-46df-8a06-4e8c4ada5100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:25.955380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f5f12-be6e-46df-8a06-4e8c4ada5100 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:25.955659 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f5f12-be6e-46df-8a06-4e8c4ada5100 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:25.955932 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f5f12-be6e-46df-8a06-4e8c4ada5100 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:25.956638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f5f12-be6e-46df-8a06-4e8c4ada5100 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:25.956945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f5f12-be6e-46df-8a06-4e8c4ada5100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:25.958511 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f5f12-be6e-46df-8a06-4e8c4ada5100 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:25.961990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d078bce-e00f-498f-9953-a06c2279f70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:25.963271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 457/926] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 6 01:00:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:25.963477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d078bce-e00f-498f-9953-a06c2279f70d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:25.964060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f5f12-be6e-46df-8a06-4e8c4ada5100 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-0d078bce-e00f-498f-9953-a06c2279f70d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:25.978119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:25.979215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:25.980560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:25.980560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:25.980560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:25.980560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 470/927] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:25.980560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5431ae-b219-45b4-8b29-604446a04640 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:25.981103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5431ae-b219-45b4-8b29-604446a04640 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:25.981103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5431ae-b219-45b4-8b29-604446a04640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:25.998681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9e5431ae-b219-45b4-8b29-604446a04640 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:25.999864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9e5431ae-b219-45b4-8b29-604446a04640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:26.067453 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f5f12-be6e-46df-8a06-4e8c4ada5100 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:26.068968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 471/928] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:26.069801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5431ae-b219-45b4-8b29-604446a04640 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:26.109456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de973c9-3e0c-41fc-9d62-8a38ae48e6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:26.110220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de973c9-3e0c-41fc-9d62-8a38ae48e6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:26.110497 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de973c9-3e0c-41fc-9d62-8a38ae48e6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:26.110766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de973c9-3e0c-41fc-9d62-8a38ae48e6f6 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:26.111390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de973c9-3e0c-41fc-9d62-8a38ae48e6f6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:26.111689 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de973c9-3e0c-41fc-9d62-8a38ae48e6f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:26.113130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de973c9-3e0c-41fc-9d62-8a38ae48e6f6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:26.118080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 458/929] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 6 01:00:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:26.118836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de973c9-3e0c-41fc-9d62-8a38ae48e6f6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:26.157215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:26.180442 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5431ae-b219-45b4-8b29-604446a04640 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:26.183861 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:26.221315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83e5f3-ee98-4aac-9783-e819a79aac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:26.222008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e5f3-ee98-4aac-9783-e819a79aac2a None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:26.222287 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e5f3-ee98-4aac-9783-e819a79aac2a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:26.222561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e5f3-ee98-4aac-9783-e819a79aac2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:26.223230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83e5f3-ee98-4aac-9783-e819a79aac2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:26.224680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83e5f3-ee98-4aac-9783-e819a79aac2a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:26.234070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de973c9-3e0c-41fc-9d62-8a38ae48e6f6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:26.256769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 472/930] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:00:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:26.258542 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83e5f3-ee98-4aac-9783-e819a79aac2a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:26.281918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5753-45fb-47e1-bc6a-aa8fe8100a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:26.282987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5753-45fb-47e1-bc6a-aa8fe8100a6d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:26.283484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5753-45fb-47e1-bc6a-aa8fe8100a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:26.283966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5753-45fb-47e1-bc6a-aa8fe8100a6d None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:26.285377 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d5753-45fb-47e1-bc6a-aa8fe8100a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:26.286019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d5753-45fb-47e1-bc6a-aa8fe8100a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:26.287720 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d5753-45fb-47e1-bc6a-aa8fe8100a6d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:26.302845 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 459/931] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:26.308635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5753-45fb-47e1-bc6a-aa8fe8100a6d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:26.391628 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83e5f3-ee98-4aac-9783-e819a79aac2a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:26.417509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:26.428399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5753-45fb-47e1-bc6a-aa8fe8100a6d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:26.431779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97077f69-c21e-4566-b9ac-944ea4b25295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:26.432433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97077f69-c21e-4566-b9ac-944ea4b25295 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:26.432707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97077f69-c21e-4566-b9ac-944ea4b25295 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:26.432963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97077f69-c21e-4566-b9ac-944ea4b25295 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:26.433804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97077f69-c21e-4566-b9ac-944ea4b25295 None admin] RBAC: Adding query filter params (interface=public, service_id=36c7cde3c1e8417dad6716ab7c4df39c, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:26.434110 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97077f69-c21e-4566-b9ac-944ea4b25295 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:26.435673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97077f69-c21e-4566-b9ac-944ea4b25295 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:26.441235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 473/932] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 6 01:00:26 2022] GET /identity/v3/endpoints?service_id=36c7cde3c1e8417dad6716ab7c4df39c&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:26.442115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97077f69-c21e-4566-b9ac-944ea4b25295 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:26.467377 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cec57-5ec0-4b35-a754-3d9ee55b6416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:26.468019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cec57-5ec0-4b35-a754-3d9ee55b6416 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:26.468326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cec57-5ec0-4b35-a754-3d9ee55b6416 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:26.468601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cec57-5ec0-4b35-a754-3d9ee55b6416 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:26.470363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:26.477001 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cec57-5ec0-4b35-a754-3d9ee55b6416 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:26.478944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cec57-5ec0-4b35-a754-3d9ee55b6416 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-0b4cec57-5ec0-4b35-a754-3d9ee55b6416 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:26.493759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:26.494790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:26.501217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:26.501217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:26.501217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:26.501217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:26.501217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:26.501217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:26.501217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:26.501217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:26.501217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 01:00:26.501217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:26.501217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 460/933] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 6 01:00:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:26.501217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cec57-5ec0-4b35-a754-3d9ee55b6416 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:26.551327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97077f69-c21e-4566-b9ac-944ea4b25295 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:26.585315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e2143-7bb6-4343-a454-bf32b85c0bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:26.585952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e2143-7bb6-4343-a454-bf32b85c0bdd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:26.586233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e2143-7bb6-4343-a454-bf32b85c0bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:26.586505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e2143-7bb6-4343-a454-bf32b85c0bdd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:26.587127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e2143-7bb6-4343-a454-bf32b85c0bdd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:26.588544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e2143-7bb6-4343-a454-bf32b85c0bdd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-299e2143-7bb6-4343-a454-bf32b85c0bdd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:26.597776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:26.598863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:26.601477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 474/934] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Sep 6 01:00:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:26.602282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e2143-7bb6-4343-a454-bf32b85c0bdd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:26.611458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cec57-5ec0-4b35-a754-3d9ee55b6416 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:26.649066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc05b5b-bbb0-4465-82af-97382412ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:26.650023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc05b5b-bbb0-4465-82af-97382412ef1b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:26.650491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc05b5b-bbb0-4465-82af-97382412ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:26.650979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc05b5b-bbb0-4465-82af-97382412ef1b None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:26.651875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc05b5b-bbb0-4465-82af-97382412ef1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:26.654037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc05b5b-bbb0-4465-82af-97382412ef1b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:26.668563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 461/935] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 6 01:00:26 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:00:26.669896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc05b5b-bbb0-4465-82af-97382412ef1b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:26.693157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:26.709440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:26.731463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e2143-7bb6-4343-a454-bf32b85c0bdd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:26.785540 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be2ba2-e053-424a-8882-b17e98a84adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:26.786176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be2ba2-e053-424a-8882-b17e98a84adc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:26.786499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be2ba2-e053-424a-8882-b17e98a84adc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:26.786778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be2ba2-e053-424a-8882-b17e98a84adc None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:26.787641 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be2ba2-e053-424a-8882-b17e98a84adc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:26.787952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be2ba2-e053-424a-8882-b17e98a84adc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:26.789510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be2ba2-e053-424a-8882-b17e98a84adc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:26.811828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 475/936] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Sep 6 01:00:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:26.817103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be2ba2-e053-424a-8882-b17e98a84adc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:26.822844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc05b5b-bbb0-4465-82af-97382412ef1b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:26.863978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fbdfa-a37e-4bc4-bf7d-45b8b1d3fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:26.864668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fbdfa-a37e-4bc4-bf7d-45b8b1d3fe21 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:26.864930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fbdfa-a37e-4bc4-bf7d-45b8b1d3fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:26.865203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fbdfa-a37e-4bc4-bf7d-45b8b1d3fe21 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:26.866649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fbdfa-a37e-4bc4-bf7d-45b8b1d3fe21 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:26.866959 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fbdfa-a37e-4bc4-bf7d-45b8b1d3fe21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:26.868466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fbdfa-a37e-4bc4-bf7d-45b8b1d3fe21 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:26.874162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 462/937] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 6 01:00:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:26.879817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fbdfa-a37e-4bc4-bf7d-45b8b1d3fe21 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:26.947191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be2ba2-e053-424a-8882-b17e98a84adc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:26.962923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:26.987036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fbdfa-a37e-4bc4-bf7d-45b8b1d3fe21 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:26.997648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a615-76b5-4c80-a436-3a3981645dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:26.999003 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a615-76b5-4c80-a436-3a3981645dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:26.999562 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a615-76b5-4c80-a436-3a3981645dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:27.000265 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a615-76b5-4c80-a436-3a3981645dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:27.013521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00a615-76b5-4c80-a436-3a3981645dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:27.016013 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00a615-76b5-4c80-a436-3a3981645dd1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:27.028654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:27.030049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839dedf-ca0f-47e7-8396-8215c4912872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:27.030684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839dedf-ca0f-47e7-8396-8215c4912872 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:27.030960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839dedf-ca0f-47e7-8396-8215c4912872 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:27.031230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839dedf-ca0f-47e7-8396-8215c4912872 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:27.031915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839dedf-ca0f-47e7-8396-8215c4912872 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:27.032273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839dedf-ca0f-47e7-8396-8215c4912872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:27.033705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839dedf-ca0f-47e7-8396-8215c4912872 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6a00a615-76b5-4c80-a436-3a3981645dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:27.038757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:27.039694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:27.041315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:27.041315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:27.041315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:27.041315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 476/938] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:27.046009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a615-76b5-4c80-a436-3a3981645dd1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:27.051725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 463/939] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 6 01:00:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:27.064312 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839dedf-ca0f-47e7-8396-8215c4912872 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:27.157429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a615-76b5-4c80-a436-3a3981645dd1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:27.192685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839dedf-ca0f-47e7-8396-8215c4912872 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:27.195285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db7891-f870-4a5b-bb38-4de2d1a8d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:27.196059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db7891-f870-4a5b-bb38-4de2d1a8d85b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:27.196526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db7891-f870-4a5b-bb38-4de2d1a8d85b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:27.196903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db7891-f870-4a5b-bb38-4de2d1a8d85b None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:27.197659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db7891-f870-4a5b-bb38-4de2d1a8d85b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:27.198058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db7891-f870-4a5b-bb38-4de2d1a8d85b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:27.199657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db7891-f870-4a5b-bb38-4de2d1a8d85b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:27.217896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 477/940] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:27.219077 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db7891-f870-4a5b-bb38-4de2d1a8d85b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:27.236899 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a642f9-f08a-428e-864e-09c321043bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:27.238338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a642f9-f08a-428e-864e-09c321043bf3 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:27.238618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a642f9-f08a-428e-864e-09c321043bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:27.238891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a642f9-f08a-428e-864e-09c321043bf3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:27.239566 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a642f9-f08a-428e-864e-09c321043bf3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:27.241032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a642f9-f08a-428e-864e-09c321043bf3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:27.261099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:27.276708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 464/941] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:00:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:27.308713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:27.347779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db7891-f870-4a5b-bb38-4de2d1a8d85b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:27.395527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a2dd0-9020-4909-8625-b4af1d9ab737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:27.396176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a2dd0-9020-4909-8625-b4af1d9ab737 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:27.396492 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a2dd0-9020-4909-8625-b4af1d9ab737 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:27.396755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a2dd0-9020-4909-8625-b4af1d9ab737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:27.404762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a2dd0-9020-4909-8625-b4af1d9ab737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:27.406338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a2dd0-9020-4909-8625-b4af1d9ab737 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e27a2dd0-9020-4909-8625-b4af1d9ab737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:27.420008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:27.421059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:27.421997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:27.421997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:27.421997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:27.421997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:27.421997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:27.421997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:27.421997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:27.421997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:27.421997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 478/942] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:27.434017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a642f9-f08a-428e-864e-09c321043bf3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:27.545374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a642f9-f08a-428e-864e-09c321043bf3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:27.580495 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47314b82-a430-40b8-b91a-c58613e6e8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:27.581468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47314b82-a430-40b8-b91a-c58613e6e8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:27.581955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47314b82-a430-40b8-b91a-c58613e6e8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:27.582455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47314b82-a430-40b8-b91a-c58613e6e8c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:27.583350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47314b82-a430-40b8-b91a-c58613e6e8c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:27.583865 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47314b82-a430-40b8-b91a-c58613e6e8c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:27.585590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47314b82-a430-40b8-b91a-c58613e6e8c2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:27.602191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 465/943] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:27.608690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a2dd0-9020-4909-8625-b4af1d9ab737 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:27.713657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a2dd0-9020-4909-8625-b4af1d9ab737 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:27.728682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:27.749490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d4813-6c6a-423d-987c-6a8a8512ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:27.750179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d4813-6c6a-423d-987c-6a8a8512ff61 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:27.750458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d4813-6c6a-423d-987c-6a8a8512ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:27.750737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d4813-6c6a-423d-987c-6a8a8512ff61 None admin] PATH_INFO: `/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/d56912bcbf0b4ce9b29ace7606deb827/roles/2fa4518222bd427084475367e47d00cd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:27.753388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d4813-6c6a-423d-987c-6a8a8512ff61 None admin] RBAC: Authorizing `identity:create_grant(project_id=d31b0823b61d4895accd0f27e6006b08, user_id=d56912bcbf0b4ce9b29ace7606deb827, role_id=2fa4518222bd427084475367e47d00cd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:27.754894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d4813-6c6a-423d-987c-6a8a8512ff61 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:27.771735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 479/944] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 01:00:27 2022] PUT /identity/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/d56912bcbf0b4ce9b29ace7606deb827/roles/2fa4518222bd427084475367e47d00cd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:00:28.278389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6b814-cc40-476f-b79b-7d259c3b5356 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:28.278948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6b814-cc40-476f-b79b-7d259c3b5356 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:28.278948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6b814-cc40-476f-b79b-7d259c3b5356 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:28.280676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 466/945] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:28.286382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6a6ab-fa4f-40c9-bed9-5b41aedb038e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:28.286783 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6a6ab-fa4f-40c9-bed9-5b41aedb038e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:28.286938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6a6ab-fa4f-40c9-bed9-5b41aedb038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:28.305624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-aeb6a6ab-fa4f-40c9-bed9-5b41aedb038e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:28.306735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-aeb6a6ab-fa4f-40c9-bed9-5b41aedb038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:28.380363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 480/946] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:28.645654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6b814-cc40-476f-b79b-7d259c3b5356 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:28.685444 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25eb4d-34b6-4677-954b-4c648a0de521 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:28.686110 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25eb4d-34b6-4677-954b-4c648a0de521 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:28.686610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25eb4d-34b6-4677-954b-4c648a0de521 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:28.688434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 481/947] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:00:28.693122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc44b0-3259-468d-9cf6-851423297990 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:28.693401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc44b0-3259-468d-9cf6-851423297990 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:28.693674 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc44b0-3259-468d-9cf6-851423297990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:28.711661 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:28.711871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2ddc44b0-3259-468d-9cf6-851423297990 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:28.713011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2ddc44b0-3259-468d-9cf6-851423297990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:28.757013 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6b814-cc40-476f-b79b-7d259c3b5356 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:28.796261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 482/948] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:00:28.805062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce334aa-2d66-44e7-8c22-5d003c2e200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:28.805889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce334aa-2d66-44e7-8c22-5d003c2e200b None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:28.806287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce334aa-2d66-44e7-8c22-5d003c2e200b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:28.806680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce334aa-2d66-44e7-8c22-5d003c2e200b None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:28.807458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce334aa-2d66-44e7-8c22-5d003c2e200b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:28.809366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce334aa-2d66-44e7-8c22-5d003c2e200b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:28.812225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: WARNING keystone.server.flask.common [None req-6ce334aa-2d66-44e7-8c22-5d003c2e200b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 06 01:00:28.833203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.sql.core [None req-6ce334aa-2d66-44e7-8c22-5d003c2e200b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 01:00:28.833203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 01:00:28.833203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [parameters: {'id': '11613b4160694f54aaadf0f01b44c32d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 01:00:28.833203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81742) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-6ce334aa-2d66-44e7-8c22-5d003c2e200b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11613b4160694f54aaadf0f01b44c32d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11613b4160694f54aaadf0f01b44c32d. Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application conn.query(q) Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 01:00:28.851162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application result.read() Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 06 01:00:28.852122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application next(self.gen) Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application yield resource Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application next(self.gen) Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise self.value Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application session.commit() Sep 06 01:00:28.853175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.session.flush() Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application compat.raise_( Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 01:00:28.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 01:00:28.854989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application conn.query(q) Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application result.read() Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 01:00:28.855863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [parameters: {'id': '11613b4160694f54aaadf0f01b44c32d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:28.857056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:28.857887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:28.858800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:28.858800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 06 01:00:28.858800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 06 01:00:28.858800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:28.858800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:28.858800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 06 01:00:28.858800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 06 01:00:28.858800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11613b4160694f54aaadf0f01b44c32d. Sep 06 01:00:28.858800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:28.861139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 467/949] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Sep 6 01:00:28 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:28.868378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc44b0-3259-468d-9cf6-851423297990 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:28.906775 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:28.979609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc44b0-3259-468d-9cf6-851423297990 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:29.019971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd7549-fbde-4ec7-98f8-78a6eadd5920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:29.019971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd7549-fbde-4ec7-98f8-78a6eadd5920 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:29.019971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd7549-fbde-4ec7-98f8-78a6eadd5920 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:29.019971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd7549-fbde-4ec7-98f8-78a6eadd5920 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:29.024453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd7549-fbde-4ec7-98f8-78a6eadd5920 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:29.025985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd7549-fbde-4ec7-98f8-78a6eadd5920 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c3fd7549-fbde-4ec7-98f8-78a6eadd5920 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:29.038010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:29.038901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:29.039837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:29.039837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:29.039837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:29.039837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:29.039837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:29.039837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:29.039837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:29.039837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:29.044399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 483/950] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:29.046394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce334aa-2d66-44e7-8c22-5d003c2e200b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:29.084674 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd7549-fbde-4ec7-98f8-78a6eadd5920 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:29.168719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce334aa-2d66-44e7-8c22-5d003c2e200b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:29.183184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:29.184200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:29.193126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd7549-fbde-4ec7-98f8-78a6eadd5920 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:29.208394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f885f6-7127-4831-89b5-82d685bd001d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:29.209254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f885f6-7127-4831-89b5-82d685bd001d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:29.209673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f885f6-7127-4831-89b5-82d685bd001d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:29.210106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f885f6-7127-4831-89b5-82d685bd001d None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:29.211194 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f885f6-7127-4831-89b5-82d685bd001d None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:29.212022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f885f6-7127-4831-89b5-82d685bd001d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:29.213892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f885f6-7127-4831-89b5-82d685bd001d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:29.230947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2b839-ef33-4d0c-ae26-566894cfee2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:29.231370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2b839-ef33-4d0c-ae26-566894cfee2e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:29.231650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2b839-ef33-4d0c-ae26-566894cfee2e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:29.231923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2b839-ef33-4d0c-ae26-566894cfee2e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:29.232573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2b839-ef33-4d0c-ae26-566894cfee2e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:29.233979 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2b839-ef33-4d0c-ae26-566894cfee2e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9ef2b839-ef33-4d0c-ae26-566894cfee2e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:29.243226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:29.244618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:29.245667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:29.247482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 468/952] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:29.252331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 484/952] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 6 01:00:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:29.253456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f885f6-7127-4831-89b5-82d685bd001d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:29.308909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f74919-c063-464a-a591-94901b3bdf6e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:29.309937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f74919-c063-464a-a591-94901b3bdf6e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:29.309937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f74919-c063-464a-a591-94901b3bdf6e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:29.311049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 485/953] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:00:29.316667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc00ae2-7e3c-4f27-af80-4f5993079a02 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:29.316946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc00ae2-7e3c-4f27-af80-4f5993079a02 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:29.317222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc00ae2-7e3c-4f27-af80-4f5993079a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:29.336572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3cc00ae2-7e3c-4f27-af80-4f5993079a02 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:29.337797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3cc00ae2-7e3c-4f27-af80-4f5993079a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:29.378658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f885f6-7127-4831-89b5-82d685bd001d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:29.417407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f0dd9-80c6-4f8b-8d0a-e247ed8d4fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:29.418075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f0dd9-80c6-4f8b-8d0a-e247ed8d4fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:29.418353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f0dd9-80c6-4f8b-8d0a-e247ed8d4fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:29.418625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f0dd9-80c6-4f8b-8d0a-e247ed8d4fd3 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:29.419325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f0dd9-80c6-4f8b-8d0a-e247ed8d4fd3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:29.419571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f0dd9-80c6-4f8b-8d0a-e247ed8d4fd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:29.421029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f0dd9-80c6-4f8b-8d0a-e247ed8d4fd3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:29.421596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 486/954] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:00:29.434518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 469/955] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 6 01:00:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:29.440208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc00ae2-7e3c-4f27-af80-4f5993079a02 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:29.539181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:29.554081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc00ae2-7e3c-4f27-af80-4f5993079a02 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:29.591454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a01604-8df3-4930-879d-8d44b44a7432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:29.592511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a01604-8df3-4930-879d-8d44b44a7432 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:29.593017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a01604-8df3-4930-879d-8d44b44a7432 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:29.593490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a01604-8df3-4930-879d-8d44b44a7432 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:29.594341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a01604-8df3-4930-879d-8d44b44a7432 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:29.594853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a01604-8df3-4930-879d-8d44b44a7432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:29.596520 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a01604-8df3-4930-879d-8d44b44a7432 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:29.602244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 487/956] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 6 01:00:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:29.612313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f0dd9-80c6-4f8b-8d0a-e247ed8d4fd3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:29.652517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:29.702037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a01604-8df3-4930-879d-8d44b44a7432 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:29.718851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f0dd9-80c6-4f8b-8d0a-e247ed8d4fd3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:29.760575 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21301a62-ff0d-4f31-96f0-191b97a20a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:29.761200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21301a62-ff0d-4f31-96f0-191b97a20a71 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:29.761531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21301a62-ff0d-4f31-96f0-191b97a20a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:29.761798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21301a62-ff0d-4f31-96f0-191b97a20a71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:29.762783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21301a62-ff0d-4f31-96f0-191b97a20a71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:29.764195 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21301a62-ff0d-4f31-96f0-191b97a20a71 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:29.791298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 470/957] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:00:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:29.793340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a664d-7667-4ec7-b83f-384e1aa4f4c0 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:29.793628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a664d-7667-4ec7-b83f-384e1aa4f4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:29.793898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a664d-7667-4ec7-b83f-384e1aa4f4c0 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:29.795955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 471/958] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:29.802148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6878c4b-ac0c-4de8-89a8-4fdc803b5c40 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:29.802467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6878c4b-ac0c-4de8-89a8-4fdc803b5c40 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:29.802842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6878c4b-ac0c-4de8-89a8-4fdc803b5c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:29.823492 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e6878c4b-ac0c-4de8-89a8-4fdc803b5c40 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:29.825718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e6878c4b-ac0c-4de8-89a8-4fdc803b5c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:29.829846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a01604-8df3-4930-879d-8d44b44a7432 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:29.881089 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b834de2-8f00-4eaf-b529-64a8d8257864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:29.882302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b834de2-8f00-4eaf-b529-64a8d8257864 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:29.882736 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b834de2-8f00-4eaf-b529-64a8d8257864 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:29.883246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b834de2-8f00-4eaf-b529-64a8d8257864 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:29.884251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b834de2-8f00-4eaf-b529-64a8d8257864 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:29.886414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b834de2-8f00-4eaf-b529-64a8d8257864 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6b834de2-8f00-4eaf-b529-64a8d8257864 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:29.900715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:29.902210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 01:00:29.903339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:29.911243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 488/959] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:29.912671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 472/960] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:00:29.913238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b834de2-8f00-4eaf-b529-64a8d8257864 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:29.930892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:30.020456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b834de2-8f00-4eaf-b529-64a8d8257864 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:30.057350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1e717-2ec7-4f5f-9c11-fe349b17521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:30.058385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1e717-2ec7-4f5f-9c11-fe349b17521f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:30.058870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1e717-2ec7-4f5f-9c11-fe349b17521f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:30.059343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1e717-2ec7-4f5f-9c11-fe349b17521f None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:30.060212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1e717-2ec7-4f5f-9c11-fe349b17521f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:30.060742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1e717-2ec7-4f5f-9c11-fe349b17521f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:30.062357 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1e717-2ec7-4f5f-9c11-fe349b17521f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:30.072340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 489/961] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:30.074068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6878c4b-ac0c-4de8-89a8-4fdc803b5c40 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:30.100719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:30.180496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6878c4b-ac0c-4de8-89a8-4fdc803b5c40 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:30.188202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1e717-2ec7-4f5f-9c11-fe349b17521f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:30.223980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa2fbb-88da-4bc4-bf66-613fa242d6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:30.224635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa2fbb-88da-4bc4-bf66-613fa242d6cb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:30.224912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa2fbb-88da-4bc4-bf66-613fa242d6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:30.225183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa2fbb-88da-4bc4-bf66-613fa242d6cb None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:30.226618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa2fbb-88da-4bc4-bf66-613fa242d6cb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:30.226929 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa2fbb-88da-4bc4-bf66-613fa242d6cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:30.228405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa2fbb-88da-4bc4-bf66-613fa242d6cb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:30.236363 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 473/962] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:30.281136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:30.307794 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1e717-2ec7-4f5f-9c11-fe349b17521f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:30.345920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eca9eb-8974-4975-bc90-2983dc318391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:30.346571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eca9eb-8974-4975-bc90-2983dc318391 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:30.346841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eca9eb-8974-4975-bc90-2983dc318391 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:30.347088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eca9eb-8974-4975-bc90-2983dc318391 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:30.358911 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eca9eb-8974-4975-bc90-2983dc318391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-93eca9eb-8974-4975-bc90-2983dc318391 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:30.363747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:30.364802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:30.365664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 490/963] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Sep 6 01:00:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:30.373153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa2fbb-88da-4bc4-bf66-613fa242d6cb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:30.468698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:30.483860 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa2fbb-88da-4bc4-bf66-613fa242d6cb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:30.519303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3ef1d-a931-4bf5-9a3b-157ea3eb5018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:30.519940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3ef1d-a931-4bf5-9a3b-157ea3eb5018 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:30.520216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3ef1d-a931-4bf5-9a3b-157ea3eb5018 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:30.520520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3ef1d-a931-4bf5-9a3b-157ea3eb5018 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:30.521203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3ef1d-a931-4bf5-9a3b-157ea3eb5018 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:30.521506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3ef1d-a931-4bf5-9a3b-157ea3eb5018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:30.523039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3ef1d-a931-4bf5-9a3b-157ea3eb5018 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:30.533617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 474/964] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 6 01:00:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:30.539527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eca9eb-8974-4975-bc90-2983dc318391 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:30.642232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eca9eb-8974-4975-bc90-2983dc318391 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:30.677769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be8b4b-c5bf-48a5-b6d9-e4157f7c37e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:30.678785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8b4b-c5bf-48a5-b6d9-e4157f7c37e2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:30.679278 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8b4b-c5bf-48a5-b6d9-e4157f7c37e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:30.679765 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8b4b-c5bf-48a5-b6d9-e4157f7c37e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:30.683000 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:30.690851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be8b4b-c5bf-48a5-b6d9-e4157f7c37e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:30.692472 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be8b4b-c5bf-48a5-b6d9-e4157f7c37e2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f3be8b4b-c5bf-48a5-b6d9-e4157f7c37e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:30.707586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:30.708606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:30.709544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:30.709544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:30.709544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:30.709544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 491/965] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:30.716276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3ef1d-a931-4bf5-9a3b-157ea3eb5018 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:30.827365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3ef1d-a931-4bf5-9a3b-157ea3eb5018 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:30.862184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5f92d-a42d-4061-9abe-9caf1c323b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:30.862798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5f92d-a42d-4061-9abe-9caf1c323b85 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:30.863070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5f92d-a42d-4061-9abe-9caf1c323b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:30.863336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5f92d-a42d-4061-9abe-9caf1c323b85 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:30.863972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5f92d-a42d-4061-9abe-9caf1c323b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:30.864271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5f92d-a42d-4061-9abe-9caf1c323b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:30.865705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5f92d-a42d-4061-9abe-9caf1c323b85 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:30.878653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 475/966] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:30.885620 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be8b4b-c5bf-48a5-b6d9-e4157f7c37e2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:30.989036 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be8b4b-c5bf-48a5-b6d9-e4157f7c37e2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:31.024314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac8f2c-0f1f-4dd0-91d9-3ff89ded0741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:31.025381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac8f2c-0f1f-4dd0-91d9-3ff89ded0741 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:31.025879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac8f2c-0f1f-4dd0-91d9-3ff89ded0741 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:31.026354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac8f2c-0f1f-4dd0-91d9-3ff89ded0741 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:31.035102 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac8f2c-0f1f-4dd0-91d9-3ff89ded0741 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:31.036903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac8f2c-0f1f-4dd0-91d9-3ff89ded0741 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-04ac8f2c-0f1f-4dd0-91d9-3ff89ded0741 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:31.048755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:31.049741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:31.050713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:31.050713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:31.050713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:31.050713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:31.050713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:31.050713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:31.050713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:31.050713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:31.050713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 01:00:31.050713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:31.050713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 492/967] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 6 01:00:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:31.057386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5f92d-a42d-4061-9abe-9caf1c323b85 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:31.070500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:31.162080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5f92d-a42d-4061-9abe-9caf1c323b85 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:31.198139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6978d5-e125-4d07-991d-b2087db5cca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:31.199179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6978d5-e125-4d07-991d-b2087db5cca4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:31.199693 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6978d5-e125-4d07-991d-b2087db5cca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:31.200169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6978d5-e125-4d07-991d-b2087db5cca4 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:31.201135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6978d5-e125-4d07-991d-b2087db5cca4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:31.201647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6978d5-e125-4d07-991d-b2087db5cca4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:31.203310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6978d5-e125-4d07-991d-b2087db5cca4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:31.222211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 476/968] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Sep 6 01:00:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:31.230425 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac8f2c-0f1f-4dd0-91d9-3ff89ded0741 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:31.279636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:31.333138 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac8f2c-0f1f-4dd0-91d9-3ff89ded0741 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:31.368149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d89de-ae89-41c2-b137-71ac6cd9dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:31.368860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d89de-ae89-41c2-b137-71ac6cd9dd79 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:31.369103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d89de-ae89-41c2-b137-71ac6cd9dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:31.369330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d89de-ae89-41c2-b137-71ac6cd9dd79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:31.389692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506214c7-8bfb-4abc-ae2f-b8a9c50e5a18 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:31.390006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506214c7-8bfb-4abc-ae2f-b8a9c50e5a18 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:31.390429 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506214c7-8bfb-4abc-ae2f-b8a9c50e5a18 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:31.392055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 477/969] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:00:31.397112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231139f-f0ec-47ab-ba69-b913b3f31e89 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:31.397395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231139f-f0ec-47ab-ba69-b913b3f31e89 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:31.397670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231139f-f0ec-47ab-ba69-b913b3f31e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:31.419889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b231139f-f0ec-47ab-ba69-b913b3f31e89 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:31.421209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b231139f-f0ec-47ab-ba69-b913b3f31e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:31.441307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d89de-ae89-41c2-b137-71ac6cd9dd79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:31.442881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d89de-ae89-41c2-b137-71ac6cd9dd79 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:31.498656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:31.501824 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:31.520598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 478/970] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:00:31.556103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 493/971] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:31 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:00:31.561541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231139f-f0ec-47ab-ba69-b913b3f31e89 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:31.661364 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231139f-f0ec-47ab-ba69-b913b3f31e89 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:31.696251 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585750c0-8f89-444f-b546-7fdc49817f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:31.697253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585750c0-8f89-444f-b546-7fdc49817f32 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:31.697729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585750c0-8f89-444f-b546-7fdc49817f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:31.698185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585750c0-8f89-444f-b546-7fdc49817f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:31.709070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585750c0-8f89-444f-b546-7fdc49817f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:31.710859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585750c0-8f89-444f-b546-7fdc49817f32 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-585750c0-8f89-444f-b546-7fdc49817f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:31.725708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:31.726692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:31.727617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:31.727617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:31.727617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:31.729686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 479/972] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:31.740311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d89de-ae89-41c2-b137-71ac6cd9dd79 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:31.788994 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585750c0-8f89-444f-b546-7fdc49817f32 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:31.839972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d89de-ae89-41c2-b137-71ac6cd9dd79 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:31.845258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:31.874953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a581e95-0aef-4c6e-87f3-b3e3c0bd40a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:31.875563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a581e95-0aef-4c6e-87f3-b3e3c0bd40a1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:31.875831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a581e95-0aef-4c6e-87f3-b3e3c0bd40a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:31.876095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a581e95-0aef-4c6e-87f3-b3e3c0bd40a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:31.876757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a581e95-0aef-4c6e-87f3-b3e3c0bd40a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:31.877207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a581e95-0aef-4c6e-87f3-b3e3c0bd40a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:31.878666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a581e95-0aef-4c6e-87f3-b3e3c0bd40a1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:31.894716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 494/973] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:31.894716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4554b9a-2b52-4574-b48d-f0f619b410a5 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:31.894716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4554b9a-2b52-4574-b48d-f0f619b410a5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:31.894716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4554b9a-2b52-4574-b48d-f0f619b410a5 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:31.894716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 495/974] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:31.895617 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4554b9a-2b52-4574-b48d-f0f619b410a5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:31.906973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:31.907869 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585750c0-8f89-444f-b546-7fdc49817f32 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:31.947430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47b924-5698-4ad8-a6b3-85fc39c98fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:31.948433 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47b924-5698-4ad8-a6b3-85fc39c98fcf None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:31.948972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47b924-5698-4ad8-a6b3-85fc39c98fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:31.949565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47b924-5698-4ad8-a6b3-85fc39c98fcf None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:31.950300 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47b924-5698-4ad8-a6b3-85fc39c98fcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:31.951793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47b924-5698-4ad8-a6b3-85fc39c98fcf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:31.967904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.sql.core [None req-be47b924-5698-4ad8-a6b3-85fc39c98fcf None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 01:00:31.967904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 01:00:31.967904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [parameters: {'user_id': '2235f7961d2e4162866339b7310bdeed', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 01:00:31.967904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81742) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-be47b924-5698-4ad8-a6b3-85fc39c98fcf None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application conn.query(q) Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application result.read() Sep 06 01:00:31.979286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 01:00:31.980391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application next(self.gen) Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application yield resource Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application next(self.gen) Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise self.value Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application session.commit() Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 01:00:31.981727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.session.flush() Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application compat.raise_( Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 01:00:31.982864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 01:00:31.983839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application conn.query(q) Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application result.read() Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 01:00:31.984747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [parameters: {'user_id': '2235f7961d2e4162866339b7310bdeed', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:31.985614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 06 01:00:31.986449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 06 01:00:31.987367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 06 01:00:31.987367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 06 01:00:31.987367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 01:00:31.987367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 01:00:31.987367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 01:00:31.987367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:31.987367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 480/975] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Sep 6 01:00:31 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:31.990268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbdd84-d1e0-4131-9dca-1f904c7d0ead None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:31.990687 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbdd84-d1e0-4131-9dca-1f904c7d0ead None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:31.991174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbdd84-d1e0-4131-9dca-1f904c7d0ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:32.015115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4554b9a-2b52-4574-b48d-f0f619b410a5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:32.017109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-65dbdd84-d1e0-4131-9dca-1f904c7d0ead None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:32.018606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-65dbdd84-d1e0-4131-9dca-1f904c7d0ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:32.058235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec56e7-36c2-4e3e-865d-c164d2fa548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:32.058992 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec56e7-36c2-4e3e-865d-c164d2fa548d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:32.059270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec56e7-36c2-4e3e-865d-c164d2fa548d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:32.059547 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec56e7-36c2-4e3e-865d-c164d2fa548d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:32.066552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec56e7-36c2-4e3e-865d-c164d2fa548d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:32.068063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec56e7-36c2-4e3e-865d-c164d2fa548d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-52ec56e7-36c2-4e3e-865d-c164d2fa548d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:32.079837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:32.080859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:32.081958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:32.081958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:32.081958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:32.081958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:32.081958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:32.081958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:32.081958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:32.081958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:32.081958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 496/976] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:32.081958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec56e7-36c2-4e3e-865d-c164d2fa548d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:32.099559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 481/977] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:32.100651 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbdd84-d1e0-4131-9dca-1f904c7d0ead None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:32.156235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:32.174328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:32.220679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec56e7-36c2-4e3e-865d-c164d2fa548d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:32.226147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbdd84-d1e0-4131-9dca-1f904c7d0ead None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:32.255754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bb501-cb8a-46e3-97dc-256fded9f902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:32.256385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bb501-cb8a-46e3-97dc-256fded9f902 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:32.256758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bb501-cb8a-46e3-97dc-256fded9f902 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:32.257118 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bb501-cb8a-46e3-97dc-256fded9f902 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:32.264649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07159ac8-81da-45b4-ac18-911df796a733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:32.265434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70bb501-cb8a-46e3-97dc-256fded9f902 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:32.265651 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07159ac8-81da-45b4-ac18-911df796a733 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:32.266087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07159ac8-81da-45b4-ac18-911df796a733 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:32.266504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07159ac8-81da-45b4-ac18-911df796a733 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:32.267353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07159ac8-81da-45b4-ac18-911df796a733 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:32.267799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07159ac8-81da-45b4-ac18-911df796a733 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:32.268475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70bb501-cb8a-46e3-97dc-256fded9f902 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:32.270001 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07159ac8-81da-45b4-ac18-911df796a733 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b70bb501-cb8a-46e3-97dc-256fded9f902 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:32.280872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:32.282063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:32.283277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:32.283277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:32.283277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:32.283277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:32.283277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:32.283277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:32.283277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:32.283277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:32.283277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 01:00:32.283277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:32.283277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 497/978] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:00:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:32.288714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bb501-cb8a-46e3-97dc-256fded9f902 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:32.290632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 482/979] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:32.297400 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07159ac8-81da-45b4-ac18-911df796a733 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:32.407023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bb501-cb8a-46e3-97dc-256fded9f902 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:32.412086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07159ac8-81da-45b4-ac18-911df796a733 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:32.413657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:32.433867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:32.442193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab67e1f-92d8-4650-ba9a-51c01fc6ae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:32.442804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab67e1f-92d8-4650-ba9a-51c01fc6ae3b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:32.443083 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab67e1f-92d8-4650-ba9a-51c01fc6ae3b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:32.443355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab67e1f-92d8-4650-ba9a-51c01fc6ae3b None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:32.444060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab67e1f-92d8-4650-ba9a-51c01fc6ae3b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:32.444393 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab67e1f-92d8-4650-ba9a-51c01fc6ae3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:32.445907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab67e1f-92d8-4650-ba9a-51c01fc6ae3b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:32.447182 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a5616-2c18-48a8-ad92-6ff885cfa482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:32.447790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a5616-2c18-48a8-ad92-6ff885cfa482 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:32.448065 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a5616-2c18-48a8-ad92-6ff885cfa482 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:32.448357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a5616-2c18-48a8-ad92-6ff885cfa482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:32.449116 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a5616-2c18-48a8-ad92-6ff885cfa482 None admin] RBAC: Adding query filter params (role.id=2fa4518222bd427084475367e47d00cd, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=d56912bcbf0b4ce9b29ace7606deb827) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:32.449421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a5616-2c18-48a8-ad92-6ff885cfa482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:32.450878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a5616-2c18-48a8-ad92-6ff885cfa482 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:32.456557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 483/980] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:32 2022] GET /identity/v3/role_assignments?user.id=d56912bcbf0b4ce9b29ace7606deb827&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=2fa4518222bd427084475367e47d00cd => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:32.457698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8d72-9078-4344-bccf-64294a275cdb None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:32.457978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8d72-9078-4344-bccf-64294a275cdb None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:32.458246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8d72-9078-4344-bccf-64294a275cdb None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:32.463696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 484/981] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:32.463696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c8d72-9078-4344-bccf-64294a275cdb None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:32.488436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 498/982] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 6 01:00:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:32.489737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7cacb-ec7e-422d-98ef-5c459a654402 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:32.490159 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7cacb-ec7e-422d-98ef-5c459a654402 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:32.490430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7cacb-ec7e-422d-98ef-5c459a654402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:32.515922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bae7cacb-ec7e-422d-98ef-5c459a654402 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:32.517329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bae7cacb-ec7e-422d-98ef-5c459a654402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:32.620345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 499/983] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:32.625089 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c8d72-9078-4344-bccf-64294a275cdb None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:32.666506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856f903-551a-4b39-b75d-3a953e2e35f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:32.667152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856f903-551a-4b39-b75d-3a953e2e35f3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:32.667483 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856f903-551a-4b39-b75d-3a953e2e35f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:32.667787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856f903-551a-4b39-b75d-3a953e2e35f3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:32.668424 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856f903-551a-4b39-b75d-3a953e2e35f3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:32.669918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856f903-551a-4b39-b75d-3a953e2e35f3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1856f903-551a-4b39-b75d-3a953e2e35f3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:32.680153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:32.681263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:32.682765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 485/984] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 6 01:00:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:32.687471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7cacb-ec7e-422d-98ef-5c459a654402 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:32.797657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7cacb-ec7e-422d-98ef-5c459a654402 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:32.815220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:32.833804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60540040-036c-41cf-aa21-863445d1eaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:32.834418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60540040-036c-41cf-aa21-863445d1eaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:32.834694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60540040-036c-41cf-aa21-863445d1eaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:32.834964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60540040-036c-41cf-aa21-863445d1eaf0 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:32.835658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60540040-036c-41cf-aa21-863445d1eaf0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:32.835962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60540040-036c-41cf-aa21-863445d1eaf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:32.837418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60540040-036c-41cf-aa21-863445d1eaf0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:32.847047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 500/985] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 6 01:00:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:32.848638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856f903-551a-4b39-b75d-3a953e2e35f3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:32.881269 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:32.889161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60540040-036c-41cf-aa21-863445d1eaf0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:32.956415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856f903-551a-4b39-b75d-3a953e2e35f3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:32.992712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a5c07-6af0-4c09-b113-fc2386287263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:32.993329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a5c07-6af0-4c09-b113-fc2386287263 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:32.993611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a5c07-6af0-4c09-b113-fc2386287263 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:32.993879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a5c07-6af0-4c09-b113-fc2386287263 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:32.994037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60540040-036c-41cf-aa21-863445d1eaf0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:32.994505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a5c07-6af0-4c09-b113-fc2386287263 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:32.994806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a5c07-6af0-4c09-b113-fc2386287263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:32.996273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a5c07-6af0-4c09-b113-fc2386287263 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:33.001712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 486/986] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 6 01:00:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:33.009567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a5c07-6af0-4c09-b113-fc2386287263 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:33.031205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf98911-c21c-4a8b-82d7-8b4a727fa65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:33.031822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf98911-c21c-4a8b-82d7-8b4a727fa65e None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:33.032101 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf98911-c21c-4a8b-82d7-8b4a727fa65e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:33.032423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf98911-c21c-4a8b-82d7-8b4a727fa65e None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:33.033096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf98911-c21c-4a8b-82d7-8b4a727fa65e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:33.034868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf98911-c21c-4a8b-82d7-8b4a727fa65e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:33.060404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 501/987] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 01:00:32 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:00:33.127654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:33.136511 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a5c07-6af0-4c09-b113-fc2386287263 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:33.180988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead4649-5fc7-460d-89d2-885ab2eb4f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:33.181621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4649-5fc7-460d-89d2-885ab2eb4f67 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:33.181897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4649-5fc7-460d-89d2-885ab2eb4f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:33.182168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4649-5fc7-460d-89d2-885ab2eb4f67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:33.182894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead4649-5fc7-460d-89d2-885ab2eb4f67 None admin] RBAC: Adding query filter params (interface=admin, service_id=36c7cde3c1e8417dad6716ab7c4df39c, region_id=RegionOne) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:33.183299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead4649-5fc7-460d-89d2-885ab2eb4f67 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:33.184777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead4649-5fc7-460d-89d2-885ab2eb4f67 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:33.195066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 487/988] 10.222.0.25 () {56 vars in 1249 bytes} [Tue Sep 6 01:00:33 2022] GET /identity/v3/endpoints?service_id=36c7cde3c1e8417dad6716ab7c4df39c&interface=admin®ion_id=RegionOne => generated 193 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:33.196578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf98911-c21c-4a8b-82d7-8b4a727fa65e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:33.242969 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:33.304464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf98911-c21c-4a8b-82d7-8b4a727fa65e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:33.340573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d4efb-b5c0-4ca5-b8ec-216f9b570b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:33.341519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4efb-b5c0-4ca5-b8ec-216f9b570b18 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:33.341974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4efb-b5c0-4ca5-b8ec-216f9b570b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:33.342419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4efb-b5c0-4ca5-b8ec-216f9b570b18 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:33.343196 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d4efb-b5c0-4ca5-b8ec-216f9b570b18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:33.344884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d4efb-b5c0-4ca5-b8ec-216f9b570b18 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:33.352091 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 502/989] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 6 01:00:33 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:00:34.467298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfb558-5942-4c2c-8abd-18db8e12663b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:34.467827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfb558-5942-4c2c-8abd-18db8e12663b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:34.467827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfb558-5942-4c2c-8abd-18db8e12663b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:34.469175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 488/990] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:34.474560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2ed8d-3166-49e8-ae84-22493c305c90 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:34.474985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2ed8d-3166-49e8-ae84-22493c305c90 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:34.475157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2ed8d-3166-49e8-ae84-22493c305c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:34.494473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-96b2ed8d-3166-49e8-ae84-22493c305c90 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:34.495749 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-96b2ed8d-3166-49e8-ae84-22493c305c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:34.568084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 503/991] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:34.835373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfb558-5942-4c2c-8abd-18db8e12663b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:34.947671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfb558-5942-4c2c-8abd-18db8e12663b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:34.985039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee232c9-e1e7-45e3-a3c0-a9a9b72ab528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:34.985678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee232c9-e1e7-45e3-a3c0-a9a9b72ab528 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:34.985957 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee232c9-e1e7-45e3-a3c0-a9a9b72ab528 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:34.986223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee232c9-e1e7-45e3-a3c0-a9a9b72ab528 None admin] PATH_INFO: `/v3/services/image` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:34.986805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee232c9-e1e7-45e3-a3c0-a9a9b72ab528 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:34.988216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee232c9-e1e7-45e3-a3c0-a9a9b72ab528 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:34.994939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34264d53-a38e-47f7-911a-6d4733b6c5d3 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:34.995229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34264d53-a38e-47f7-911a-6d4733b6c5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:34.995563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34264d53-a38e-47f7-911a-6d4733b6c5d3 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:34.997113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 504/992] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-cee232c9-e1e7-45e3-a3c0-a9a9b72ab528 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:34.998357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:34.999322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:35.005211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 489/993] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Sep 6 01:00:34 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:35.006034 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8294a-85f1-4e76-8600-26399b214b45 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:35.006034 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8294a-85f1-4e76-8600-26399b214b45 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:35.006034 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8294a-85f1-4e76-8600-26399b214b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:35.009862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee232c9-e1e7-45e3-a3c0-a9a9b72ab528 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:35.026177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e9e8294a-85f1-4e76-8600-26399b214b45 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:35.027821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e9e8294a-85f1-4e76-8600-26399b214b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:35.034785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:35.061060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:35.111061 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 505/994] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:35.124583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee232c9-e1e7-45e3-a3c0-a9a9b72ab528 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:35.161553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d73337-b3d1-4665-a0d2-5ca5550f6bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:35.162162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d73337-b3d1-4665-a0d2-5ca5550f6bfb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:35.162437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d73337-b3d1-4665-a0d2-5ca5550f6bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:35.162705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d73337-b3d1-4665-a0d2-5ca5550f6bfb None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:35.163328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d73337-b3d1-4665-a0d2-5ca5550f6bfb None admin] RBAC: Adding query filter params (name=image) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:35.163627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d73337-b3d1-4665-a0d2-5ca5550f6bfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:35.165071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d73337-b3d1-4665-a0d2-5ca5550f6bfb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:35.170815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 490/995] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:35.176465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8294a-85f1-4e76-8600-26399b214b45 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:35.229084 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9aaef-d413-43ad-ac45-7a59b67057ba None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:35.229430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9aaef-d413-43ad-ac45-7a59b67057ba None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:35.229657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9aaef-d413-43ad-ac45-7a59b67057ba None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:35.231352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 491/996] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:35.236100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0725d2-d574-4073-bb42-4d2aacefe268 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:35.236422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0725d2-d574-4073-bb42-4d2aacefe268 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:35.236696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0725d2-d574-4073-bb42-4d2aacefe268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:35.255974 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0a0725d2-d574-4073-bb42-4d2aacefe268 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:35.257300 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0a0725d2-d574-4073-bb42-4d2aacefe268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:35.280065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8294a-85f1-4e76-8600-26399b214b45 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:35.317142 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624c308-5972-4537-83c0-04170e823537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:35.317766 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624c308-5972-4537-83c0-04170e823537 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:35.318070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624c308-5972-4537-83c0-04170e823537 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:35.318289 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624c308-5972-4537-83c0-04170e823537 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:35.318920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624c308-5972-4537-83c0-04170e823537 None admin] RBAC: Adding query filter params (type=image) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:35.319222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624c308-5972-4537-83c0-04170e823537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:35.320672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624c308-5972-4537-83c0-04170e823537 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:35.336329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 506/997] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:35.336552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 492/998] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:35.375273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624c308-5972-4537-83c0-04170e823537 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:35.408796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:35.491882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624c308-5972-4537-83c0-04170e823537 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:35.526233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947b504-3361-4f39-92a6-12aa6f155bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:35.526925 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947b504-3361-4f39-92a6-12aa6f155bef None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:35.527197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947b504-3361-4f39-92a6-12aa6f155bef None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:35.527465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947b504-3361-4f39-92a6-12aa6f155bef None admin] PATH_INFO: `/v3/services/compute` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:35.528047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947b504-3361-4f39-92a6-12aa6f155bef None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:35.529490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947b504-3361-4f39-92a6-12aa6f155bef None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-1947b504-3361-4f39-92a6-12aa6f155bef None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:35.538879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:35.539921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:35.540825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 507/999] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:35.546217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0725d2-d574-4073-bb42-4d2aacefe268 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:35.561557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:35.600541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947b504-3361-4f39-92a6-12aa6f155bef None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:35.653271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0725d2-d574-4073-bb42-4d2aacefe268 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:35.690437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6af2b6-c0ed-4c34-9fab-586dc189314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:35.691055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6af2b6-c0ed-4c34-9fab-586dc189314e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:35.691338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6af2b6-c0ed-4c34-9fab-586dc189314e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:35.691585 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6af2b6-c0ed-4c34-9fab-586dc189314e None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:35.692212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6af2b6-c0ed-4c34-9fab-586dc189314e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:35.692579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6af2b6-c0ed-4c34-9fab-586dc189314e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:35.693990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6af2b6-c0ed-4c34-9fab-586dc189314e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:35.704350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 493/1000] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:35.706149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:35.706275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6af2b6-c0ed-4c34-9fab-586dc189314e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:35.716281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947b504-3361-4f39-92a6-12aa6f155bef None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:35.756006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a8cb6-c985-4dc3-acce-5d8fd102b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:35.756847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a8cb6-c985-4dc3-acce-5d8fd102b99d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:35.757114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a8cb6-c985-4dc3-acce-5d8fd102b99d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:35.757392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a8cb6-c985-4dc3-acce-5d8fd102b99d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:35.757968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a8cb6-c985-4dc3-acce-5d8fd102b99d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:35.759395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a8cb6-c985-4dc3-acce-5d8fd102b99d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f40a8cb6-c985-4dc3-acce-5d8fd102b99d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:35.768797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:35.769840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:35.770697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 508/1001] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 6 01:00:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:35.776318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a8cb6-c985-4dc3-acce-5d8fd102b99d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:35.794200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:35.818018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6af2b6-c0ed-4c34-9fab-586dc189314e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:35.853239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4c68-25af-4748-b099-654d429ff21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:35.853846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4c68-25af-4748-b099-654d429ff21d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:35.854122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4c68-25af-4748-b099-654d429ff21d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:35.854390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4c68-25af-4748-b099-654d429ff21d None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:35.855061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe4c68-25af-4748-b099-654d429ff21d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:35.855355 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe4c68-25af-4748-b099-654d429ff21d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:35.856971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe4c68-25af-4748-b099-654d429ff21d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:35.861867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 494/1002] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:35.867556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4c68-25af-4748-b099-654d429ff21d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:35.887631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a8cb6-c985-4dc3-acce-5d8fd102b99d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:35.924096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931805fa-0410-42ad-af8f-e0d4e10a8cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:35.924648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931805fa-0410-42ad-af8f-e0d4e10a8cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:35.924923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931805fa-0410-42ad-af8f-e0d4e10a8cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:35.925284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931805fa-0410-42ad-af8f-e0d4e10a8cd5 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:35.925812 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931805fa-0410-42ad-af8f-e0d4e10a8cd5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:35.926256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931805fa-0410-42ad-af8f-e0d4e10a8cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:35.927512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931805fa-0410-42ad-af8f-e0d4e10a8cd5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:35.937226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 509/1003] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 6 01:00:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:35.938706 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931805fa-0410-42ad-af8f-e0d4e10a8cd5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:35.961237 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:35.973012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4c68-25af-4748-b099-654d429ff21d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:36.010994 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca9ab3-d2cc-452c-8f9b-58158c5e32d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:36.011617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca9ab3-d2cc-452c-8f9b-58158c5e32d9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:36.011892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca9ab3-d2cc-452c-8f9b-58158c5e32d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:36.012174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca9ab3-d2cc-452c-8f9b-58158c5e32d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:36.012891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca9ab3-d2cc-452c-8f9b-58158c5e32d9 None admin] RBAC: Adding query filter params (interface=public, service_id=e9694a2c02b54a8da35f4dcbe262d922, region_id=RegionOne) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:36.013201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca9ab3-d2cc-452c-8f9b-58158c5e32d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:36.014610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca9ab3-d2cc-452c-8f9b-58158c5e32d9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:36.019794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 495/1004] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 6 01:00:35 2022] GET /identity/v3/endpoints?service_id=e9694a2c02b54a8da35f4dcbe262d922&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:36.025393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca9ab3-d2cc-452c-8f9b-58158c5e32d9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:36.028844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:36.051555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931805fa-0410-42ad-af8f-e0d4e10a8cd5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:36.092666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbe6f5-79c0-4b98-b6a1-3afe1990838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:36.093652 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbe6f5-79c0-4b98-b6a1-3afe1990838b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:36.094180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbe6f5-79c0-4b98-b6a1-3afe1990838b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:36.094452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbe6f5-79c0-4b98-b6a1-3afe1990838b None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:36.095080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbe6f5-79c0-4b98-b6a1-3afe1990838b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:36.095378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbe6f5-79c0-4b98-b6a1-3afe1990838b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:36.097042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbe6f5-79c0-4b98-b6a1-3afe1990838b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:36.108352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 510/1005] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 6 01:00:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:36.109621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbe6f5-79c0-4b98-b6a1-3afe1990838b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:36.134647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca9ab3-d2cc-452c-8f9b-58158c5e32d9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:36.174757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d380040-1905-4127-9191-156684b01ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:36.175291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d380040-1905-4127-9191-156684b01ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:36.175566 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d380040-1905-4127-9191-156684b01ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:36.175835 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d380040-1905-4127-9191-156684b01ec0 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:36.176471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d380040-1905-4127-9191-156684b01ec0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:36.177885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d380040-1905-4127-9191-156684b01ec0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:36.184398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 496/1006] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 6 01:00:36 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:00:36.202065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:36.221005 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbe6f5-79c0-4b98-b6a1-3afe1990838b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:36.266515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f755af-7759-4048-97ae-bc2e39363807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:36.267138 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f755af-7759-4048-97ae-bc2e39363807 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:36.267413 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f755af-7759-4048-97ae-bc2e39363807 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:36.267646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f755af-7759-4048-97ae-bc2e39363807 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:36.268361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f755af-7759-4048-97ae-bc2e39363807 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:36.269803 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f755af-7759-4048-97ae-bc2e39363807 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:36.296841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 511/1007] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:00:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:37.244010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e84f6-34a3-4dad-9d6a-17b6ee5e93e2 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:37.244752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e84f6-34a3-4dad-9d6a-17b6ee5e93e2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:37.244752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e84f6-34a3-4dad-9d6a-17b6ee5e93e2 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:37.247715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 497/1008] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:37.253290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593660ba-5e08-4792-a1d5-7d5e1af05918 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:37.253765 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593660ba-5e08-4792-a1d5-7d5e1af05918 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:37.253870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593660ba-5e08-4792-a1d5-7d5e1af05918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:37.273105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-593660ba-5e08-4792-a1d5-7d5e1af05918 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:37.274302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-593660ba-5e08-4792-a1d5-7d5e1af05918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:37.358107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 512/1009] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:37.625175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e84f6-34a3-4dad-9d6a-17b6ee5e93e2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:37.702156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:37.746487 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e84f6-34a3-4dad-9d6a-17b6ee5e93e2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:37.783269 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f5afd-540a-449b-91cc-ccd09f7eec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:37.783887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f5afd-540a-449b-91cc-ccd09f7eec67 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:37.784162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f5afd-540a-449b-91cc-ccd09f7eec67 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:37.784796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f5afd-540a-449b-91cc-ccd09f7eec67 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:37.785467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f5afd-540a-449b-91cc-ccd09f7eec67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:37.786885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f5afd-540a-449b-91cc-ccd09f7eec67 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:37.805811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 498/1010] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 01:00:37 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:38.223865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8da9e-c81a-49d1-a970-132e2268ac6c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:38.224111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8da9e-c81a-49d1-a970-132e2268ac6c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:38.224444 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8da9e-c81a-49d1-a970-132e2268ac6c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:38.225948 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 513/1011] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:00:38.231271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19232a-96e9-4627-bdf4-07420d689d92 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:38.231564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19232a-96e9-4627-bdf4-07420d689d92 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:38.231817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19232a-96e9-4627-bdf4-07420d689d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:38.255247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-bd19232a-96e9-4627-bdf4-07420d689d92 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:38.256466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bd19232a-96e9-4627-bdf4-07420d689d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:38.336761 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 499/1012] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:38 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:38.373132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f74e-03e8-43be-94b2-a555cb4e8b2d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:38.373720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f74e-03e8-43be-94b2-a555cb4e8b2d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:38.373720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f74e-03e8-43be-94b2-a555cb4e8b2d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:38.375138 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 514/1013] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:38.380209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95f6e2-a418-4057-add1-4c7520980688 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:38.380496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95f6e2-a418-4057-add1-4c7520980688 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:38.380823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95f6e2-a418-4057-add1-4c7520980688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:38.399716 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7d95f6e2-a418-4057-add1-4c7520980688 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:38.400914 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7d95f6e2-a418-4057-add1-4c7520980688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:38.453040 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:38.473337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 500/1014] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:38 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:38.601094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532f74e-03e8-43be-94b2-a555cb4e8b2d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:38.676272 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:38.711604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532f74e-03e8-43be-94b2-a555cb4e8b2d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:38.737995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95f6e2-a418-4057-add1-4c7520980688 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:38.751841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5cc8d-4413-48e4-b1b6-87c6a59f56fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:38.752819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5cc8d-4413-48e4-b1b6-87c6a59f56fe None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:38.753101 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5cc8d-4413-48e4-b1b6-87c6a59f56fe None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:38.753373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5cc8d-4413-48e4-b1b6-87c6a59f56fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:38.754130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5cc8d-4413-48e4-b1b6-87c6a59f56fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:38.756198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5cc8d-4413-48e4-b1b6-87c6a59f56fe None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c2d5cc8d-4413-48e4-b1b6-87c6a59f56fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:38.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:38.767336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:38.768193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 515/1015] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:38.773579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5cc8d-4413-48e4-b1b6-87c6a59f56fe None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:38.849866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95f6e2-a418-4057-add1-4c7520980688 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:38.878134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5cc8d-4413-48e4-b1b6-87c6a59f56fe None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:38.887892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bca6fd-6552-4a25-b3eb-0e8a4250aaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:38.889355 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bca6fd-6552-4a25-b3eb-0e8a4250aaeb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:38.890216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bca6fd-6552-4a25-b3eb-0e8a4250aaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:38.890687 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bca6fd-6552-4a25-b3eb-0e8a4250aaeb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:38.892480 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bca6fd-6552-4a25-b3eb-0e8a4250aaeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:38.895129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bca6fd-6552-4a25-b3eb-0e8a4250aaeb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:38.897760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 501/1016] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:38.903044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bca6fd-6552-4a25-b3eb-0e8a4250aaeb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:38.919115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62951ae5-8778-4a50-a685-e01cfc85d584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:38.919740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62951ae5-8778-4a50-a685-e01cfc85d584 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:38.920011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62951ae5-8778-4a50-a685-e01cfc85d584 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:38.920309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62951ae5-8778-4a50-a685-e01cfc85d584 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:38.920944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62951ae5-8778-4a50-a685-e01cfc85d584 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:38.921247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62951ae5-8778-4a50-a685-e01cfc85d584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:38.922685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62951ae5-8778-4a50-a685-e01cfc85d584 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:38.923855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:38.932352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 516/1017] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:38.934584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62951ae5-8778-4a50-a685-e01cfc85d584 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:38.961476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:39.015068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bca6fd-6552-4a25-b3eb-0e8a4250aaeb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:39.040848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62951ae5-8778-4a50-a685-e01cfc85d584 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:39.055103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e8245-53d3-42e5-a970-0f27314fdaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:39.055954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e8245-53d3-42e5-a970-0f27314fdaa7 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:39.056426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e8245-53d3-42e5-a970-0f27314fdaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:39.056874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e8245-53d3-42e5-a970-0f27314fdaa7 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:39.058056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e8245-53d3-42e5-a970-0f27314fdaa7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:39.059836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e8245-53d3-42e5-a970-0f27314fdaa7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:39.074119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f26180-85ac-4f75-a307-5a9da4b817d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:39.074728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f26180-85ac-4f75-a307-5a9da4b817d4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:39.075002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f26180-85ac-4f75-a307-5a9da4b817d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:39.075270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f26180-85ac-4f75-a307-5a9da4b817d4 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:39.075902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f26180-85ac-4f75-a307-5a9da4b817d4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:39.076202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f26180-85ac-4f75-a307-5a9da4b817d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:39.077639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f26180-85ac-4f75-a307-5a9da4b817d4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:39.087291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 517/1018] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 6 01:00:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:39.088538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f26180-85ac-4f75-a307-5a9da4b817d4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:39.093819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 502/1019] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 01:00:38 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:00:39.160244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:39.205693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f26180-85ac-4f75-a307-5a9da4b817d4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:39.243678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d8ef9-ca27-46ff-aac1-775f4be6b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:39.244327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d8ef9-ca27-46ff-aac1-775f4be6b3b3 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:39.244611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d8ef9-ca27-46ff-aac1-775f4be6b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:39.244886 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d8ef9-ca27-46ff-aac1-775f4be6b3b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:39.245642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d8ef9-ca27-46ff-aac1-775f4be6b3b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:39.247070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d8ef9-ca27-46ff-aac1-775f4be6b3b3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:39.271210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 518/1020] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:00:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:39.713718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146da407-405c-4991-ad73-97acfb21cc18 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:39.714412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146da407-405c-4991-ad73-97acfb21cc18 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:39.714690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146da407-405c-4991-ad73-97acfb21cc18 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:39.715963 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 503/1021] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:39.721428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f37577-fbde-433f-b836-d28600d47563 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:39.721857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f37577-fbde-433f-b836-d28600d47563 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:39.721954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f37577-fbde-433f-b836-d28600d47563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:39.741538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-92f37577-fbde-433f-b836-d28600d47563 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:39.742719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-92f37577-fbde-433f-b836-d28600d47563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:39.820692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 519/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:40.085123 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146da407-405c-4991-ad73-97acfb21cc18 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:40.195578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146da407-405c-4991-ad73-97acfb21cc18 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:40.198039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:40.232350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438099eb-d66c-4b1a-a6c5-834af8dc11bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:40.232992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438099eb-d66c-4b1a-a6c5-834af8dc11bf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:40.233254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438099eb-d66c-4b1a-a6c5-834af8dc11bf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:40.233521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438099eb-d66c-4b1a-a6c5-834af8dc11bf None admin] PATH_INFO: `/v3/services/image` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:40.234099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438099eb-d66c-4b1a-a6c5-834af8dc11bf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:40.235538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438099eb-d66c-4b1a-a6c5-834af8dc11bf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-438099eb-d66c-4b1a-a6c5-834af8dc11bf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:40.245176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:40.246494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:40.249461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 504/1023] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Sep 6 01:00:40 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:40.253230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f37577-fbde-433f-b836-d28600d47563 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:40.305339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:40.365889 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f37577-fbde-433f-b836-d28600d47563 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:40.402850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180cde2-b999-48e4-99f5-c46360fe2951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:40.403468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180cde2-b999-48e4-99f5-c46360fe2951 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:40.403743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180cde2-b999-48e4-99f5-c46360fe2951 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:40.404010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180cde2-b999-48e4-99f5-c46360fe2951 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:40.404664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180cde2-b999-48e4-99f5-c46360fe2951 None admin] RBAC: Adding query filter params (name=image) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:40.404952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180cde2-b999-48e4-99f5-c46360fe2951 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:40.406388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180cde2-b999-48e4-99f5-c46360fe2951 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:40.416477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 520/1024] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:40.417741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438099eb-d66c-4b1a-a6c5-834af8dc11bf None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:40.525014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438099eb-d66c-4b1a-a6c5-834af8dc11bf None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:40.559066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a41ee5-1b33-4696-9797-ddbe2dd1327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:40.559591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a41ee5-1b33-4696-9797-ddbe2dd1327b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:40.559865 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a41ee5-1b33-4696-9797-ddbe2dd1327b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:40.560136 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a41ee5-1b33-4696-9797-ddbe2dd1327b None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:40.560786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a41ee5-1b33-4696-9797-ddbe2dd1327b None admin] RBAC: Adding query filter params (type=image) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:40.561082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a41ee5-1b33-4696-9797-ddbe2dd1327b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:40.562518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a41ee5-1b33-4696-9797-ddbe2dd1327b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:40.567581 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 505/1025] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:40.573449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180cde2-b999-48e4-99f5-c46360fe2951 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:40.678436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180cde2-b999-48e4-99f5-c46360fe2951 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:40.688655 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:40.716563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb38797-ac13-46c4-9866-fd22bd045136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:40.717184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb38797-ac13-46c4-9866-fd22bd045136 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:40.717499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb38797-ac13-46c4-9866-fd22bd045136 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:40.717776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb38797-ac13-46c4-9866-fd22bd045136 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:40.718485 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb38797-ac13-46c4-9866-fd22bd045136 None admin] RBAC: Adding query filter params (interface=public, service_id=e065290da6fe47aa99272804405b33e7, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:40.718793 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb38797-ac13-46c4-9866-fd22bd045136 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:40.720221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb38797-ac13-46c4-9866-fd22bd045136 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:40.725877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 521/1026] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 6 01:00:40 2022] GET /identity/v3/endpoints?service_id=e065290da6fe47aa99272804405b33e7&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:40.731894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a41ee5-1b33-4696-9797-ddbe2dd1327b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:40.765565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:40.838271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a41ee5-1b33-4696-9797-ddbe2dd1327b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:40.872968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d8a2b-1f3b-4d9a-818c-a8d941df5a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:40.873587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d8a2b-1f3b-4d9a-818c-a8d941df5a9c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:40.873864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d8a2b-1f3b-4d9a-818c-a8d941df5a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:40.874107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d8a2b-1f3b-4d9a-818c-a8d941df5a9c None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:40.874741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d8a2b-1f3b-4d9a-818c-a8d941df5a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:40.876156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d8a2b-1f3b-4d9a-818c-a8d941df5a9c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:40.883252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 506/1027] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 6 01:00:40 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:00:41.069930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba116d4b-f0f6-4951-ac68-13279aba177f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:41.070164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba116d4b-f0f6-4951-ac68-13279aba177f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:41.070466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba116d4b-f0f6-4951-ac68-13279aba177f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:41.071971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 522/1028] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:41.077228 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd5333-7429-44b2-bd3f-3c7583276d7e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:41.077474 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd5333-7429-44b2-bd3f-3c7583276d7e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:41.077785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd5333-7429-44b2-bd3f-3c7583276d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:41.096477 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-eacd5333-7429-44b2-bd3f-3c7583276d7e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:41.097583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-eacd5333-7429-44b2-bd3f-3c7583276d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:41.169623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 507/1029] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:41.268469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab4022-5138-41c3-bb94-1d5d50ff7670 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:41.268775 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab4022-5138-41c3-bb94-1d5d50ff7670 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:41.269173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab4022-5138-41c3-bb94-1d5d50ff7670 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:41.270612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 523/1030] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:41.275863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d04fcc-19eb-4107-b6b5-1a591963e39d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:41.276126 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d04fcc-19eb-4107-b6b5-1a591963e39d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:41.276968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d04fcc-19eb-4107-b6b5-1a591963e39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:41.296531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-95d04fcc-19eb-4107-b6b5-1a591963e39d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:41.297723 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-95d04fcc-19eb-4107-b6b5-1a591963e39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:41.319113 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:41.369796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 508/1031] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:41.459667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab4022-5138-41c3-bb94-1d5d50ff7670 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:41.604844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab4022-5138-41c3-bb94-1d5d50ff7670 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:41.637738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d04fcc-19eb-4107-b6b5-1a591963e39d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:41.640883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1fda2-911e-4855-8e18-2a7035d76d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:41.641533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1fda2-911e-4855-8e18-2a7035d76d7b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:41.641807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1fda2-911e-4855-8e18-2a7035d76d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:41.642075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1fda2-911e-4855-8e18-2a7035d76d7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:41.643180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1fda2-911e-4855-8e18-2a7035d76d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:41.644829 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1fda2-911e-4855-8e18-2a7035d76d7b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:41.646540 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 524/1032] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:41.652386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1fda2-911e-4855-8e18-2a7035d76d7b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:41.698350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:41.751872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d04fcc-19eb-4107-b6b5-1a591963e39d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:41.768419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1fda2-911e-4855-8e18-2a7035d76d7b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:41.791162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fc457-e3d0-4e7a-a95a-fd1d63c71ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:41.791803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fc457-e3d0-4e7a-a95a-fd1d63c71ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:41.792604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fc457-e3d0-4e7a-a95a-fd1d63c71ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:41.792604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fc457-e3d0-4e7a-a95a-fd1d63c71ee0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:41.802969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4fc457-e3d0-4e7a-a95a-fd1d63c71ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:41.806211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe08b-cbc7-45fc-ae21-5c3b4328ae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:41.806827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe08b-cbc7-45fc-ae21-5c3b4328ae87 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:41.807104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe08b-cbc7-45fc-ae21-5c3b4328ae87 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:41.807375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe08b-cbc7-45fc-ae21-5c3b4328ae87 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-eb4fc457-e3d0-4e7a-a95a-fd1d63c71ee0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:41.807765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:41.809175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:41.810048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:41.810048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:41.810048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:41.810048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:41.810048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:41.810048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:41.810048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:41.810048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:41.810048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:41.810048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:41.810048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 01:00:41.810048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:41.810703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fe08b-cbc7-45fc-ae21-5c3b4328ae87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:41.810784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 509/1033] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Sep 6 01:00:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:41.814678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fe08b-cbc7-45fc-ae21-5c3b4328ae87 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:41.814807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fc457-e3d0-4e7a-a95a-fd1d63c71ee0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:41.835739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:41.844325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 525/1034] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 01:00:41 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:00:41.941765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fc457-e3d0-4e7a-a95a-fd1d63c71ee0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:41.981266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671608e-443d-46ab-b846-8772349b055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:41.981894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671608e-443d-46ab-b846-8772349b055d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:41.982171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671608e-443d-46ab-b846-8772349b055d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:41.982501 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671608e-443d-46ab-b846-8772349b055d None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:41.983178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671608e-443d-46ab-b846-8772349b055d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:41.983484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671608e-443d-46ab-b846-8772349b055d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:41.984948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671608e-443d-46ab-b846-8772349b055d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:41.995927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 510/1035] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 6 01:00:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:42.001575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe08b-cbc7-45fc-ae21-5c3b4328ae87 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:42.104483 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:42.111904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe08b-cbc7-45fc-ae21-5c3b4328ae87 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:42.146498 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd6090-3ed2-4771-822f-630bd72edfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:42.147131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd6090-3ed2-4771-822f-630bd72edfbd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:42.147402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd6090-3ed2-4771-822f-630bd72edfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:42.147669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd6090-3ed2-4771-822f-630bd72edfbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:42.159080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd6090-3ed2-4771-822f-630bd72edfbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:42.160945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd6090-3ed2-4771-822f-630bd72edfbd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5cfd6090-3ed2-4771-822f-630bd72edfbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:42.175184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:42.176198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:42.181387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:42.181387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:42.181387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:42.181387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 526/1036] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:42.184056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671608e-443d-46ab-b846-8772349b055d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:42.269389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:42.297810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671608e-443d-46ab-b846-8772349b055d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:42.332278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3bd16-e6ed-495c-b7b0-d5cde005f8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:42.332931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3bd16-e6ed-495c-b7b0-d5cde005f8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:42.333208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3bd16-e6ed-495c-b7b0-d5cde005f8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:42.333478 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3bd16-e6ed-495c-b7b0-d5cde005f8b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:42.334119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3bd16-e6ed-495c-b7b0-d5cde005f8b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:42.334418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3bd16-e6ed-495c-b7b0-d5cde005f8b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:42.335960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3bd16-e6ed-495c-b7b0-d5cde005f8b1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:42.348446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 511/1037] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:42.353869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd6090-3ed2-4771-822f-630bd72edfbd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:42.459930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd6090-3ed2-4771-822f-630bd72edfbd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:42.494531 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa7f7b-d4b7-434a-ab67-b0f05ee3462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:42.495559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa7f7b-d4b7-434a-ab67-b0f05ee3462d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:42.496040 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa7f7b-d4b7-434a-ab67-b0f05ee3462d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:42.496527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa7f7b-d4b7-434a-ab67-b0f05ee3462d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:42.504653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa7f7b-d4b7-434a-ab67-b0f05ee3462d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:42.506384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa7f7b-d4b7-434a-ab67-b0f05ee3462d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-fdfa7f7b-d4b7-434a-ab67-b0f05ee3462d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:42.518174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:42.519171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:42.520197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:42.520197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:42.520197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:42.520197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:42.520197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:42.520197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:42.520197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:42.520197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:42.520197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 01:00:42.520197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:42.526298 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 527/1038] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 6 01:00:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:42.528022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3bd16-e6ed-495c-b7b0-d5cde005f8b1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:42.632921 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3bd16-e6ed-495c-b7b0-d5cde005f8b1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:42.668985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282639e-51bc-4e0e-88f4-95edaa642bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:42.669589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282639e-51bc-4e0e-88f4-95edaa642bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:42.669866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282639e-51bc-4e0e-88f4-95edaa642bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:42.670137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282639e-51bc-4e0e-88f4-95edaa642bd8 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:42.670827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282639e-51bc-4e0e-88f4-95edaa642bd8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:42.671119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282639e-51bc-4e0e-88f4-95edaa642bd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:42.672607 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282639e-51bc-4e0e-88f4-95edaa642bd8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:42.680950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:42.692020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 512/1039] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 6 01:00:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:42.698523 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa7f7b-d4b7-434a-ab67-b0f05ee3462d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:42.711209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:42.806193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa7f7b-d4b7-434a-ab67-b0f05ee3462d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:42.839336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3718e47-b1b9-4794-8335-30b6f50f8f9c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:42.839874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3718e47-b1b9-4794-8335-30b6f50f8f9c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:42.839955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3718e47-b1b9-4794-8335-30b6f50f8f9c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:42.841497 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 513/1040] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:42.842364 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16008fb3-596f-45ea-90c6-e062150a4934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:42.843070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16008fb3-596f-45ea-90c6-e062150a4934 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:42.843344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16008fb3-596f-45ea-90c6-e062150a4934 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:42.843611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16008fb3-596f-45ea-90c6-e062150a4934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:42.846535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a68d6-67fd-41f1-8f36-89a580dcad49 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:42.846818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a68d6-67fd-41f1-8f36-89a580dcad49 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:42.847087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a68d6-67fd-41f1-8f36-89a580dcad49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:42.867792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2e8a68d6-67fd-41f1-8f36-89a580dcad49 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:42.869010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2e8a68d6-67fd-41f1-8f36-89a580dcad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:42.917622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16008fb3-596f-45ea-90c6-e062150a4934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:42.919134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16008fb3-596f-45ea-90c6-e062150a4934 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:42.929390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:42.944330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 514/1041] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:43.028312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 528/1042] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:42 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:00:43.034054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a68d6-67fd-41f1-8f36-89a580dcad49 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:43.137823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a68d6-67fd-41f1-8f36-89a580dcad49 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:43.164813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:43.174959 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee2f01-a11a-4d6c-84d0-702ace53e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:43.175594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee2f01-a11a-4d6c-84d0-702ace53e42a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:43.175862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee2f01-a11a-4d6c-84d0-702ace53e42a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:43.176127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee2f01-a11a-4d6c-84d0-702ace53e42a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:43.187001 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee2f01-a11a-4d6c-84d0-702ace53e42a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:43.188510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee2f01-a11a-4d6c-84d0-702ace53e42a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-7bee2f01-a11a-4d6c-84d0-702ace53e42a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:43.203773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:43.204990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:43.205929 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:43.205929 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:43.205929 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:43.208439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 515/1043] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:43.209701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16008fb3-596f-45ea-90c6-e062150a4934 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:43.210857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee2f01-a11a-4d6c-84d0-702ace53e42a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:43.315849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee2f01-a11a-4d6c-84d0-702ace53e42a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:43.324779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16008fb3-596f-45ea-90c6-e062150a4934 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:43.335621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:43.350357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af563538-bf9b-4c30-85cd-0cd809584507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:43.350967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af563538-bf9b-4c30-85cd-0cd809584507 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:43.351239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af563538-bf9b-4c30-85cd-0cd809584507 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:43.351507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af563538-bf9b-4c30-85cd-0cd809584507 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:43.352141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af563538-bf9b-4c30-85cd-0cd809584507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:43.352469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af563538-bf9b-4c30-85cd-0cd809584507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:43.353867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af563538-bf9b-4c30-85cd-0cd809584507 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:43.365784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff8102-c7fc-4f93-bc68-243b627455d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:43.371286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff8102-c7fc-4f93-bc68-243b627455d6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:43.371432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 516/1044] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:43.371518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff8102-c7fc-4f93-bc68-243b627455d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:43.371518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff8102-c7fc-4f93-bc68-243b627455d6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:43.371518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff8102-c7fc-4f93-bc68-243b627455d6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:43.371518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff8102-c7fc-4f93-bc68-243b627455d6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:43.372422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af563538-bf9b-4c30-85cd-0cd809584507 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-feff8102-c7fc-4f93-bc68-243b627455d6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:43.381056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:43.382119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:43.382987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 529/1045] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Sep 6 01:00:43 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:43.388141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff8102-c7fc-4f93-bc68-243b627455d6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:43.417863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:43.486305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af563538-bf9b-4c30-85cd-0cd809584507 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:43.497637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff8102-c7fc-4f93-bc68-243b627455d6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:43.523144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8d29e-5466-4157-844b-fa033ce8bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:43.523724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8d29e-5466-4157-844b-fa033ce8bc3c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:43.523996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8d29e-5466-4157-844b-fa033ce8bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:43.524261 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8d29e-5466-4157-844b-fa033ce8bc3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:43.531345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8d29e-5466-4157-844b-fa033ce8bc3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:43.532860 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8d29e-5466-4157-844b-fa033ce8bc3c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:43.533725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a9692-1825-438e-bf74-162d118b032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:43.534674 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a9692-1825-438e-bf74-162d118b032d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:43.534950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a9692-1825-438e-bf74-162d118b032d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:43.535214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a9692-1825-438e-bf74-162d118b032d None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:43.535844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a9692-1825-438e-bf74-162d118b032d None admin] RBAC: Adding query filter params (name=image) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:43.536141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a9692-1825-438e-bf74-162d118b032d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:43.537598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a9692-1825-438e-bf74-162d118b032d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:43.542782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 530/1046] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1bf8d29e-5466-4157-844b-fa033ce8bc3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:43.544872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:43.545799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:43.551685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:43.551685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:43.551685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:43.551685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:43.551685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:43.551685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:43.551685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:43.551685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:43.551685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 517/1047] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:43.551685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8d29e-5466-4157-844b-fa033ce8bc3c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:43.552256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a9692-1825-438e-bf74-162d118b032d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:43.590408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:43.654214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:43.656928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a9692-1825-438e-bf74-162d118b032d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:43.658089 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8d29e-5466-4157-844b-fa033ce8bc3c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:43.692794 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fdd6e-c3a1-4bda-bd2d-3cbd4b336eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:43.693375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fdd6e-c3a1-4bda-bd2d-3cbd4b336eec None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:43.693649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fdd6e-c3a1-4bda-bd2d-3cbd4b336eec None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:43.693915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fdd6e-c3a1-4bda-bd2d-3cbd4b336eec None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:43.694475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844c88-b195-4b04-a5c9-b88a9f74c6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:43.694601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fdd6e-c3a1-4bda-bd2d-3cbd4b336eec None admin] RBAC: Adding query filter params (type=image) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:43.694824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fdd6e-c3a1-4bda-bd2d-3cbd4b336eec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:43.695093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844c88-b195-4b04-a5c9-b88a9f74c6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:43.695358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844c88-b195-4b04-a5c9-b88a9f74c6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:43.695624 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844c88-b195-4b04-a5c9-b88a9f74c6d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:43.696239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fdd6e-c3a1-4bda-bd2d-3cbd4b336eec None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:43.696372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48844c88-b195-4b04-a5c9-b88a9f74c6d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:43.696619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48844c88-b195-4b04-a5c9-b88a9f74c6d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:43.698130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48844c88-b195-4b04-a5c9-b88a9f74c6d0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:43.701633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 531/1048] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:43.707213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fdd6e-c3a1-4bda-bd2d-3cbd4b336eec None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:43.716779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 518/1049] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:43.718238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844c88-b195-4b04-a5c9-b88a9f74c6d0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:43.808340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:43.810843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fdd6e-c3a1-4bda-bd2d-3cbd4b336eec None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:43.828419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844c88-b195-4b04-a5c9-b88a9f74c6d0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:43.847252 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463f843-4f3a-472c-9298-b9a9fd083c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:43.847859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463f843-4f3a-472c-9298-b9a9fd083c0b None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:43.848133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463f843-4f3a-472c-9298-b9a9fd083c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:43.848437 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463f843-4f3a-472c-9298-b9a9fd083c0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:43.849099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463f843-4f3a-472c-9298-b9a9fd083c0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:43.850523 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463f843-4f3a-472c-9298-b9a9fd083c0b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:43.863790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39211ef-8340-445d-9f59-2a6df9beaead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:43.864431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39211ef-8340-445d-9f59-2a6df9beaead None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:43.864780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39211ef-8340-445d-9f59-2a6df9beaead None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:43.865111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39211ef-8340-445d-9f59-2a6df9beaead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:43.866041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39211ef-8340-445d-9f59-2a6df9beaead None admin] RBAC: Adding query filter params (role.id=2fa4518222bd427084475367e47d00cd, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=42b9c25e98fe4b1bbc33a601d4150071) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:43.866384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39211ef-8340-445d-9f59-2a6df9beaead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:43.867953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39211ef-8340-445d-9f59-2a6df9beaead None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:43.874032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 532/1051] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:00:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:00:43.874198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 519/1051] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:43 2022] GET /identity/v3/role_assignments?user.id=42b9c25e98fe4b1bbc33a601d4150071&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=2fa4518222bd427084475367e47d00cd => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:43.875094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866db72c-8daa-4b05-934f-2c97023c16d7 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:43.875375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866db72c-8daa-4b05-934f-2c97023c16d7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:43.875643 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866db72c-8daa-4b05-934f-2c97023c16d7 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:43.876848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 533/1052] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:43.882559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6722e-4af3-4423-bb37-7fafc9ad0542 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:43.882807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6722e-4af3-4423-bb37-7fafc9ad0542 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:43.883088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6722e-4af3-4423-bb37-7fafc9ad0542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:43.903983 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0ee6722e-4af3-4423-bb37-7fafc9ad0542 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:43.905358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0ee6722e-4af3-4423-bb37-7fafc9ad0542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:43.926347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:43.996088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 520/1053] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:44.263901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866db72c-8daa-4b05-934f-2c97023c16d7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:44.376873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866db72c-8daa-4b05-934f-2c97023c16d7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:44.413787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed93daf-cba9-4e43-a24c-6e91b7ed67ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:44.414421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed93daf-cba9-4e43-a24c-6e91b7ed67ef None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:44.414699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed93daf-cba9-4e43-a24c-6e91b7ed67ef None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:44.414946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed93daf-cba9-4e43-a24c-6e91b7ed67ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:44.425886 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed93daf-cba9-4e43-a24c-6e91b7ed67ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5ed93daf-cba9-4e43-a24c-6e91b7ed67ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:44.430798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:44.431750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:44.432744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:44.432744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:44.432744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:44.432744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:44.432744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:44.432744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:44.432744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:44.432744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:44.432744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:44.432744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:44.432744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:44.432744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:44.436423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 534/1054] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:00:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:44.438674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6722e-4af3-4423-bb37-7fafc9ad0542 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:44.542345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6722e-4af3-4423-bb37-7fafc9ad0542 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:44.577622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0f98c-1364-4882-b611-5e99d0fdf971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:44.578235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0f98c-1364-4882-b611-5e99d0fdf971 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:44.578506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0f98c-1364-4882-b611-5e99d0fdf971 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:44.578770 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0f98c-1364-4882-b611-5e99d0fdf971 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:44.579427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0f98c-1364-4882-b611-5e99d0fdf971 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:44.579722 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0f98c-1364-4882-b611-5e99d0fdf971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:44.581178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0f98c-1364-4882-b611-5e99d0fdf971 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:44.589646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 521/1055] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:00:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:44.595455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed93daf-cba9-4e43-a24c-6e91b7ed67ef None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:44.614415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:44.696831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed93daf-cba9-4e43-a24c-6e91b7ed67ef None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:44.730216 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f3fe6-0d8e-4d6a-9f03-30c0bc168096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:44.730847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f3fe6-0d8e-4d6a-9f03-30c0bc168096 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:44.731119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f3fe6-0d8e-4d6a-9f03-30c0bc168096 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:44.731386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f3fe6-0d8e-4d6a-9f03-30c0bc168096 None admin] PATH_INFO: `/v3/users/adbaa8c913574d4095bc0e5f7146c76b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:44.745251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f3fe6-0d8e-4d6a-9f03-30c0bc168096 None admin] RBAC: Authorizing `identity:get_user(user_id=adbaa8c913574d4095bc0e5f7146c76b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:44.746734 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f3fe6-0d8e-4d6a-9f03-30c0bc168096 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:44.748520 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 535/1056] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:00:44 2022] GET /identity/v3/users/adbaa8c913574d4095bc0e5f7146c76b => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:44.754524 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0f98c-1364-4882-b611-5e99d0fdf971 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:44.767503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:44.859616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0f98c-1364-4882-b611-5e99d0fdf971 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:44.894844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c87b6-bbbc-4d21-a34e-afb376b488f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:44.895539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c87b6-bbbc-4d21-a34e-afb376b488f8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:44.895793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c87b6-bbbc-4d21-a34e-afb376b488f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:44.895982 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c87b6-bbbc-4d21-a34e-afb376b488f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:44.967904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c87b6-bbbc-4d21-a34e-afb376b488f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:44.969537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c87b6-bbbc-4d21-a34e-afb376b488f8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:44.981426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:45.078476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 522/1057] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:00:45.084528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f3fe6-0d8e-4d6a-9f03-30c0bc168096 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:45.162276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:45.188613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f3fe6-0d8e-4d6a-9f03-30c0bc168096 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:45.222644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847217e-8d4a-47e8-af1d-cacbee2960ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:45.223269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847217e-8d4a-47e8-af1d-cacbee2960ee None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:45.223557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847217e-8d4a-47e8-af1d-cacbee2960ee None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:45.223807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847217e-8d4a-47e8-af1d-cacbee2960ee None admin] PATH_INFO: `/v3/projects/ef375d7e204b4540804a2ed0dc97341b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:45.224927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847217e-8d4a-47e8-af1d-cacbee2960ee None admin] RBAC: Authorizing `identity:get_project(project_id=ef375d7e204b4540804a2ed0dc97341b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:45.226445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847217e-8d4a-47e8-af1d-cacbee2960ee None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:45.228230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 536/1058] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 01:00:45 2022] GET /identity/v3/projects/ef375d7e204b4540804a2ed0dc97341b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:45.234472 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c87b6-bbbc-4d21-a34e-afb376b488f8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:45.335675 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c87b6-bbbc-4d21-a34e-afb376b488f8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:45.346621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:45.372248 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbba22-6c2a-455c-8b2b-efe109f51549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:45.372912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbba22-6c2a-455c-8b2b-efe109f51549 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:45.373191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbba22-6c2a-455c-8b2b-efe109f51549 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:45.373465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbba22-6c2a-455c-8b2b-efe109f51549 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:45.374191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbba22-6c2a-455c-8b2b-efe109f51549 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=ef375d7e204b4540804a2ed0dc97341b, user.id=adbaa8c913574d4095bc0e5f7146c76b) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:45.374506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbba22-6c2a-455c-8b2b-efe109f51549 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:45.375984 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbba22-6c2a-455c-8b2b-efe109f51549 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:45.381831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 523/1059] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:45 2022] GET /identity/v3/role_assignments?user.id=adbaa8c913574d4095bc0e5f7146c76b&scope.project.id=ef375d7e204b4540804a2ed0dc97341b&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:45.817036 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d92bd-cbb9-47ce-ada8-7ffba0b265a1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:45.817452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d92bd-cbb9-47ce-ada8-7ffba0b265a1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:45.817553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d92bd-cbb9-47ce-ada8-7ffba0b265a1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:45.819099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 537/1060] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:45.824169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942710d-c9f3-462d-a402-294cec80fe66 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:45.824441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942710d-c9f3-462d-a402-294cec80fe66 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:45.824745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942710d-c9f3-462d-a402-294cec80fe66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:45.844562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9942710d-c9f3-462d-a402-294cec80fe66 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:45.845769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9942710d-c9f3-462d-a402-294cec80fe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:45.872567 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1f963-a2dc-4b39-bf2e-0c02c3bad198 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:45.872815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1f963-a2dc-4b39-bf2e-0c02c3bad198 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:45.873121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1f963-a2dc-4b39-bf2e-0c02c3bad198 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:45.874638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 538/1061] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:00:45.879301 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46da0f-b2a4-4a84-9b32-172094be666b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:45.879596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46da0f-b2a4-4a84-9b32-172094be666b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:45.879864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46da0f-b2a4-4a84-9b32-172094be666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:45.898656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0c46da0f-b2a4-4a84-9b32-172094be666b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:45.899843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0c46da0f-b2a4-4a84-9b32-172094be666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:45.919904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 524/1062] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:45.971635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 539/1063] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:00:46.188629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942710d-c9f3-462d-a402-294cec80fe66 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:46.239495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46da0f-b2a4-4a84-9b32-172094be666b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:46.301139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942710d-c9f3-462d-a402-294cec80fe66 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:46.304640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:46.317609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:46.338875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245866c-eedb-492a-9c09-ba7b54198174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:46.339592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245866c-eedb-492a-9c09-ba7b54198174 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:46.339799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245866c-eedb-492a-9c09-ba7b54198174 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:46.340057 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245866c-eedb-492a-9c09-ba7b54198174 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:46.350549 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245866c-eedb-492a-9c09-ba7b54198174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:46.353713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46da0f-b2a4-4a84-9b32-172094be666b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-6245866c-eedb-492a-9c09-ba7b54198174 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:46.355456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:46.356445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:46.357336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 525/1064] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Sep 6 01:00:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:46.362519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245866c-eedb-492a-9c09-ba7b54198174 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:46.393593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659a40f-301e-4e09-812d-9f0d0649fd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:46.394315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659a40f-301e-4e09-812d-9f0d0649fd4d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:46.394645 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659a40f-301e-4e09-812d-9f0d0649fd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:46.394869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659a40f-301e-4e09-812d-9f0d0649fd4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:46.470027 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659a40f-301e-4e09-812d-9f0d0649fd4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:46.471447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659a40f-301e-4e09-812d-9f0d0649fd4d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:46.478400 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245866c-eedb-492a-9c09-ba7b54198174 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:46.520365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136886d4-8645-4b65-9ab9-87988daf4393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:46.520981 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136886d4-8645-4b65-9ab9-87988daf4393 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:46.521259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136886d4-8645-4b65-9ab9-87988daf4393 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:46.521526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136886d4-8645-4b65-9ab9-87988daf4393 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:46.522177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136886d4-8645-4b65-9ab9-87988daf4393 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:46.522481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136886d4-8645-4b65-9ab9-87988daf4393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:46.523892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136886d4-8645-4b65-9ab9-87988daf4393 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:46.532903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 526/1065] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 6 01:00:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:46.538697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136886d4-8645-4b65-9ab9-87988daf4393 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:46.550513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:46.567377 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:46.585445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 540/1066] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:00:46.591125 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659a40f-301e-4e09-812d-9f0d0649fd4d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:46.646442 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136886d4-8645-4b65-9ab9-87988daf4393 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:46.680584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff155f2-2619-4866-ab6a-ff24dd9bd4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:46.681211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff155f2-2619-4866-ab6a-ff24dd9bd4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:46.681482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff155f2-2619-4866-ab6a-ff24dd9bd4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:46.681749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff155f2-2619-4866-ab6a-ff24dd9bd4b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:46.693476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff155f2-2619-4866-ab6a-ff24dd9bd4b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:46.694737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659a40f-301e-4e09-812d-9f0d0649fd4d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:46.694980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff155f2-2619-4866-ab6a-ff24dd9bd4b1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-dff155f2-2619-4866-ab6a-ff24dd9bd4b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:46.709969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:46.711157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:46.712314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:46.712314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:46.712314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:46.716380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 527/1067] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:46.717344 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff155f2-2619-4866-ab6a-ff24dd9bd4b1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:46.736088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b184ce-b6be-40c8-a5b4-04973b7a11c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:46.736780 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b184ce-b6be-40c8-a5b4-04973b7a11c0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:46.736975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b184ce-b6be-40c8-a5b4-04973b7a11c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:46.737204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b184ce-b6be-40c8-a5b4-04973b7a11c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:46.747477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b184ce-b6be-40c8-a5b4-04973b7a11c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:46.749026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b184ce-b6be-40c8-a5b4-04973b7a11c0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-88b184ce-b6be-40c8-a5b4-04973b7a11c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:46.764884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:46.766217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:46.767163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:46.767163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:46.767163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:46.767163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 541/1068] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:46.773638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b184ce-b6be-40c8-a5b4-04973b7a11c0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:46.802888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:46.807857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:46.826793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff155f2-2619-4866-ab6a-ff24dd9bd4b1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:46.863729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b88f6-db6c-4cf3-8f4c-a6b55c224653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:46.864372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b88f6-db6c-4cf3-8f4c-a6b55c224653 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:46.864656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b88f6-db6c-4cf3-8f4c-a6b55c224653 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:46.865334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b88f6-db6c-4cf3-8f4c-a6b55c224653 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:46.865983 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b88f6-db6c-4cf3-8f4c-a6b55c224653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:46.866286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b88f6-db6c-4cf3-8f4c-a6b55c224653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:46.868399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b88f6-db6c-4cf3-8f4c-a6b55c224653 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:46.881714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 528/1069] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:46.887588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b88f6-db6c-4cf3-8f4c-a6b55c224653 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:46.893015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b184ce-b6be-40c8-a5b4-04973b7a11c0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:46.931737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d85686-c7b7-4cd9-9b67-01961532bc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:46.932410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d85686-c7b7-4cd9-9b67-01961532bc11 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:46.932680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d85686-c7b7-4cd9-9b67-01961532bc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:46.932956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d85686-c7b7-4cd9-9b67-01961532bc11 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:46.933596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d85686-c7b7-4cd9-9b67-01961532bc11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:46.933920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d85686-c7b7-4cd9-9b67-01961532bc11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:46.935320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d85686-c7b7-4cd9-9b67-01961532bc11 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:46.947472 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 542/1070] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:47.004048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b88f6-db6c-4cf3-8f4c-a6b55c224653 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:47.049993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fe284-62de-456f-be62-919a66bac891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:47.050649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fe284-62de-456f-be62-919a66bac891 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:47.050898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fe284-62de-456f-be62-919a66bac891 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:47.051193 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fe284-62de-456f-be62-919a66bac891 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:47.059773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fe284-62de-456f-be62-919a66bac891 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:47.061318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fe284-62de-456f-be62-919a66bac891 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:47.063608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e03fe284-62de-456f-be62-919a66bac891 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:47.076093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:47.077322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:47.078326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:47.078326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:47.078326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:47.078326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:47.078326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:47.078326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:47.078326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:47.078326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:47.078326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 01:00:47.078326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:47.080643 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 529/1071] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 6 01:00:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:47.083430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d85686-c7b7-4cd9-9b67-01961532bc11 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:47.180001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:47.198423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d85686-c7b7-4cd9-9b67-01961532bc11 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:47.236245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8aa27f-ad36-4ed4-a6f5-d46b5f12cea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:47.236948 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aa27f-ad36-4ed4-a6f5-d46b5f12cea4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:47.237228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aa27f-ad36-4ed4-a6f5-d46b5f12cea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:47.237488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aa27f-ad36-4ed4-a6f5-d46b5f12cea4 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:47.238221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8aa27f-ad36-4ed4-a6f5-d46b5f12cea4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:47.238520 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8aa27f-ad36-4ed4-a6f5-d46b5f12cea4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:47.240002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8aa27f-ad36-4ed4-a6f5-d46b5f12cea4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:47.257577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 543/1072] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 6 01:00:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:47.263499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fe284-62de-456f-be62-919a66bac891 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:47.269504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e03f9c-986b-43f3-973e-d8e78e1dc67c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:47.269783 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e03f9c-986b-43f3-973e-d8e78e1dc67c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:47.270050 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e03f9c-986b-43f3-973e-d8e78e1dc67c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:47.271324 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 544/1073] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:47.276534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97428-f548-4a36-b9eb-8ea65a18e1f9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:47.277035 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97428-f548-4a36-b9eb-8ea65a18e1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:47.277301 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97428-f548-4a36-b9eb-8ea65a18e1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:47.295369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-31d97428-f548-4a36-b9eb-8ea65a18e1f9 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:47.296581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-31d97428-f548-4a36-b9eb-8ea65a18e1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:47.363330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 545/1074] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:00:47.368634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fe284-62de-456f-be62-919a66bac891 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:47.403763 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a167583-e858-428a-8090-2e92eb13fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:47.404427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a167583-e858-428a-8090-2e92eb13fc12 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:47.404705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a167583-e858-428a-8090-2e92eb13fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:47.404973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a167583-e858-428a-8090-2e92eb13fc12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:47.415851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a167583-e858-428a-8090-2e92eb13fc12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:47.417421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a167583-e858-428a-8090-2e92eb13fc12 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-5a167583-e858-428a-8090-2e92eb13fc12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:47.431010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:47.432861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:47.433889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:47.433889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:47.433889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:47.433889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 530/1075] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:47.438347 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d97428-f548-4a36-b9eb-8ea65a18e1f9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:47.509855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:47.540955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d97428-f548-4a36-b9eb-8ea65a18e1f9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:47.575441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e15dbe-7be1-4b65-93f5-e5d37261be22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:47.576033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e15dbe-7be1-4b65-93f5-e5d37261be22 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:47.576332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e15dbe-7be1-4b65-93f5-e5d37261be22 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:47.576624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e15dbe-7be1-4b65-93f5-e5d37261be22 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:47.577278 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e15dbe-7be1-4b65-93f5-e5d37261be22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:47.577583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e15dbe-7be1-4b65-93f5-e5d37261be22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:47.579014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e15dbe-7be1-4b65-93f5-e5d37261be22 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:47.590423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 546/1076] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:47.596263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a167583-e858-428a-8090-2e92eb13fc12 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:47.626266 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e15dbe-7be1-4b65-93f5-e5d37261be22 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:47.648716 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:47.703043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a167583-e858-428a-8090-2e92eb13fc12 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:47.737225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e15dbe-7be1-4b65-93f5-e5d37261be22 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:47.738755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9f43b-3b2e-429b-b1c5-6eabfc988bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:47.739704 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9f43b-3b2e-429b-b1c5-6eabfc988bbe None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:47.740108 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9f43b-3b2e-429b-b1c5-6eabfc988bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:47.740553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9f43b-3b2e-429b-b1c5-6eabfc988bbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:47.751376 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9f43b-3b2e-429b-b1c5-6eabfc988bbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:47.753765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9f43b-3b2e-429b-b1c5-6eabfc988bbe None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:47.768514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-0af9f43b-3b2e-429b-b1c5-6eabfc988bbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:47.772129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:47.773127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:47.774071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:47.774071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:47.774071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:47.774071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:47.774071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:47.774071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:47.774071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:47.774071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:47.774071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 531/1077] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:47.776754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47a83b-8432-4d9e-919c-11d4d60c3b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:47.777405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47a83b-8432-4d9e-919c-11d4d60c3b60 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:47.777675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47a83b-8432-4d9e-919c-11d4d60c3b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:47.777946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47a83b-8432-4d9e-919c-11d4d60c3b60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:47.780174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9f43b-3b2e-429b-b1c5-6eabfc988bbe None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:47.790567 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47a83b-8432-4d9e-919c-11d4d60c3b60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-4a47a83b-8432-4d9e-919c-11d4d60c3b60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:47.796084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:47.797271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:47.798182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 547/1078] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:00:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:47.803852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47a83b-8432-4d9e-919c-11d4d60c3b60 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:47.888117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9f43b-3b2e-429b-b1c5-6eabfc988bbe None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:47.898771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:47.910544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47a83b-8432-4d9e-919c-11d4d60c3b60 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:47.923697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07b0e2-6069-4e0a-a046-5ea8ece4f1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:47.924336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07b0e2-6069-4e0a-a046-5ea8ece4f1fd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:47.924619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07b0e2-6069-4e0a-a046-5ea8ece4f1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:47.924889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07b0e2-6069-4e0a-a046-5ea8ece4f1fd None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:47.925583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07b0e2-6069-4e0a-a046-5ea8ece4f1fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:47.925887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07b0e2-6069-4e0a-a046-5ea8ece4f1fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:47.927370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07b0e2-6069-4e0a-a046-5ea8ece4f1fd None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:47.940214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 532/1079] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:47.945901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626c9c0-576d-4109-8907-a5bb64b109aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:47.946278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07b0e2-6069-4e0a-a046-5ea8ece4f1fd None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:47.946618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626c9c0-576d-4109-8907-a5bb64b109aa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:47.946904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626c9c0-576d-4109-8907-a5bb64b109aa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:47.947194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626c9c0-576d-4109-8907-a5bb64b109aa None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:47.948097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626c9c0-576d-4109-8907-a5bb64b109aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:47.948581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626c9c0-576d-4109-8907-a5bb64b109aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:47.950032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626c9c0-576d-4109-8907-a5bb64b109aa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:47.958941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 548/1080] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:00:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:47.965139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626c9c0-576d-4109-8907-a5bb64b109aa None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:48.025016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:48.046424 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07b0e2-6069-4e0a-a046-5ea8ece4f1fd None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:48.071362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626c9c0-576d-4109-8907-a5bb64b109aa None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:48.080790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b36f9-b351-4f27-acc4-cfe4a0d6e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:48.081479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b36f9-b351-4f27-acc4-cfe4a0d6e7f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:48.081751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b36f9-b351-4f27-acc4-cfe4a0d6e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:48.082025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b36f9-b351-4f27-acc4-cfe4a0d6e7f6 None admin] PATH_INFO: `/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/42b9c25e98fe4b1bbc33a601d4150071/roles/2fa4518222bd427084475367e47d00cd` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:48.084230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b36f9-b351-4f27-acc4-cfe4a0d6e7f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d31b0823b61d4895accd0f27e6006b08, user_id=42b9c25e98fe4b1bbc33a601d4150071, role_id=2fa4518222bd427084475367e47d00cd)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:48.085750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b36f9-b351-4f27-acc4-cfe4a0d6e7f6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:48.099711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 533/1081] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 01:00:47 2022] PUT /identity/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/42b9c25e98fe4b1bbc33a601d4150071/roles/2fa4518222bd427084475367e47d00cd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:00:48.105224 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf5e25-6f7f-45a2-9a10-a38a7204efb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:48.105875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf5e25-6f7f-45a2-9a10-a38a7204efb6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:48.106150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf5e25-6f7f-45a2-9a10-a38a7204efb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:48.106411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf5e25-6f7f-45a2-9a10-a38a7204efb6 None admin] PATH_INFO: `/v3/users/adbaa8c913574d4095bc0e5f7146c76b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:48.107596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf5e25-6f7f-45a2-9a10-a38a7204efb6 None admin] RBAC: Authorizing `identity:get_user(user_id=adbaa8c913574d4095bc0e5f7146c76b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:48.109147 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf5e25-6f7f-45a2-9a10-a38a7204efb6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:48.110799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 549/1082] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:00:47 2022] GET /identity/v3/users/adbaa8c913574d4095bc0e5f7146c76b => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:48.117004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b36f9-b351-4f27-acc4-cfe4a0d6e7f6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:48.151990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:48.232026 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b36f9-b351-4f27-acc4-cfe4a0d6e7f6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:48.270290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da23bd-79bd-465b-9fb1-05c8c91b372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:48.270936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da23bd-79bd-465b-9fb1-05c8c91b372d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:48.271209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da23bd-79bd-465b-9fb1-05c8c91b372d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:48.271481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da23bd-79bd-465b-9fb1-05c8c91b372d None admin] PATH_INFO: `/v3/projects/ef375d7e204b4540804a2ed0dc97341b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:48.272652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da23bd-79bd-465b-9fb1-05c8c91b372d None admin] RBAC: Authorizing `identity:get_project(project_id=ef375d7e204b4540804a2ed0dc97341b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:48.274141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da23bd-79bd-465b-9fb1-05c8c91b372d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:48.275847 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 534/1083] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 01:00:48 2022] GET /identity/v3/projects/ef375d7e204b4540804a2ed0dc97341b => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:48.282659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf5e25-6f7f-45a2-9a10-a38a7204efb6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:48.386187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf5e25-6f7f-45a2-9a10-a38a7204efb6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:48.408120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:48.421532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c12cd-20ff-4d33-9ebf-d3160f64915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:48.422190 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c12cd-20ff-4d33-9ebf-d3160f64915e None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:48.422437 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c12cd-20ff-4d33-9ebf-d3160f64915e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:48.422725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c12cd-20ff-4d33-9ebf-d3160f64915e None admin] PATH_INFO: `/v3/projects/ef375d7e204b4540804a2ed0dc97341b/users/adbaa8c913574d4095bc0e5f7146c76b/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:48.424768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c12cd-20ff-4d33-9ebf-d3160f64915e None admin] RBAC: Authorizing `identity:create_grant(project_id=ef375d7e204b4540804a2ed0dc97341b, user_id=adbaa8c913574d4095bc0e5f7146c76b, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:48.426247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c12cd-20ff-4d33-9ebf-d3160f64915e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:48.444115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 550/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 01:00:48 2022] PUT /identity/v3/projects/ef375d7e204b4540804a2ed0dc97341b/users/adbaa8c913574d4095bc0e5f7146c76b/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:00:49.990868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafc901-2eb1-4f18-83df-fb137a127c7b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:49.991420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafc901-2eb1-4f18-83df-fb137a127c7b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:49.991420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafc901-2eb1-4f18-83df-fb137a127c7b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:49.992783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 535/1085] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:49.998082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d36727-99fc-4eca-91e7-3c01480ab9ea None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:49.998553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d36727-99fc-4eca-91e7-3c01480ab9ea None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:49.998647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d36727-99fc-4eca-91e7-3c01480ab9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:50.017271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-53d36727-99fc-4eca-91e7-3c01480ab9ea None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:50.018466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-53d36727-99fc-4eca-91e7-3c01480ab9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:50.089743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 551/1086] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:50.361441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafc901-2eb1-4f18-83df-fb137a127c7b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:50.371205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cb978-fd89-43d6-99cc-bf91cb031a1f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:50.371490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cb978-fd89-43d6-99cc-bf91cb031a1f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:50.371771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cb978-fd89-43d6-99cc-bf91cb031a1f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:50.373174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 552/1087] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:00:50.378099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0cb47-f9f4-41a4-ace7-7720b9f64ef3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:50.378380 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0cb47-f9f4-41a4-ace7-7720b9f64ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:50.378648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0cb47-f9f4-41a4-ace7-7720b9f64ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:50.396751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-86c0cb47-f9f4-41a4-ace7-7720b9f64ef3 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:50.397944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-86c0cb47-f9f4-41a4-ace7-7720b9f64ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:50.466409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:50.471189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafc901-2eb1-4f18-83df-fb137a127c7b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:50.471719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 553/1088] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:00:50.506609 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48136e-a493-4367-a90e-874b802b5199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:50.507235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48136e-a493-4367-a90e-874b802b5199 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:50.507506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48136e-a493-4367-a90e-874b802b5199 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:50.507773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48136e-a493-4367-a90e-874b802b5199 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:50.518087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48136e-a493-4367-a90e-874b802b5199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-8d48136e-a493-4367-a90e-874b802b5199 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:50.522823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:50.523862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:50.524771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 536/1089] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Sep 6 01:00:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:50.530132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0cb47-f9f4-41a4-ace7-7720b9f64ef3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:50.574188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:50.631059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0cb47-f9f4-41a4-ace7-7720b9f64ef3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:50.666225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc1967-50b4-4a5a-ad03-a3af8475b4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:50.666863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1967-50b4-4a5a-ad03-a3af8475b4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:50.667163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1967-50b4-4a5a-ad03-a3af8475b4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:50.667427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1967-50b4-4a5a-ad03-a3af8475b4e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:50.668081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc1967-50b4-4a5a-ad03-a3af8475b4e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:50.668410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc1967-50b4-4a5a-ad03-a3af8475b4e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:50.669805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc1967-50b4-4a5a-ad03-a3af8475b4e3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:50.677720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 554/1090] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 6 01:00:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:50.683499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48136e-a493-4367-a90e-874b802b5199 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:50.734259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc1967-50b4-4a5a-ad03-a3af8475b4e3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:50.786249 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48136e-a493-4367-a90e-874b802b5199 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:50.820846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1b033-fa85-448e-8ec7-e178cdca644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:50.821476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1b033-fa85-448e-8ec7-e178cdca644c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:50.821754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1b033-fa85-448e-8ec7-e178cdca644c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:50.822024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1b033-fa85-448e-8ec7-e178cdca644c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:50.834902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc1967-50b4-4a5a-ad03-a3af8475b4e3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:50.837285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:50.837777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1b033-fa85-448e-8ec7-e178cdca644c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:50.839644 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1b033-fa85-448e-8ec7-e178cdca644c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-85b1b033-fa85-448e-8ec7-e178cdca644c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:50.854852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:50.855843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:50.856802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:50.856802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:50.856802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:50.856802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 537/1091] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:50.861796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1b033-fa85-448e-8ec7-e178cdca644c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:50.871070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f7166-de80-4793-bda9-cc1cbdc320a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:50.871712 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f7166-de80-4793-bda9-cc1cbdc320a2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:50.871991 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f7166-de80-4793-bda9-cc1cbdc320a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:50.872261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f7166-de80-4793-bda9-cc1cbdc320a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:50.874964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:50.883009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f7166-de80-4793-bda9-cc1cbdc320a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d22f7166-de80-4793-bda9-cc1cbdc320a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:00:50.887762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:50.888772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:00:50.889808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 555/1092] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:00:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:50.894906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f7166-de80-4793-bda9-cc1cbdc320a2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:50.964993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1b033-fa85-448e-8ec7-e178cdca644c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:50.997180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f7166-de80-4793-bda9-cc1cbdc320a2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:50.998923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6fc2e-c05a-4043-a22d-cbd2bee94e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:50.999529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6fc2e-c05a-4043-a22d-cbd2bee94e69 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:50.999799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6fc2e-c05a-4043-a22d-cbd2bee94e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:51.000062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6fc2e-c05a-4043-a22d-cbd2bee94e69 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:51.000721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6fc2e-c05a-4043-a22d-cbd2bee94e69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:51.001014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6fc2e-c05a-4043-a22d-cbd2bee94e69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:51.002413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6fc2e-c05a-4043-a22d-cbd2bee94e69 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:51.015340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 538/1093] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:51.020912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6fc2e-c05a-4043-a22d-cbd2bee94e69 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:51.033586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1e25f-c26a-4b2d-8afb-6e209785d149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:51.034552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1e25f-c26a-4b2d-8afb-6e209785d149 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:51.034827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1e25f-c26a-4b2d-8afb-6e209785d149 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:51.035095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1e25f-c26a-4b2d-8afb-6e209785d149 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:51.035760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1e25f-c26a-4b2d-8afb-6e209785d149 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:51.036060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1e25f-c26a-4b2d-8afb-6e209785d149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:51.037685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1e25f-c26a-4b2d-8afb-6e209785d149 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:51.046518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 556/1094] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:00:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:51.052099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1e25f-c26a-4b2d-8afb-6e209785d149 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:51.080445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:51.092245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:51.124579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6fc2e-c05a-4043-a22d-cbd2bee94e69 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:51.155232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1e25f-c26a-4b2d-8afb-6e209785d149 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:51.157867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66530c5f-16b3-4217-9a94-3c3bf8980777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:51.158512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66530c5f-16b3-4217-9a94-3c3bf8980777 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:51.159126 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66530c5f-16b3-4217-9a94-3c3bf8980777 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:51.159405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66530c5f-16b3-4217-9a94-3c3bf8980777 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:51.166674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66530c5f-16b3-4217-9a94-3c3bf8980777 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:51.168338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66530c5f-16b3-4217-9a94-3c3bf8980777 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-66530c5f-16b3-4217-9a94-3c3bf8980777 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:00:51.180156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:51.181153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:51.182237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:51.182237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:51.182237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:00:51.182237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:00:51.182237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:00:51.182237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:00:51.182237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:00:51.182237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:00:51.182237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 01:00:51.182237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:51.182237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 539/1095] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 6 01:00:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:00:51.189665 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66530c5f-16b3-4217-9a94-3c3bf8980777 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:51.195778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f10a70-8c0c-442a-bebe-d5b749a3f430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:51.196456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f10a70-8c0c-442a-bebe-d5b749a3f430 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:51.196737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f10a70-8c0c-442a-bebe-d5b749a3f430 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:51.197012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f10a70-8c0c-442a-bebe-d5b749a3f430 None admin] PATH_INFO: `/v3/users/adbaa8c913574d4095bc0e5f7146c76b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:51.198557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f10a70-8c0c-442a-bebe-d5b749a3f430 None admin] RBAC: Authorizing `identity:get_user(user_id=adbaa8c913574d4095bc0e5f7146c76b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:51.199718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f10a70-8c0c-442a-bebe-d5b749a3f430 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:51.201647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 557/1096] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:00:51 2022] GET /identity/v3/users/adbaa8c913574d4095bc0e5f7146c76b => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:51.206999 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f10a70-8c0c-442a-bebe-d5b749a3f430 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:51.292591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66530c5f-16b3-4217-9a94-3c3bf8980777 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:51.300859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:51.308750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f10a70-8c0c-442a-bebe-d5b749a3f430 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:51.320415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:51.326879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b239f-fc53-4081-9cf8-8796406f2e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:51.327506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b239f-fc53-4081-9cf8-8796406f2e40 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:51.327777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b239f-fc53-4081-9cf8-8796406f2e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:51.328046 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b239f-fc53-4081-9cf8-8796406f2e40 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:51.328776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b239f-fc53-4081-9cf8-8796406f2e40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:51.329090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b239f-fc53-4081-9cf8-8796406f2e40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:51.330541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b239f-fc53-4081-9cf8-8796406f2e40 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:51.342607 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126c850-cc26-4269-b889-1b8a7f6af934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:51.343212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126c850-cc26-4269-b889-1b8a7f6af934 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:51.343486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126c850-cc26-4269-b889-1b8a7f6af934 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:51.343754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126c850-cc26-4269-b889-1b8a7f6af934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:51.347744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 540/1097] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 6 01:00:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:51.353590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b239f-fc53-4081-9cf8-8796406f2e40 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:51.411815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126c850-cc26-4269-b889-1b8a7f6af934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:51.413293 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126c850-cc26-4269-b889-1b8a7f6af934 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:51.452073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b239f-fc53-4081-9cf8-8796406f2e40 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:51.485450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe8a3-e310-4602-bcb3-1c1437a14b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:51.486049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe8a3-e310-4602-bcb3-1c1437a14b97 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:51.486318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe8a3-e310-4602-bcb3-1c1437a14b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:51.486588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe8a3-e310-4602-bcb3-1c1437a14b97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:51.501759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:51.509126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 558/1098] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 01:00:51.515151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126c850-cc26-4269-b889-1b8a7f6af934 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:51.542422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:51.555598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fe8a3-e310-4602-bcb3-1c1437a14b97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:51.557148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fe8a3-e310-4602-bcb3-1c1437a14b97 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:51.613284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126c850-cc26-4269-b889-1b8a7f6af934 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:51.647641 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f43f42-3662-440b-bcdb-11a2f48acaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:51.648268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f43f42-3662-440b-bcdb-11a2f48acaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:51.648573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f43f42-3662-440b-bcdb-11a2f48acaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:51.648845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f43f42-3662-440b-bcdb-11a2f48acaf6 None admin] PATH_INFO: `/v3/projects/ef375d7e204b4540804a2ed0dc97341b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:51.650395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f43f42-3662-440b-bcdb-11a2f48acaf6 None admin] RBAC: Authorizing `identity:get_project(project_id=ef375d7e204b4540804a2ed0dc97341b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:51.651932 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f43f42-3662-440b-bcdb-11a2f48acaf6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:51.653629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 559/1099] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 01:00:51 2022] GET /identity/v3/projects/ef375d7e204b4540804a2ed0dc97341b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:00:51.660870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 541/1100] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 01:00:51.662074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f43f42-3662-440b-bcdb-11a2f48acaf6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:51.662196 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe8a3-e310-4602-bcb3-1c1437a14b97 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:51.722704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:51.746753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:51.760232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe8a3-e310-4602-bcb3-1c1437a14b97 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:51.760974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f43f42-3662-440b-bcdb-11a2f48acaf6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:51.794690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d0de0-3c39-482e-ade1-67ebcf902f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:51.795316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d0de0-3c39-482e-ade1-67ebcf902f5a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:51.795585 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d0de0-3c39-482e-ade1-67ebcf902f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:51.795757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2769d-4059-42f7-a8c2-3eb2474f492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:51.795881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d0de0-3c39-482e-ade1-67ebcf902f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:51.796338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2769d-4059-42f7-a8c2-3eb2474f492a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:51.796629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2769d-4059-42f7-a8c2-3eb2474f492a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:51.796902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2769d-4059-42f7-a8c2-3eb2474f492a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:51.797603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2769d-4059-42f7-a8c2-3eb2474f492a None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=ef375d7e204b4540804a2ed0dc97341b, user.id=adbaa8c913574d4095bc0e5f7146c76b) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:51.797908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2769d-4059-42f7-a8c2-3eb2474f492a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:51.799399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2769d-4059-42f7-a8c2-3eb2474f492a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:51.805579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 560/1101] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:51 2022] GET /identity/v3/role_assignments?user.id=adbaa8c913574d4095bc0e5f7146c76b&scope.project.id=ef375d7e204b4540804a2ed0dc97341b&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:51.809224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d0de0-3c39-482e-ade1-67ebcf902f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:51.810725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d0de0-3c39-482e-ade1-67ebcf902f5a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-cd5d0de0-3c39-482e-ade1-67ebcf902f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:00:51.827020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:51.828105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:00:51.829088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:00:51.829088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:00:51.829088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:51.829088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 542/1102] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:51.834657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2769d-4059-42f7-a8c2-3eb2474f492a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:51.943168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2769d-4059-42f7-a8c2-3eb2474f492a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:51.970824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:51.980567 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb3c0d-a4bc-4da7-8127-e35b569038cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:51.981184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3c0d-a4bc-4da7-8127-e35b569038cd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:51.981464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3c0d-a4bc-4da7-8127-e35b569038cd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:51.981735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3c0d-a4bc-4da7-8127-e35b569038cd None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:51.982385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb3c0d-a4bc-4da7-8127-e35b569038cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:51.982685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb3c0d-a4bc-4da7-8127-e35b569038cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:51.984095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb3c0d-a4bc-4da7-8127-e35b569038cd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:51.995979 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 561/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:52.002005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d0de0-3c39-482e-ade1-67ebcf902f5a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:52.105368 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d0de0-3c39-482e-ade1-67ebcf902f5a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:52.139814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde27f7-aec9-4ae6-955e-11f7e95ef8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:52.140475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde27f7-aec9-4ae6-955e-11f7e95ef8bb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:52.140744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde27f7-aec9-4ae6-955e-11f7e95ef8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:52.141010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde27f7-aec9-4ae6-955e-11f7e95ef8bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:52.147811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde27f7-aec9-4ae6-955e-11f7e95ef8bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:52.149320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde27f7-aec9-4ae6-955e-11f7e95ef8bb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:52.151904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-cbde27f7-aec9-4ae6-955e-11f7e95ef8bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:00:52.162141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:00:52.163082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:00:52.163998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:00:52.163998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:00:52.163998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:00:52.163998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:00:52.163998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:00:52.163998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:00:52.163998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:00:52.163998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:00:52.168906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 543/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:00:52.169989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb3c0d-a4bc-4da7-8127-e35b569038cd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:52.275354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb3c0d-a4bc-4da7-8127-e35b569038cd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:52.311910 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be028819-73c0-445f-82d1-a1e1c391d904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:52.312557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be028819-73c0-445f-82d1-a1e1c391d904 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:52.312829 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be028819-73c0-445f-82d1-a1e1c391d904 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:52.313101 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be028819-73c0-445f-82d1-a1e1c391d904 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:52.313795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be028819-73c0-445f-82d1-a1e1c391d904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:52.314099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be028819-73c0-445f-82d1-a1e1c391d904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:52.315587 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be028819-73c0-445f-82d1-a1e1c391d904 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:52.327581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 562/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:52.334003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde27f7-aec9-4ae6-955e-11f7e95ef8bb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:52.438103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde27f7-aec9-4ae6-955e-11f7e95ef8bb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:52.472893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde6150-3da3-4c22-907b-b61d0fe853fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:52.473494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde6150-3da3-4c22-907b-b61d0fe853fc None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:52.473770 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde6150-3da3-4c22-907b-b61d0fe853fc None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:52.474041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde6150-3da3-4c22-907b-b61d0fe853fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:52.474768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde6150-3da3-4c22-907b-b61d0fe853fc None admin] RBAC: Adding query filter params (role.id=2fa4518222bd427084475367e47d00cd, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=42b9c25e98fe4b1bbc33a601d4150071) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:52.475071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde6150-3da3-4c22-907b-b61d0fe853fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:52.476578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde6150-3da3-4c22-907b-b61d0fe853fc None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:52.482717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 544/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:52 2022] GET /identity/v3/role_assignments?user.id=42b9c25e98fe4b1bbc33a601d4150071&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=2fa4518222bd427084475367e47d00cd => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:53.700950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206e4b7-d3cc-4991-b0fd-0f96b7a5029b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:53.701806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206e4b7-d3cc-4991-b0fd-0f96b7a5029b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:53.701806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206e4b7-d3cc-4991-b0fd-0f96b7a5029b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:53.703969 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 563/1107] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:53.710187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313566db-c54f-474a-87ed-f087aa3f057c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:53.710873 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313566db-c54f-474a-87ed-f087aa3f057c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:53.711013 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313566db-c54f-474a-87ed-f087aa3f057c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:53.737783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-313566db-c54f-474a-87ed-f087aa3f057c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:53.738973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-313566db-c54f-474a-87ed-f087aa3f057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:53.802502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:53.814549 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 545/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:54.079030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206e4b7-d3cc-4991-b0fd-0f96b7a5029b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:54.130168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:54.189456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206e4b7-d3cc-4991-b0fd-0f96b7a5029b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:54.227062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f52e1-051a-446d-895f-e20352bbf36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:54.227679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f52e1-051a-446d-895f-e20352bbf36c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:54.227950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f52e1-051a-446d-895f-e20352bbf36c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:54.228214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f52e1-051a-446d-895f-e20352bbf36c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:54.229689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f52e1-051a-446d-895f-e20352bbf36c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:54.231179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f52e1-051a-446d-895f-e20352bbf36c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:54.232763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 564/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:00:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:54.239429 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313566db-c54f-474a-87ed-f087aa3f057c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:54.347353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313566db-c54f-474a-87ed-f087aa3f057c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:54.384414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26aa5c-2c84-4580-842a-c82943eb13bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:54.385111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26aa5c-2c84-4580-842a-c82943eb13bb None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:54.385387 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26aa5c-2c84-4580-842a-c82943eb13bb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:54.385661 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26aa5c-2c84-4580-842a-c82943eb13bb None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:54.386313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26aa5c-2c84-4580-842a-c82943eb13bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:54.387827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26aa5c-2c84-4580-842a-c82943eb13bb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:54.411916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 546/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 01:00:54 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:00:56.379396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caca0b-d434-4ab4-a2ba-875809eb62cf None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:56.380025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caca0b-d434-4ab4-a2ba-875809eb62cf None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:56.380025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caca0b-d434-4ab4-a2ba-875809eb62cf None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:56.381914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 565/1111] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:56.388776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09f750-b4a1-4aa0-9453-10e9d3445f10 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:56.389226 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09f750-b4a1-4aa0-9453-10e9d3445f10 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:56.389332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09f750-b4a1-4aa0-9453-10e9d3445f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:56.413042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ea09f750-b4a1-4aa0-9453-10e9d3445f10 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:56.414238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ea09f750-b4a1-4aa0-9453-10e9d3445f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:56.464419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:56.486034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 547/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:00:56.755795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caca0b-d434-4ab4-a2ba-875809eb62cf None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:56.880954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caca0b-d434-4ab4-a2ba-875809eb62cf None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:56.895272 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:56.926117 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ac11a-eee1-4481-a00c-a867be1eb4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:56.926740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ac11a-eee1-4481-a00c-a867be1eb4ee None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:56.927018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ac11a-eee1-4481-a00c-a867be1eb4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:56.927287 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ac11a-eee1-4481-a00c-a867be1eb4ee None admin] PATH_INFO: `/v3/roles/5f42b81ce88a4943902b63aaaffc1bc2` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:56.928831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ac11a-eee1-4481-a00c-a867be1eb4ee None admin] RBAC: Authorizing `identity:get_role(role_id=5f42b81ce88a4943902b63aaaffc1bc2)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:56.930276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ac11a-eee1-4481-a00c-a867be1eb4ee None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:56.931968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 566/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:00:56 2022] GET /identity/v3/roles/5f42b81ce88a4943902b63aaaffc1bc2 => generated 223 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:56.941055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09f750-b4a1-4aa0-9453-10e9d3445f10 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:57.062932 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09f750-b4a1-4aa0-9453-10e9d3445f10 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:57.100317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f1057-2bde-41ca-82eb-9b5ca0d6975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:57.100943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f1057-2bde-41ca-82eb-9b5ca0d6975b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:57.101215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f1057-2bde-41ca-82eb-9b5ca0d6975b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:57.101485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f1057-2bde-41ca-82eb-9b5ca0d6975b None admin] PATH_INFO: `/v3/users/b5eef57cbcfe4e49a9301331c4e96a8e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:57.114723 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f1057-2bde-41ca-82eb-9b5ca0d6975b None admin] RBAC: Authorizing `identity:get_user(user_id=b5eef57cbcfe4e49a9301331c4e96a8e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:57.116200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f1057-2bde-41ca-82eb-9b5ca0d6975b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:57.117835 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 548/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:00:56 2022] GET /identity/v3/users/b5eef57cbcfe4e49a9301331c4e96a8e => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:57.124006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ac11a-eee1-4481-a00c-a867be1eb4ee None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:57.255726 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ac11a-eee1-4481-a00c-a867be1eb4ee None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:57.291965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168025f-4d5a-42a4-94a9-4fc52fc4aa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:57.292591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168025f-4d5a-42a4-94a9-4fc52fc4aa17 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:57.292863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168025f-4d5a-42a4-94a9-4fc52fc4aa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:57.293133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168025f-4d5a-42a4-94a9-4fc52fc4aa17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:57.343564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:57.363519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168025f-4d5a-42a4-94a9-4fc52fc4aa17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:57.365056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168025f-4d5a-42a4-94a9-4fc52fc4aa17 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:57.479148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 567/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:00:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:00:57.485273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f1057-2bde-41ca-82eb-9b5ca0d6975b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:57.538500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:57.600614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f1057-2bde-41ca-82eb-9b5ca0d6975b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:57.635512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc6124-5e7e-4f93-a5f6-4a2cbf766654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:57.636132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc6124-5e7e-4f93-a5f6-4a2cbf766654 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:57.636438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc6124-5e7e-4f93-a5f6-4a2cbf766654 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:57.636700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc6124-5e7e-4f93-a5f6-4a2cbf766654 None admin] PATH_INFO: `/v3/projects/ef375d7e204b4540804a2ed0dc97341b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:57.637829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc6124-5e7e-4f93-a5f6-4a2cbf766654 None admin] RBAC: Authorizing `identity:get_project(project_id=ef375d7e204b4540804a2ed0dc97341b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:57.639321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc6124-5e7e-4f93-a5f6-4a2cbf766654 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:57.640944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 549/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 01:00:57 2022] GET /identity/v3/projects/ef375d7e204b4540804a2ed0dc97341b => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:57.647427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168025f-4d5a-42a4-94a9-4fc52fc4aa17 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:00:57.734960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:00:57.761393 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168025f-4d5a-42a4-94a9-4fc52fc4aa17 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:00:57.800672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796259d-6b6f-48ad-a17a-a0dc1d07d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:00:57.801266 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796259d-6b6f-48ad-a17a-a0dc1d07d6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:57.801540 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796259d-6b6f-48ad-a17a-a0dc1d07d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:57.801807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796259d-6b6f-48ad-a17a-a0dc1d07d6d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:57.802525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796259d-6b6f-48ad-a17a-a0dc1d07d6d4 None admin] RBAC: Adding query filter params (role.id=5f42b81ce88a4943902b63aaaffc1bc2, scope.project.id=ef375d7e204b4540804a2ed0dc97341b, user.id=b5eef57cbcfe4e49a9301331c4e96a8e) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:00:57.802830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796259d-6b6f-48ad-a17a-a0dc1d07d6d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:00:57.804330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796259d-6b6f-48ad-a17a-a0dc1d07d6d4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:00:57.810037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 568/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:00:57 2022] GET /identity/v3/role_assignments?user.id=b5eef57cbcfe4e49a9301331c4e96a8e&scope.project.id=ef375d7e204b4540804a2ed0dc97341b&role.id=5f42b81ce88a4943902b63aaaffc1bc2 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:00:59.649724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeeff3d-82f9-4e5d-af41-7e10f15ffbe9 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:59.650477 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeeff3d-82f9-4e5d-af41-7e10f15ffbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:59.650477 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeeff3d-82f9-4e5d-af41-7e10f15ffbe9 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:59.651629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 550/1118] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:00:59.657916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3569c-47d5-49a5-8374-10afea5ec0b5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:00:59.658351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3569c-47d5-49a5-8374-10afea5ec0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:00:59.658809 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3569c-47d5-49a5-8374-10afea5ec0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:00:59.681107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-45e3569c-47d5-49a5-8374-10afea5ec0b5 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:00:59.682384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-45e3569c-47d5-49a5-8374-10afea5ec0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:00:59.755136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 569/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:00:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:00.019561 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeeff3d-82f9-4e5d-af41-7e10f15ffbe9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:00.125787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeeff3d-82f9-4e5d-af41-7e10f15ffbe9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:00.133190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:00.163147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce241898-bb17-4f6d-8fc9-b1c95214f031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:00.163759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce241898-bb17-4f6d-8fc9-b1c95214f031 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:00.164030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce241898-bb17-4f6d-8fc9-b1c95214f031 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:00.164316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce241898-bb17-4f6d-8fc9-b1c95214f031 None admin] PATH_INFO: `/v3/roles/5f42b81ce88a4943902b63aaaffc1bc2` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:00.165784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce241898-bb17-4f6d-8fc9-b1c95214f031 None admin] RBAC: Authorizing `identity:get_role(role_id=5f42b81ce88a4943902b63aaaffc1bc2)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:00.167287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce241898-bb17-4f6d-8fc9-b1c95214f031 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:00.168633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 551/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:01:00 2022] GET /identity/v3/roles/5f42b81ce88a4943902b63aaaffc1bc2 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:00.174773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3569c-47d5-49a5-8374-10afea5ec0b5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:00.258459 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:00.285971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3569c-47d5-49a5-8374-10afea5ec0b5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:00.328970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b588c91-afd9-4266-aa07-740b063ab913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:00.329606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b588c91-afd9-4266-aa07-740b063ab913 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:00.329884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b588c91-afd9-4266-aa07-740b063ab913 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:00.330151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b588c91-afd9-4266-aa07-740b063ab913 None admin] PATH_INFO: `/v3/users/b5eef57cbcfe4e49a9301331c4e96a8e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:00.331281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b588c91-afd9-4266-aa07-740b063ab913 None admin] RBAC: Authorizing `identity:get_user(user_id=b5eef57cbcfe4e49a9301331c4e96a8e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:00.332827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b588c91-afd9-4266-aa07-740b063ab913 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:00.334425 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 570/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:01:00 2022] GET /identity/v3/users/b5eef57cbcfe4e49a9301331c4e96a8e => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:00.340828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce241898-bb17-4f6d-8fc9-b1c95214f031 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:00.448705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce241898-bb17-4f6d-8fc9-b1c95214f031 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:00.481864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da6a3a-f68b-485a-89c5-beb2b996a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:00.482527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da6a3a-f68b-485a-89c5-beb2b996a73f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:00.482798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da6a3a-f68b-485a-89c5-beb2b996a73f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:00.483065 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da6a3a-f68b-485a-89c5-beb2b996a73f None admin] PATH_INFO: `/v3/projects/ef375d7e204b4540804a2ed0dc97341b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:00.484129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da6a3a-f68b-485a-89c5-beb2b996a73f None admin] RBAC: Authorizing `identity:get_project(project_id=ef375d7e204b4540804a2ed0dc97341b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:00.485629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da6a3a-f68b-485a-89c5-beb2b996a73f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:00.487250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 552/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 01:01:00 2022] GET /identity/v3/projects/ef375d7e204b4540804a2ed0dc97341b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:00.493487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b588c91-afd9-4266-aa07-740b063ab913 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:00.597000 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b588c91-afd9-4266-aa07-740b063ab913 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:00.632881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afa8ed-689b-4bf2-89e2-61b708601586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:00.633536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afa8ed-689b-4bf2-89e2-61b708601586 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:00.633814 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afa8ed-689b-4bf2-89e2-61b708601586 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:00.634086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afa8ed-689b-4bf2-89e2-61b708601586 None admin] PATH_INFO: `/v3/projects/ef375d7e204b4540804a2ed0dc97341b/users/b5eef57cbcfe4e49a9301331c4e96a8e/roles/5f42b81ce88a4943902b63aaaffc1bc2` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:00.637070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afa8ed-689b-4bf2-89e2-61b708601586 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef375d7e204b4540804a2ed0dc97341b, user_id=b5eef57cbcfe4e49a9301331c4e96a8e, role_id=5f42b81ce88a4943902b63aaaffc1bc2)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:00.638554 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afa8ed-689b-4bf2-89e2-61b708601586 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:00.656993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 571/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 01:01:00 2022] PUT /identity/v3/projects/ef375d7e204b4540804a2ed0dc97341b/users/b5eef57cbcfe4e49a9301331c4e96a8e/roles/5f42b81ce88a4943902b63aaaffc1bc2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:01:02.517222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ffeea-8837-4768-8ea6-48385d07ac62 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:02.518148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ffeea-8837-4768-8ea6-48385d07ac62 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:02.518148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ffeea-8837-4768-8ea6-48385d07ac62 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:02.520185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 553/1124] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:02.526082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0de25-af8e-41d9-b7ea-28c3b36a3967 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:02.526536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0de25-af8e-41d9-b7ea-28c3b36a3967 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:02.526643 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0de25-af8e-41d9-b7ea-28c3b36a3967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:02.534903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:02.547690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b2f0de25-af8e-41d9-b7ea-28c3b36a3967 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:02.548924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b2f0de25-af8e-41d9-b7ea-28c3b36a3967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:02.625174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 572/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:02.891843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ffeea-8837-4768-8ea6-48385d07ac62 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:02.943900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:03.009017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ffeea-8837-4768-8ea6-48385d07ac62 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:03.047680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3ddc-3a50-49c9-b10a-b53852459cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:03.048660 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3ddc-3a50-49c9-b10a-b53852459cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:03.049028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3ddc-3a50-49c9-b10a-b53852459cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:03.049413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3ddc-3a50-49c9-b10a-b53852459cd3 None admin] PATH_INFO: `/v3/roles/5f42b81ce88a4943902b63aaaffc1bc2` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:03.051764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a3ddc-3a50-49c9-b10a-b53852459cd3 None admin] RBAC: Authorizing `identity:get_role(role_id=5f42b81ce88a4943902b63aaaffc1bc2)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:03.054145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a3ddc-3a50-49c9-b10a-b53852459cd3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:03.056345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 554/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:01:02 2022] GET /identity/v3/roles/5f42b81ce88a4943902b63aaaffc1bc2 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:03.062076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0de25-af8e-41d9-b7ea-28c3b36a3967 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:03.167908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0de25-af8e-41d9-b7ea-28c3b36a3967 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:03.203617 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14334c8-ed58-4368-b2d9-4599cd81a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:03.204232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14334c8-ed58-4368-b2d9-4599cd81a444 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:03.204532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14334c8-ed58-4368-b2d9-4599cd81a444 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:03.204769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14334c8-ed58-4368-b2d9-4599cd81a444 None admin] PATH_INFO: `/v3/users/b5eef57cbcfe4e49a9301331c4e96a8e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:03.206030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14334c8-ed58-4368-b2d9-4599cd81a444 None admin] RBAC: Authorizing `identity:get_user(user_id=b5eef57cbcfe4e49a9301331c4e96a8e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:03.207521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14334c8-ed58-4368-b2d9-4599cd81a444 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:03.209095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 573/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:01:03 2022] GET /identity/v3/users/b5eef57cbcfe4e49a9301331c4e96a8e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:01:03.215466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3ddc-3a50-49c9-b10a-b53852459cd3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:03.331824 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3ddc-3a50-49c9-b10a-b53852459cd3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:03.343024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:03.371784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e941ad4-862c-4d8c-b682-89e7e6fa4b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:03.372415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e941ad4-862c-4d8c-b682-89e7e6fa4b4e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:03.372688 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e941ad4-862c-4d8c-b682-89e7e6fa4b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:03.372956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e941ad4-862c-4d8c-b682-89e7e6fa4b4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:03.440390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e941ad4-862c-4d8c-b682-89e7e6fa4b4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:03.441825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e941ad4-862c-4d8c-b682-89e7e6fa4b4e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:03.543130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 555/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:01:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:01:03.549622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14334c8-ed58-4368-b2d9-4599cd81a444 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:03.552697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:03.666977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14334c8-ed58-4368-b2d9-4599cd81a444 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:03.704643 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5d520-6c21-4533-885b-07ed21bceed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:03.705197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5d520-6c21-4533-885b-07ed21bceed8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:03.705472 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5d520-6c21-4533-885b-07ed21bceed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:03.705738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5d520-6c21-4533-885b-07ed21bceed8 None admin] PATH_INFO: `/v3/projects/ef375d7e204b4540804a2ed0dc97341b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:03.706977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5d520-6c21-4533-885b-07ed21bceed8 None admin] RBAC: Authorizing `identity:get_project(project_id=ef375d7e204b4540804a2ed0dc97341b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:03.708507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5d520-6c21-4533-885b-07ed21bceed8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:03.710120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 574/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 01:01:03 2022] GET /identity/v3/projects/ef375d7e204b4540804a2ed0dc97341b => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:03.717758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e941ad4-862c-4d8c-b682-89e7e6fa4b4e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:03.735892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:03.829473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e941ad4-862c-4d8c-b682-89e7e6fa4b4e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:03.864300 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d09fe-712e-4d40-8093-f158b037f81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:03.864916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d09fe-712e-4d40-8093-f158b037f81b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:03.865196 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d09fe-712e-4d40-8093-f158b037f81b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:03.865464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d09fe-712e-4d40-8093-f158b037f81b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:03.866184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d09fe-712e-4d40-8093-f158b037f81b None admin] RBAC: Adding query filter params (role.id=5f42b81ce88a4943902b63aaaffc1bc2, scope.project.id=ef375d7e204b4540804a2ed0dc97341b, user.id=b5eef57cbcfe4e49a9301331c4e96a8e) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:01:03.866492 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d09fe-712e-4d40-8093-f158b037f81b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:03.867941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d09fe-712e-4d40-8093-f158b037f81b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:03.873746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 556/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:01:03 2022] GET /identity/v3/role_assignments?user.id=b5eef57cbcfe4e49a9301331c4e96a8e&scope.project.id=ef375d7e204b4540804a2ed0dc97341b&role.id=5f42b81ce88a4943902b63aaaffc1bc2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:05.856638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58577c1-b998-4682-bb1a-6ede12d20f8f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:05.857518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58577c1-b998-4682-bb1a-6ede12d20f8f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:05.857518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58577c1-b998-4682-bb1a-6ede12d20f8f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:05.859587 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 575/1131] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:05.865006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8cf0c-62c1-4410-9242-042fd66a35f6 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:05.865436 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8cf0c-62c1-4410-9242-042fd66a35f6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:05.865524 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8cf0c-62c1-4410-9242-042fd66a35f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:05.885662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0ce8cf0c-62c1-4410-9242-042fd66a35f6 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:05.887174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0ce8cf0c-62c1-4410-9242-042fd66a35f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:05.958516 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 557/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:06.246668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58577c1-b998-4682-bb1a-6ede12d20f8f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:06.332893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:06.365951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58577c1-b998-4682-bb1a-6ede12d20f8f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:06.411902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3ace3-10db-4776-86c0-4f2d9f7c3e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:06.412624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3ace3-10db-4776-86c0-4f2d9f7c3e24 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:06.412901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3ace3-10db-4776-86c0-4f2d9f7c3e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:06.413171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3ace3-10db-4776-86c0-4f2d9f7c3e24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:06.414435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3ace3-10db-4776-86c0-4f2d9f7c3e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:06.416093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3ace3-10db-4776-86c0-4f2d9f7c3e24 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:06.417712 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 576/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:01:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:06.427551 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8cf0c-62c1-4410-9242-042fd66a35f6 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:06.432989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:06.543955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8cf0c-62c1-4410-9242-042fd66a35f6 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:06.580176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ddf74-08e2-4e99-8bdc-de8367d9e047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:06.580798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ddf74-08e2-4e99-8bdc-de8367d9e047 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:06.581068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ddf74-08e2-4e99-8bdc-de8367d9e047 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:06.581333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ddf74-08e2-4e99-8bdc-de8367d9e047 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:06.581969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ddf74-08e2-4e99-8bdc-de8367d9e047 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:06.583434 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ddf74-08e2-4e99-8bdc-de8367d9e047 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:06.613166 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 558/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 01:01:06 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:01:08.525962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a0936-cb71-40d7-84ff-5f852507fc16 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:08.526838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a0936-cb71-40d7-84ff-5f852507fc16 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:08.526838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a0936-cb71-40d7-84ff-5f852507fc16 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:08.528890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 577/1135] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:08.538301 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa5a99-33b7-4e40-86c8-9c44d9183767 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:08.538726 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa5a99-33b7-4e40-86c8-9c44d9183767 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:08.538865 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa5a99-33b7-4e40-86c8-9c44d9183767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:08.559250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b0fa5a99-33b7-4e40-86c8-9c44d9183767 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:08.560486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b0fa5a99-33b7-4e40-86c8-9c44d9183767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:08.623573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:08.641942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 559/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:08.915895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a0936-cb71-40d7-84ff-5f852507fc16 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:09.024665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a0936-cb71-40d7-84ff-5f852507fc16 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:09.061730 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046be02-bbb2-4281-898a-4d8d3f5710bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:09.062372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046be02-bbb2-4281-898a-4d8d3f5710bd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:09.062624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046be02-bbb2-4281-898a-4d8d3f5710bd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:09.062893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046be02-bbb2-4281-898a-4d8d3f5710bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:09.064128 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046be02-bbb2-4281-898a-4d8d3f5710bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:09.065646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046be02-bbb2-4281-898a-4d8d3f5710bd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:09.067230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 578/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:01:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:09.073698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa5a99-33b7-4e40-86c8-9c44d9183767 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:09.178741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa5a99-33b7-4e40-86c8-9c44d9183767 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:09.216604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14df44-e6fe-492c-bf94-a5824446f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:09.217192 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14df44-e6fe-492c-bf94-a5824446f09a None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:09.217460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14df44-e6fe-492c-bf94-a5824446f09a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:09.217725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14df44-e6fe-492c-bf94-a5824446f09a None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:09.218367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14df44-e6fe-492c-bf94-a5824446f09a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:09.219830 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14df44-e6fe-492c-bf94-a5824446f09a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:09.245056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 560/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 01:01:09 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:01:11.209915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e129c52-0619-4a8d-86d2-5c6ccb421f71 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:11.210759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e129c52-0619-4a8d-86d2-5c6ccb421f71 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:11.210759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e129c52-0619-4a8d-86d2-5c6ccb421f71 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:11.212690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 579/1139] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:11.218336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7923ad-332b-46ec-ae03-12a0d1d07c57 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:11.218729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7923ad-332b-46ec-ae03-12a0d1d07c57 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:11.218873 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7923ad-332b-46ec-ae03-12a0d1d07c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:11.245292 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3d7923ad-332b-46ec-ae03-12a0d1d07c57 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:11.246496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3d7923ad-332b-46ec-ae03-12a0d1d07c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:11.285255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:11.319354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 561/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:11.588374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e129c52-0619-4a8d-86d2-5c6ccb421f71 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:11.598671 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:11.704816 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e129c52-0619-4a8d-86d2-5c6ccb421f71 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:11.741827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4f1a0-8d98-46c2-ad14-17ea4b694812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:11.742458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4f1a0-8d98-46c2-ad14-17ea4b694812 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:11.742739 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4f1a0-8d98-46c2-ad14-17ea4b694812 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:11.743008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4f1a0-8d98-46c2-ad14-17ea4b694812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:11.756002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4f1a0-8d98-46c2-ad14-17ea4b694812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-29d4f1a0-8d98-46c2-ad14-17ea4b694812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:01:11.761070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:01:11.762208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:01:11.763144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 580/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:01:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:01:11.768377 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7923ad-332b-46ec-ae03-12a0d1d07c57 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:11.871190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7923ad-332b-46ec-ae03-12a0d1d07c57 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:11.906054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5005d07-d776-4046-8d1a-17b1ee56fed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:11.906650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5005d07-d776-4046-8d1a-17b1ee56fed0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:11.906920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5005d07-d776-4046-8d1a-17b1ee56fed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:11.907187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5005d07-d776-4046-8d1a-17b1ee56fed0 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:11.907838 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5005d07-d776-4046-8d1a-17b1ee56fed0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:01:11.908500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5005d07-d776-4046-8d1a-17b1ee56fed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:11.909906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5005d07-d776-4046-8d1a-17b1ee56fed0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:11.917999 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 562/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:11.927311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4f1a0-8d98-46c2-ad14-17ea4b694812 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:12.001258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:12.037724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4f1a0-8d98-46c2-ad14-17ea4b694812 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:12.074917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2ba03-50c5-4eb9-bbfd-7cde649b055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:12.075543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2ba03-50c5-4eb9-bbfd-7cde649b055b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:12.075817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2ba03-50c5-4eb9-bbfd-7cde649b055b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:12.076088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2ba03-50c5-4eb9-bbfd-7cde649b055b None admin] PATH_INFO: `/v3/users/e30e7a1367ca4c04bb562dbd8d3ecbd3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:12.089785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2ba03-50c5-4eb9-bbfd-7cde649b055b None admin] RBAC: Authorizing `identity:get_user(user_id=e30e7a1367ca4c04bb562dbd8d3ecbd3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:12.091277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2ba03-50c5-4eb9-bbfd-7cde649b055b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:12.092886 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 581/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:01:11 2022] GET /identity/v3/users/e30e7a1367ca4c04bb562dbd8d3ecbd3 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:12.101703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5005d07-d776-4046-8d1a-17b1ee56fed0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:12.137338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:12.204955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5005d07-d776-4046-8d1a-17b1ee56fed0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:12.240506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b37ad-d800-4d3c-a2ed-a64d29cc4b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:12.241103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b37ad-d800-4d3c-a2ed-a64d29cc4b80 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:12.241358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b37ad-d800-4d3c-a2ed-a64d29cc4b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:12.241622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b37ad-d800-4d3c-a2ed-a64d29cc4b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:12.314387 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b37ad-d800-4d3c-a2ed-a64d29cc4b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:12.315848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b37ad-d800-4d3c-a2ed-a64d29cc4b80 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:12.349152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:12.416996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 563/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:01:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:01:12.423811 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2ba03-50c5-4eb9-bbfd-7cde649b055b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:12.544197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2ba03-50c5-4eb9-bbfd-7cde649b055b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:12.569845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:12.581244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dea2f0-7f7e-459a-b07e-81a438aa1653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:12.581870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dea2f0-7f7e-459a-b07e-81a438aa1653 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:12.582143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dea2f0-7f7e-459a-b07e-81a438aa1653 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:12.582409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dea2f0-7f7e-459a-b07e-81a438aa1653 None admin] PATH_INFO: `/v3/projects/a2fcd8fed71f4aec90e43654a9612f61` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:12.583543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dea2f0-7f7e-459a-b07e-81a438aa1653 None admin] RBAC: Authorizing `identity:get_project(project_id=a2fcd8fed71f4aec90e43654a9612f61)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:12.585048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dea2f0-7f7e-459a-b07e-81a438aa1653 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:12.586703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 582/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 01:01:12 2022] GET /identity/v3/projects/a2fcd8fed71f4aec90e43654a9612f61 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:12.593140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b37ad-d800-4d3c-a2ed-a64d29cc4b80 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:12.720884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b37ad-d800-4d3c-a2ed-a64d29cc4b80 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:12.757367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612b02a-3be8-4472-989d-0fe82c7c71c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:12.757961 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612b02a-3be8-4472-989d-0fe82c7c71c5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:12.758226 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612b02a-3be8-4472-989d-0fe82c7c71c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:12.758490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612b02a-3be8-4472-989d-0fe82c7c71c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:12.759252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612b02a-3be8-4472-989d-0fe82c7c71c5 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=a2fcd8fed71f4aec90e43654a9612f61, user.id=e30e7a1367ca4c04bb562dbd8d3ecbd3) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:01:12.759560 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612b02a-3be8-4472-989d-0fe82c7c71c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:12.761065 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612b02a-3be8-4472-989d-0fe82c7c71c5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:12.762869 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:12.767390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 564/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:01:12 2022] GET /identity/v3/role_assignments?user.id=e30e7a1367ca4c04bb562dbd8d3ecbd3&scope.project.id=a2fcd8fed71f4aec90e43654a9612f61&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:14.663313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe818a6-3d02-4aa2-880d-4d9c088e3a0d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:14.663878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe818a6-3d02-4aa2-880d-4d9c088e3a0d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:14.663878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe818a6-3d02-4aa2-880d-4d9c088e3a0d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:14.665934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 583/1147] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:14.672356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e86a8-a34e-4dc5-8029-995eb91074ae None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:14.673125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e86a8-a34e-4dc5-8029-995eb91074ae None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:14.673295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e86a8-a34e-4dc5-8029-995eb91074ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:14.700407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ca8e86a8-a34e-4dc5-8029-995eb91074ae None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:14.701592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ca8e86a8-a34e-4dc5-8029-995eb91074ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:14.772185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 565/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:15.038733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe818a6-3d02-4aa2-880d-4d9c088e3a0d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:15.144433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe818a6-3d02-4aa2-880d-4d9c088e3a0d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:15.180701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707cb79-471d-4d9c-8bd5-1bc5d7eb2e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:15.181333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707cb79-471d-4d9c-8bd5-1bc5d7eb2e34 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:15.181614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707cb79-471d-4d9c-8bd5-1bc5d7eb2e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:15.181875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707cb79-471d-4d9c-8bd5-1bc5d7eb2e34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:15.192116 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707cb79-471d-4d9c-8bd5-1bc5d7eb2e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8707cb79-471d-4d9c-8bd5-1bc5d7eb2e34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:01:15.196997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:01:15.198143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:01:15.199018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 584/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:01:15.204937 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e86a8-a34e-4dc5-8029-995eb91074ae None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:15.311383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e86a8-a34e-4dc5-8029-995eb91074ae None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:15.338132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:15.347721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d839f-8442-4b84-96b9-0d3a20940462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:15.348321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d839f-8442-4b84-96b9-0d3a20940462 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:15.348616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d839f-8442-4b84-96b9-0d3a20940462 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:15.348882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d839f-8442-4b84-96b9-0d3a20940462 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:15.349535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d839f-8442-4b84-96b9-0d3a20940462 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:01:15.349834 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d839f-8442-4b84-96b9-0d3a20940462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:15.351230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d839f-8442-4b84-96b9-0d3a20940462 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:15.359428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 566/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:01:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:15.365387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707cb79-471d-4d9c-8bd5-1bc5d7eb2e34 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:15.431164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:15.480114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707cb79-471d-4d9c-8bd5-1bc5d7eb2e34 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:15.518959 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280e5d6-5e63-4a16-b591-6323f36f980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:15.519569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280e5d6-5e63-4a16-b591-6323f36f980a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:15.519841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280e5d6-5e63-4a16-b591-6323f36f980a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:15.520111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280e5d6-5e63-4a16-b591-6323f36f980a None admin] PATH_INFO: `/v3/users/e30e7a1367ca4c04bb562dbd8d3ecbd3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:15.521413 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280e5d6-5e63-4a16-b591-6323f36f980a None admin] RBAC: Authorizing `identity:get_user(user_id=e30e7a1367ca4c04bb562dbd8d3ecbd3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:15.522897 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280e5d6-5e63-4a16-b591-6323f36f980a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:15.524637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 585/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:01:15 2022] GET /identity/v3/users/e30e7a1367ca4c04bb562dbd8d3ecbd3 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:15.531380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d839f-8442-4b84-96b9-0d3a20940462 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:15.640512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d839f-8442-4b84-96b9-0d3a20940462 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:15.675953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc52da-549a-41d3-ba4c-25b4f2f3dd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:15.676627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc52da-549a-41d3-ba4c-25b4f2f3dd58 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:15.676845 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc52da-549a-41d3-ba4c-25b4f2f3dd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:15.677113 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc52da-549a-41d3-ba4c-25b4f2f3dd58 None admin] PATH_INFO: `/v3/projects/a2fcd8fed71f4aec90e43654a9612f61` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:15.678259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc52da-549a-41d3-ba4c-25b4f2f3dd58 None admin] RBAC: Authorizing `identity:get_project(project_id=a2fcd8fed71f4aec90e43654a9612f61)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:15.679725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc52da-549a-41d3-ba4c-25b4f2f3dd58 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:15.681399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 567/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 01:01:15 2022] GET /identity/v3/projects/a2fcd8fed71f4aec90e43654a9612f61 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:15.690629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280e5d6-5e63-4a16-b591-6323f36f980a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:15.807624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280e5d6-5e63-4a16-b591-6323f36f980a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:15.828081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:15.846225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b95ca7-2232-42e9-9183-b3215ab765ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:15.846890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b95ca7-2232-42e9-9183-b3215ab765ef None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:15.847171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b95ca7-2232-42e9-9183-b3215ab765ef None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:15.847444 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b95ca7-2232-42e9-9183-b3215ab765ef None admin] PATH_INFO: `/v3/projects/a2fcd8fed71f4aec90e43654a9612f61/users/e30e7a1367ca4c04bb562dbd8d3ecbd3/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:15.849517 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b95ca7-2232-42e9-9183-b3215ab765ef None admin] RBAC: Authorizing `identity:create_grant(project_id=a2fcd8fed71f4aec90e43654a9612f61, user_id=e30e7a1367ca4c04bb562dbd8d3ecbd3, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:15.851006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b95ca7-2232-42e9-9183-b3215ab765ef None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:15.867009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 586/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 01:01:15 2022] PUT /identity/v3/projects/a2fcd8fed71f4aec90e43654a9612f61/users/e30e7a1367ca4c04bb562dbd8d3ecbd3/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:01:17.750513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19f1b6-517a-4549-87a5-40ecc97a0bdf None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:17.751410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19f1b6-517a-4549-87a5-40ecc97a0bdf None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:17.751410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19f1b6-517a-4549-87a5-40ecc97a0bdf None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:17.753582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 568/1154] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:17.760155 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fe904-3342-46f0-9311-ae32a1e33029 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:17.760932 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fe904-3342-46f0-9311-ae32a1e33029 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:17.761042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fe904-3342-46f0-9311-ae32a1e33029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:17.791363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c62fe904-3342-46f0-9311-ae32a1e33029 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:17.792607 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c62fe904-3342-46f0-9311-ae32a1e33029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:17.864030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 587/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:18.140644 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19f1b6-517a-4549-87a5-40ecc97a0bdf None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:18.209122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:18.256715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19f1b6-517a-4549-87a5-40ecc97a0bdf None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:18.292331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841a9b7-dcc3-4c5b-bdfb-f5538f3e05e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:18.292953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841a9b7-dcc3-4c5b-bdfb-f5538f3e05e7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:18.293294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841a9b7-dcc3-4c5b-bdfb-f5538f3e05e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:18.293499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841a9b7-dcc3-4c5b-bdfb-f5538f3e05e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:18.304978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841a9b7-dcc3-4c5b-bdfb-f5538f3e05e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-8841a9b7-dcc3-4c5b-bdfb-f5538f3e05e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:01:18.309818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:01:18.310905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:01:18.312062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 569/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:01:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:01:18.317684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fe904-3342-46f0-9311-ae32a1e33029 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:18.424669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fe904-3342-46f0-9311-ae32a1e33029 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:18.436327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:18.462962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf025e-fd9e-48cb-9fd5-83235779869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:18.463573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf025e-fd9e-48cb-9fd5-83235779869e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:18.463848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf025e-fd9e-48cb-9fd5-83235779869e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:18.464089 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf025e-fd9e-48cb-9fd5-83235779869e None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:18.464817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf025e-fd9e-48cb-9fd5-83235779869e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:01:18.465121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf025e-fd9e-48cb-9fd5-83235779869e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:18.466530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf025e-fd9e-48cb-9fd5-83235779869e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:18.474693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 588/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:01:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:01:18.481408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841a9b7-dcc3-4c5b-bdfb-f5538f3e05e7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:18.590951 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841a9b7-dcc3-4c5b-bdfb-f5538f3e05e7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:18.607858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:18.627658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548946f3-b0e4-4ebe-9aac-883d0bcfa619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:18.628310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548946f3-b0e4-4ebe-9aac-883d0bcfa619 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:18.628595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548946f3-b0e4-4ebe-9aac-883d0bcfa619 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:18.628867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548946f3-b0e4-4ebe-9aac-883d0bcfa619 None admin] PATH_INFO: `/v3/users/e30e7a1367ca4c04bb562dbd8d3ecbd3` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:18.630050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548946f3-b0e4-4ebe-9aac-883d0bcfa619 None admin] RBAC: Authorizing `identity:get_user(user_id=e30e7a1367ca4c04bb562dbd8d3ecbd3)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:18.631537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548946f3-b0e4-4ebe-9aac-883d0bcfa619 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:18.633144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 570/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:01:18 2022] GET /identity/v3/users/e30e7a1367ca4c04bb562dbd8d3ecbd3 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:18.640676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf025e-fd9e-48cb-9fd5-83235779869e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:18.748489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf025e-fd9e-48cb-9fd5-83235779869e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:18.783558 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c55c5-2b61-4403-89c5-c05c7074448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:18.784165 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c55c5-2b61-4403-89c5-c05c7074448e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:18.784436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c55c5-2b61-4403-89c5-c05c7074448e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:18.784698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c55c5-2b61-4403-89c5-c05c7074448e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:18.826260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:18.854926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c55c5-2b61-4403-89c5-c05c7074448e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:18.856341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c55c5-2b61-4403-89c5-c05c7074448e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:18.955809 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 589/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:01:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:01:18.964264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548946f3-b0e4-4ebe-9aac-883d0bcfa619 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:19.071503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548946f3-b0e4-4ebe-9aac-883d0bcfa619 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:19.106559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd237c-504e-4980-b0a4-01e51e97c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:19.107116 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd237c-504e-4980-b0a4-01e51e97c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:19.107388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd237c-504e-4980-b0a4-01e51e97c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:19.107657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd237c-504e-4980-b0a4-01e51e97c6f1 None admin] PATH_INFO: `/v3/projects/a2fcd8fed71f4aec90e43654a9612f61` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:19.108832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd237c-504e-4980-b0a4-01e51e97c6f1 None admin] RBAC: Authorizing `identity:get_project(project_id=a2fcd8fed71f4aec90e43654a9612f61)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:19.110314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd237c-504e-4980-b0a4-01e51e97c6f1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:19.111948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 571/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 01:01:18 2022] GET /identity/v3/projects/a2fcd8fed71f4aec90e43654a9612f61 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:19.119281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c55c5-2b61-4403-89c5-c05c7074448e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:19.200741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:19.231601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c55c5-2b61-4403-89c5-c05c7074448e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:19.266984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1583d17-836f-4ad5-9ebd-d9e5bfe1b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:19.267578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1583d17-836f-4ad5-9ebd-d9e5bfe1b435 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:19.267852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1583d17-836f-4ad5-9ebd-d9e5bfe1b435 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:19.268125 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1583d17-836f-4ad5-9ebd-d9e5bfe1b435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:19.268885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1583d17-836f-4ad5-9ebd-d9e5bfe1b435 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=a2fcd8fed71f4aec90e43654a9612f61, user.id=e30e7a1367ca4c04bb562dbd8d3ecbd3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:01:19.269191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1583d17-836f-4ad5-9ebd-d9e5bfe1b435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:19.270683 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1583d17-836f-4ad5-9ebd-d9e5bfe1b435 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:19.276586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 590/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:01:19 2022] GET /identity/v3/role_assignments?user.id=e30e7a1367ca4c04bb562dbd8d3ecbd3&scope.project.id=a2fcd8fed71f4aec90e43654a9612f61&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:21.173916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604c4f7-4dbc-4afb-80eb-ac9dc36a2999 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:21.174470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604c4f7-4dbc-4afb-80eb-ac9dc36a2999 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:21.174470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604c4f7-4dbc-4afb-80eb-ac9dc36a2999 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:21.175780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 572/1162] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:21.182408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c73dd5-8401-4483-a8e4-e57a245826b6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:21.183132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c73dd5-8401-4483-a8e4-e57a245826b6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:21.183280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c73dd5-8401-4483-a8e4-e57a245826b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:21.213764 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-27c73dd5-8401-4483-a8e4-e57a245826b6 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:21.214981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-27c73dd5-8401-4483-a8e4-e57a245826b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:21.287204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 591/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:21.549543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604c4f7-4dbc-4afb-80eb-ac9dc36a2999 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:21.614851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:21.665581 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604c4f7-4dbc-4afb-80eb-ac9dc36a2999 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:21.702539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9377a9-8d49-4a04-aa85-32d7ebd2040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:21.703135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9377a9-8d49-4a04-aa85-32d7ebd2040e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:21.703404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9377a9-8d49-4a04-aa85-32d7ebd2040e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:21.703672 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9377a9-8d49-4a04-aa85-32d7ebd2040e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:21.777482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9377a9-8d49-4a04-aa85-32d7ebd2040e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:21.778968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9377a9-8d49-4a04-aa85-32d7ebd2040e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:21.833490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:21.879971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 573/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:01:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:01:21.886267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c73dd5-8401-4483-a8e4-e57a245826b6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:21.957122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:22.001835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c73dd5-8401-4483-a8e4-e57a245826b6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:22.041198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c12c5-f0d8-429f-a2a5-470bb18603f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:22.041839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c12c5-f0d8-429f-a2a5-470bb18603f0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:22.042114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c12c5-f0d8-429f-a2a5-470bb18603f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:22.042376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c12c5-f0d8-429f-a2a5-470bb18603f0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:22.050752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c12c5-f0d8-429f-a2a5-470bb18603f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:22.052315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c12c5-f0d8-429f-a2a5-470bb18603f0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5a1c12c5-f0d8-429f-a2a5-470bb18603f0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:01:22.065098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:01:22.066373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:01:22.067952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 592/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 6 01:01:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:01:22.074403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9377a9-8d49-4a04-aa85-32d7ebd2040e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:22.186791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9377a9-8d49-4a04-aa85-32d7ebd2040e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:22.221130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c2d22-ce2a-4499-a193-1e4b20525040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:22.221719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c2d22-ce2a-4499-a193-1e4b20525040 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:22.221988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c2d22-ce2a-4499-a193-1e4b20525040 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:22.222255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c2d22-ce2a-4499-a193-1e4b20525040 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:22.222880 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c2d22-ce2a-4499-a193-1e4b20525040 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:01:22.223176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c2d22-ce2a-4499-a193-1e4b20525040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:22.224615 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c2d22-ce2a-4499-a193-1e4b20525040 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:22.231911 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 574/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 6 01:01:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:24.087246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ce229-bff5-45f8-9dc4-fa19f63a58e2 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:24.088115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ce229-bff5-45f8-9dc4-fa19f63a58e2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:24.088115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ce229-bff5-45f8-9dc4-fa19f63a58e2 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:24.090570 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 593/1167] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:24.095803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec716c3-54dc-43d8-a2b2-649328279d61 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:24.096244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec716c3-54dc-43d8-a2b2-649328279d61 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:24.096361 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec716c3-54dc-43d8-a2b2-649328279d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:24.116442 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-dec716c3-54dc-43d8-a2b2-649328279d61 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:24.117719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-dec716c3-54dc-43d8-a2b2-649328279d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:24.131046 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:24.186027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 575/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:24.451223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ce229-bff5-45f8-9dc4-fa19f63a58e2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:24.579122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ce229-bff5-45f8-9dc4-fa19f63a58e2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:24.606437 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:24.622041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47f8ae-d861-4024-86da-8597f69649bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:24.622984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47f8ae-d861-4024-86da-8597f69649bd None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:24.623434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47f8ae-d861-4024-86da-8597f69649bd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:24.623885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47f8ae-d861-4024-86da-8597f69649bd None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:24.625026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47f8ae-d861-4024-86da-8597f69649bd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:24.627317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47f8ae-d861-4024-86da-8597f69649bd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:24.647565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 594/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Tue Sep 6 01:01:24 2022] POST /identity/v3/domains => generated 267 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:01:26.543488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be53907-5c84-4438-9cb2-3b6ffd226dc9 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:26.544405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be53907-5c84-4438-9cb2-3b6ffd226dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:26.544405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be53907-5c84-4438-9cb2-3b6ffd226dc9 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:26.546593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 576/1170] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:26.552905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a439f-9414-491f-b1c3-df66643cf6f3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:26.553584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a439f-9414-491f-b1c3-df66643cf6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:26.553727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a439f-9414-491f-b1c3-df66643cf6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:26.579723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1f5a439f-9414-491f-b1c3-df66643cf6f3 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:26.580970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1f5a439f-9414-491f-b1c3-df66643cf6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:26.661067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 595/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:26.925336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be53907-5c84-4438-9cb2-3b6ffd226dc9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:27.047144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be53907-5c84-4438-9cb2-3b6ffd226dc9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:27.088534 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7912da-0157-44ce-bee6-a69183764a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:27.089165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7912da-0157-44ce-bee6-a69183764a1b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:27.089435 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7912da-0157-44ce-bee6-a69183764a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:27.089703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7912da-0157-44ce-bee6-a69183764a1b None admin] PATH_INFO: `/v3/domains/59e3087eade84a71a04a90adbd202d5f` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:27.104682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7912da-0157-44ce-bee6-a69183764a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=59e3087eade84a71a04a90adbd202d5f)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:27.107131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7912da-0157-44ce-bee6-a69183764a1b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:27.109617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 577/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Sep 6 01:01:26 2022] GET /identity/v3/domains/59e3087eade84a71a04a90adbd202d5f => generated 267 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:27.115739 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a439f-9414-491f-b1c3-df66643cf6f3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:27.232220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a439f-9414-491f-b1c3-df66643cf6f3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:27.249017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:27.271436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e3ef4-fcbd-437f-ab96-2dffd224edad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:27.272040 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3ef4-fcbd-437f-ab96-2dffd224edad None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:27.272312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3ef4-fcbd-437f-ab96-2dffd224edad None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:27.272599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3ef4-fcbd-437f-ab96-2dffd224edad None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:27.273245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e3ef4-fcbd-437f-ab96-2dffd224edad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:27.274719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e3ef4-fcbd-437f-ab96-2dffd224edad None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:27.304257 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 596/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 01:01:27 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:01:29.236983 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b28024-e0b0-41cd-a9fb-16b76fc2364f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:29.237891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b28024-e0b0-41cd-a9fb-16b76fc2364f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:29.237891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b28024-e0b0-41cd-a9fb-16b76fc2364f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:29.239974 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 578/1174] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:29.247188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020488fa-37a7-4e34-98a0-00093195d456 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:29.247621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020488fa-37a7-4e34-98a0-00093195d456 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:29.247729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020488fa-37a7-4e34-98a0-00093195d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:29.276187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-020488fa-37a7-4e34-98a0-00093195d456 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:29.277404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-020488fa-37a7-4e34-98a0-00093195d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:29.346954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 597/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:29.616232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b28024-e0b0-41cd-a9fb-16b76fc2364f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:29.634864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:29.731264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b28024-e0b0-41cd-a9fb-16b76fc2364f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:29.776398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab5ae4-e615-4037-bfa5-0c55f6826d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:29.777024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5ae4-e615-4037-bfa5-0c55f6826d56 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:29.777295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5ae4-e615-4037-bfa5-0c55f6826d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:29.777586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5ae4-e615-4037-bfa5-0c55f6826d56 None admin] PATH_INFO: `/v3/domains/59e3087eade84a71a04a90adbd202d5f` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:29.778829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab5ae4-e615-4037-bfa5-0c55f6826d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=59e3087eade84a71a04a90adbd202d5f)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:29.780329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab5ae4-e615-4037-bfa5-0c55f6826d56 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:29.781876 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 579/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Sep 6 01:01:29 2022] GET /identity/v3/domains/59e3087eade84a71a04a90adbd202d5f => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:29.788254 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020488fa-37a7-4e34-98a0-00093195d456 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:29.885470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:29.889881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020488fa-37a7-4e34-98a0-00093195d456 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:29.925473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6509ca-42ef-4bde-a0f1-a5bb314ea2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:29.926067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6509ca-42ef-4bde-a0f1-a5bb314ea2e0 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:29.926336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6509ca-42ef-4bde-a0f1-a5bb314ea2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:29.926597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6509ca-42ef-4bde-a0f1-a5bb314ea2e0 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:29.927250 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6509ca-42ef-4bde-a0f1-a5bb314ea2e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:29.928768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6509ca-42ef-4bde-a0f1-a5bb314ea2e0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:29.957699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 598/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 01:01:29 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:01:31.878909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc530e5f-0bc5-435b-a6c6-9f34b128cd0b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:31.879469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc530e5f-0bc5-435b-a6c6-9f34b128cd0b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:31.879469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc530e5f-0bc5-435b-a6c6-9f34b128cd0b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:31.881645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 580/1178] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:31.888617 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee45d9d-1f56-40da-aa73-cc1c063e25db None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:31.889047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee45d9d-1f56-40da-aa73-cc1c063e25db None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:31.889179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee45d9d-1f56-40da-aa73-cc1c063e25db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:31.917187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7ee45d9d-1f56-40da-aa73-cc1c063e25db None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:31.918371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7ee45d9d-1f56-40da-aa73-cc1c063e25db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:31.988763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 599/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:32.269414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc530e5f-0bc5-435b-a6c6-9f34b128cd0b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:32.375592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:32.411490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc530e5f-0bc5-435b-a6c6-9f34b128cd0b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:32.459536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535e201-b827-4be0-bcc8-4d0b4f03925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:32.460480 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535e201-b827-4be0-bcc8-4d0b4f03925a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:32.460901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535e201-b827-4be0-bcc8-4d0b4f03925a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:32.461196 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535e201-b827-4be0-bcc8-4d0b4f03925a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:32.472124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535e201-b827-4be0-bcc8-4d0b4f03925a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e535e201-b827-4be0-bcc8-4d0b4f03925a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:01:32.477036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:01:32.478178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:01:32.479100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 581/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:01:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:01:32.484562 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee45d9d-1f56-40da-aa73-cc1c063e25db None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:32.573958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:32.591727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee45d9d-1f56-40da-aa73-cc1c063e25db None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:32.631199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02884c7-a085-47aa-aa2a-a38eff2087bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:32.631790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02884c7-a085-47aa-aa2a-a38eff2087bb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:32.632061 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02884c7-a085-47aa-aa2a-a38eff2087bb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:32.632336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02884c7-a085-47aa-aa2a-a38eff2087bb None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:32.633058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02884c7-a085-47aa-aa2a-a38eff2087bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:01:32.633357 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02884c7-a085-47aa-aa2a-a38eff2087bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:32.634872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02884c7-a085-47aa-aa2a-a38eff2087bb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:32.643081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 600/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:01:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:32.653078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535e201-b827-4be0-bcc8-4d0b4f03925a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:32.768308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535e201-b827-4be0-bcc8-4d0b4f03925a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:32.808943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81ec92-cb20-4d67-b8c4-92a88fcaaaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:32.809569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81ec92-cb20-4d67-b8c4-92a88fcaaaec None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:32.809839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81ec92-cb20-4d67-b8c4-92a88fcaaaec None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:32.810104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81ec92-cb20-4d67-b8c4-92a88fcaaaec None admin] PATH_INFO: `/v3/users/b974bacb1869454ab7c61473e2e13755` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:32.813456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:32.825273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81ec92-cb20-4d67-b8c4-92a88fcaaaec None admin] RBAC: Authorizing `identity:get_user(user_id=b974bacb1869454ab7c61473e2e13755)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:32.826691 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81ec92-cb20-4d67-b8c4-92a88fcaaaec None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:32.828314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 582/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:01:32 2022] GET /identity/v3/users/b974bacb1869454ab7c61473e2e13755 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:32.834570 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02884c7-a085-47aa-aa2a-a38eff2087bb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:32.939518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02884c7-a085-47aa-aa2a-a38eff2087bb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:32.974991 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72072170-e171-4669-98c4-0ec80bd5eaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:32.975583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72072170-e171-4669-98c4-0ec80bd5eaaa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:32.975878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72072170-e171-4669-98c4-0ec80bd5eaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:32.976113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72072170-e171-4669-98c4-0ec80bd5eaaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:32.991745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:33.058589 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72072170-e171-4669-98c4-0ec80bd5eaaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:33.060095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72072170-e171-4669-98c4-0ec80bd5eaaa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:33.159913 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 601/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:01:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:01:33.166390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81ec92-cb20-4d67-b8c4-92a88fcaaaec None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:33.273908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81ec92-cb20-4d67-b8c4-92a88fcaaaec None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:33.310717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85856b-e687-42f0-a3cd-c7d2cd46e3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:33.311340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85856b-e687-42f0-a3cd-c7d2cd46e3dd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:33.311617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85856b-e687-42f0-a3cd-c7d2cd46e3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:33.311890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85856b-e687-42f0-a3cd-c7d2cd46e3dd None admin] PATH_INFO: `/v3/projects/30ab1db6e4304e439fe66d693d35d7eb` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:33.313039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85856b-e687-42f0-a3cd-c7d2cd46e3dd None admin] RBAC: Authorizing `identity:get_project(project_id=30ab1db6e4304e439fe66d693d35d7eb)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:33.314528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85856b-e687-42f0-a3cd-c7d2cd46e3dd None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:33.316141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 583/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 01:01:33 2022] GET /identity/v3/projects/30ab1db6e4304e439fe66d693d35d7eb => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:33.323431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72072170-e171-4669-98c4-0ec80bd5eaaa None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:33.380744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:33.446087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72072170-e171-4669-98c4-0ec80bd5eaaa None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:33.481772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70506e0-e411-4d24-b41d-513766cebf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:33.482359 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70506e0-e411-4d24-b41d-513766cebf0c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:33.482637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70506e0-e411-4d24-b41d-513766cebf0c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:33.482901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70506e0-e411-4d24-b41d-513766cebf0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:33.483615 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70506e0-e411-4d24-b41d-513766cebf0c None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=30ab1db6e4304e439fe66d693d35d7eb, user.id=b974bacb1869454ab7c61473e2e13755) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:01:33.483916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70506e0-e411-4d24-b41d-513766cebf0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:33.485434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70506e0-e411-4d24-b41d-513766cebf0c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:33.490861 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 602/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:01:33 2022] GET /identity/v3/role_assignments?user.id=b974bacb1869454ab7c61473e2e13755&scope.project.id=30ab1db6e4304e439fe66d693d35d7eb&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:35.366032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7259b-61c3-412d-8912-3d8126f123ad None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:35.366576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7259b-61c3-412d-8912-3d8126f123ad None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:35.366576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7259b-61c3-412d-8912-3d8126f123ad None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:35.367822 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 584/1186] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:35.374284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616031b9-cee5-46ae-a8cf-924e10ea766f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:35.374975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616031b9-cee5-46ae-a8cf-924e10ea766f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:35.375145 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616031b9-cee5-46ae-a8cf-924e10ea766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:35.403151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-616031b9-cee5-46ae-a8cf-924e10ea766f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:35.404378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-616031b9-cee5-46ae-a8cf-924e10ea766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:35.474333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 603/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:35.743181 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7259b-61c3-412d-8912-3d8126f123ad None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:35.813482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:35.855952 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7259b-61c3-412d-8912-3d8126f123ad None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:35.891575 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3efe0-33df-460d-917a-219eef7cdeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:35.892192 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3efe0-33df-460d-917a-219eef7cdeea None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:35.892499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3efe0-33df-460d-917a-219eef7cdeea None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:35.892773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3efe0-33df-460d-917a-219eef7cdeea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:35.903757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3efe0-33df-460d-917a-219eef7cdeea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-b4d3efe0-33df-460d-917a-219eef7cdeea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:01:35.908939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:01:35.910007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:01:35.920381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 585/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:01:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:01:35.921320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616031b9-cee5-46ae-a8cf-924e10ea766f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:35.964737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:36.026892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616031b9-cee5-46ae-a8cf-924e10ea766f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:36.064137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cfe8a-401c-4c18-923e-0234ded46df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:36.064772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cfe8a-401c-4c18-923e-0234ded46df3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:36.065048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cfe8a-401c-4c18-923e-0234ded46df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:36.065326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cfe8a-401c-4c18-923e-0234ded46df3 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:36.066020 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cfe8a-401c-4c18-923e-0234ded46df3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:01:36.066321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cfe8a-401c-4c18-923e-0234ded46df3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:36.067737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cfe8a-401c-4c18-923e-0234ded46df3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:36.076068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 604/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:01:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:36.082670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3efe0-33df-460d-917a-219eef7cdeea None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:36.204383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3efe0-33df-460d-917a-219eef7cdeea None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:36.227228 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:36.239275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3b2c-a35f-43ec-8f54-0b89bb34e3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:36.239900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3b2c-a35f-43ec-8f54-0b89bb34e3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:36.240176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3b2c-a35f-43ec-8f54-0b89bb34e3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:36.240542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3b2c-a35f-43ec-8f54-0b89bb34e3f9 None admin] PATH_INFO: `/v3/users/b974bacb1869454ab7c61473e2e13755` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:36.241786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d3b2c-a35f-43ec-8f54-0b89bb34e3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=b974bacb1869454ab7c61473e2e13755)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:36.243269 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d3b2c-a35f-43ec-8f54-0b89bb34e3f9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:36.244863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 586/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:01:36 2022] GET /identity/v3/users/b974bacb1869454ab7c61473e2e13755 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:36.251059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cfe8a-401c-4c18-923e-0234ded46df3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:36.358953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cfe8a-401c-4c18-923e-0234ded46df3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:36.360484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:36.395428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86172f-747c-4cd3-ac6e-264c15207f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:36.396058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86172f-747c-4cd3-ac6e-264c15207f52 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:36.396392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86172f-747c-4cd3-ac6e-264c15207f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:36.396611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86172f-747c-4cd3-ac6e-264c15207f52 None admin] PATH_INFO: `/v3/projects/30ab1db6e4304e439fe66d693d35d7eb` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:36.397852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86172f-747c-4cd3-ac6e-264c15207f52 None admin] RBAC: Authorizing `identity:get_project(project_id=30ab1db6e4304e439fe66d693d35d7eb)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:36.399341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86172f-747c-4cd3-ac6e-264c15207f52 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:36.401520 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 605/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 01:01:36 2022] GET /identity/v3/projects/30ab1db6e4304e439fe66d693d35d7eb => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:36.408253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3b2c-a35f-43ec-8f54-0b89bb34e3f9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:36.521039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3b2c-a35f-43ec-8f54-0b89bb34e3f9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:36.556830 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a60d5-8ff8-414c-9873-9f213fe65f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:36.557471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a60d5-8ff8-414c-9873-9f213fe65f14 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:36.557746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a60d5-8ff8-414c-9873-9f213fe65f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:36.558012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a60d5-8ff8-414c-9873-9f213fe65f14 None admin] PATH_INFO: `/v3/projects/30ab1db6e4304e439fe66d693d35d7eb/users/b974bacb1869454ab7c61473e2e13755/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:36.560178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a60d5-8ff8-414c-9873-9f213fe65f14 None admin] RBAC: Authorizing `identity:create_grant(project_id=30ab1db6e4304e439fe66d693d35d7eb, user_id=b974bacb1869454ab7c61473e2e13755, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:36.561802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a60d5-8ff8-414c-9873-9f213fe65f14 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:36.583594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 587/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 01:01:36 2022] PUT /identity/v3/projects/30ab1db6e4304e439fe66d693d35d7eb/users/b974bacb1869454ab7c61473e2e13755/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:01:38.542242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acded40c-9c3d-4a64-8c4b-660e70d1457e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:38.542836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acded40c-9c3d-4a64-8c4b-660e70d1457e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:38.542836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acded40c-9c3d-4a64-8c4b-660e70d1457e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:38.544265 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 606/1193] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:01:38.550906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0206a-234d-441e-998a-26a568723df5 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:38.551601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0206a-234d-441e-998a-26a568723df5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:38.551601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0206a-234d-441e-998a-26a568723df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:38.579461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c9c0206a-234d-441e-998a-26a568723df5 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:01:38.580706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c9c0206a-234d-441e-998a-26a568723df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:01:38.640310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:38.667495 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 588/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:01:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:01:38.953321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acded40c-9c3d-4a64-8c4b-660e70d1457e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:39.072733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acded40c-9c3d-4a64-8c4b-660e70d1457e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:39.112853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cbc8f-8eb5-43d0-915c-f93620829c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:39.113571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cbc8f-8eb5-43d0-915c-f93620829c12 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:39.113846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cbc8f-8eb5-43d0-915c-f93620829c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:39.114187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cbc8f-8eb5-43d0-915c-f93620829c12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:39.125291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cbc8f-8eb5-43d0-915c-f93620829c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f18cbc8f-8eb5-43d0-915c-f93620829c12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:01:39.130184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:01:39.131310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:01:39.132374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 607/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:01:39.138090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0206a-234d-441e-998a-26a568723df5 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:39.271132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0206a-234d-441e-998a-26a568723df5 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:39.309054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce1180-1f4b-46f5-a367-c1d1ff009d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:39.309656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce1180-1f4b-46f5-a367-c1d1ff009d0a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:39.309932 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce1180-1f4b-46f5-a367-c1d1ff009d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:39.310206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce1180-1f4b-46f5-a367-c1d1ff009d0a None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:39.310869 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce1180-1f4b-46f5-a367-c1d1ff009d0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:01:39.311167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce1180-1f4b-46f5-a367-c1d1ff009d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:39.312606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce1180-1f4b-46f5-a367-c1d1ff009d0a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:39.320713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 589/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:01:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:39.327496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cbc8f-8eb5-43d0-915c-f93620829c12 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:39.371476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:39.445079 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cbc8f-8eb5-43d0-915c-f93620829c12 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:39.481235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb984de6-4f6a-485c-847c-4a850c2a41d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:39.481858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb984de6-4f6a-485c-847c-4a850c2a41d6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:39.482132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb984de6-4f6a-485c-847c-4a850c2a41d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:39.482404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb984de6-4f6a-485c-847c-4a850c2a41d6 None admin] PATH_INFO: `/v3/users/b974bacb1869454ab7c61473e2e13755` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:39.483603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb984de6-4f6a-485c-847c-4a850c2a41d6 None admin] RBAC: Authorizing `identity:get_user(user_id=b974bacb1869454ab7c61473e2e13755)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:39.485113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb984de6-4f6a-485c-847c-4a850c2a41d6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:39.486713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 608/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 6 01:01:39 2022] GET /identity/v3/users/b974bacb1869454ab7c61473e2e13755 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:39.495985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce1180-1f4b-46f5-a367-c1d1ff009d0a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:39.548372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:39.619101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce1180-1f4b-46f5-a367-c1d1ff009d0a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:39.658766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb76b9-e9f6-4c2c-bd01-9de86002ad40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:39.659369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb76b9-e9f6-4c2c-bd01-9de86002ad40 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:39.659643 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb76b9-e9f6-4c2c-bd01-9de86002ad40 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:39.659916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb76b9-e9f6-4c2c-bd01-9de86002ad40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:39.729466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb76b9-e9f6-4c2c-bd01-9de86002ad40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:39.730965 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb76b9-e9f6-4c2c-bd01-9de86002ad40 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:39.773634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:39.838714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 590/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:01:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:01:39.847995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb984de6-4f6a-485c-847c-4a850c2a41d6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:39.952674 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:39.956670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb984de6-4f6a-485c-847c-4a850c2a41d6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:39.998342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b160a5-2b79-4e7e-92f0-151bf46fe1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:39.999216 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b160a5-2b79-4e7e-92f0-151bf46fe1ed None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:39.999532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b160a5-2b79-4e7e-92f0-151bf46fe1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:39.999874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b160a5-2b79-4e7e-92f0-151bf46fe1ed None admin] PATH_INFO: `/v3/projects/30ab1db6e4304e439fe66d693d35d7eb` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:40.001879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b160a5-2b79-4e7e-92f0-151bf46fe1ed None admin] RBAC: Authorizing `identity:get_project(project_id=30ab1db6e4304e439fe66d693d35d7eb)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:40.004209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b160a5-2b79-4e7e-92f0-151bf46fe1ed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:40.006408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 609/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 6 01:01:39 2022] GET /identity/v3/projects/30ab1db6e4304e439fe66d693d35d7eb => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:40.012955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb76b9-e9f6-4c2c-bd01-9de86002ad40 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:01:40.117417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb76b9-e9f6-4c2c-bd01-9de86002ad40 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:01:40.153354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344385ba-d4e7-4b3b-beb2-642b759070f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:01:40.153956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344385ba-d4e7-4b3b-beb2-642b759070f8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:01:40.154230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344385ba-d4e7-4b3b-beb2-642b759070f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:01:40.154503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344385ba-d4e7-4b3b-beb2-642b759070f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:01:40.155228 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344385ba-d4e7-4b3b-beb2-642b759070f8 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=30ab1db6e4304e439fe66d693d35d7eb, user.id=b974bacb1869454ab7c61473e2e13755) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:01:40.155538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344385ba-d4e7-4b3b-beb2-642b759070f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:01:40.157393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344385ba-d4e7-4b3b-beb2-642b759070f8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:01:40.163245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 591/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:01:40 2022] GET /identity/v3/role_assignments?user.id=b974bacb1869454ab7c61473e2e13755&scope.project.id=30ab1db6e4304e439fe66d693d35d7eb&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:01:49.990453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=17 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:01:50.160547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:35.851901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dddd7-a295-43bc-9f1e-9593be9bd2a8 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:35.852535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dddd7-a295-43bc-9f1e-9593be9bd2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:35.852535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dddd7-a295-43bc-9f1e-9593be9bd2a8 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:35.853961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 610/1201] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:02:35.859666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2590-d4ea-422a-a102-981e13165b85 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:35.860235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2590-d4ea-422a-a102-981e13165b85 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:35.860235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2590-d4ea-422a-a102-981e13165b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:35.884576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-21de2590-d4ea-422a-a102-981e13165b85 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:02:35.885814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-21de2590-d4ea-422a-a102-981e13165b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:02:35.980818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 592/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:02:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:02:36.247041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dddd7-a295-43bc-9f1e-9593be9bd2a8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:36.389198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dddd7-a295-43bc-9f1e-9593be9bd2a8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:36.433585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134d8ba-3422-4f1f-8a3e-b37b3d73f501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:36.434350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134d8ba-3422-4f1f-8a3e-b37b3d73f501 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:36.434629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134d8ba-3422-4f1f-8a3e-b37b3d73f501 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:36.434904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134d8ba-3422-4f1f-8a3e-b37b3d73f501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:36.447901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134d8ba-3422-4f1f-8a3e-b37b3d73f501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:36.449483 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134d8ba-3422-4f1f-8a3e-b37b3d73f501 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-4134d8ba-3422-4f1f-8a3e-b37b3d73f501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:02:36.466509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:36.467715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:02:36.468949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:02:36.468949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:36.468949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:36.468949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 611/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:36.474084 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de2590-d4ea-422a-a102-981e13165b85 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:36.619306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de2590-d4ea-422a-a102-981e13165b85 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:36.655275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:36.663160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf3018-dda8-44c6-8adf-062093a7a8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:36.663927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf3018-dda8-44c6-8adf-062093a7a8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:36.664215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf3018-dda8-44c6-8adf-062093a7a8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:36.664526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf3018-dda8-44c6-8adf-062093a7a8a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:36.665463 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf3018-dda8-44c6-8adf-062093a7a8a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:36.665940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf3018-dda8-44c6-8adf-062093a7a8a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:36.667527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf3018-dda8-44c6-8adf-062093a7a8a0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:36.684857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 593/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:02:36.686342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134d8ba-3422-4f1f-8a3e-b37b3d73f501 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:36.776903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:36.833836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134d8ba-3422-4f1f-8a3e-b37b3d73f501 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:36.875727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ebbf0-6f8d-4c1d-b458-3eea51831171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:36.876396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ebbf0-6f8d-4c1d-b458-3eea51831171 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:36.876519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ebbf0-6f8d-4c1d-b458-3eea51831171 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:36.876795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ebbf0-6f8d-4c1d-b458-3eea51831171 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:36.877431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ebbf0-6f8d-4c1d-b458-3eea51831171 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:36.878964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ebbf0-6f8d-4c1d-b458-3eea51831171 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:36.904661 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 612/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 6 01:02:36 2022] POST /identity/v3/users => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:02:39.252464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80ec86-059e-4698-a0c1-c427ad1ea577 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:39.253071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80ec86-059e-4698-a0c1-c427ad1ea577 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:39.253365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80ec86-059e-4698-a0c1-c427ad1ea577 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:39.255684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 594/1206] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:02:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:02:39.262755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e76240-739c-490a-a6c3-f35604d99e10 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:39.263313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e76240-739c-490a-a6c3-f35604d99e10 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:39.263313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e76240-739c-490a-a6c3-f35604d99e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:39.289053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-90e76240-739c-490a-a6c3-f35604d99e10 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:02:39.290526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-90e76240-739c-490a-a6c3-f35604d99e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:02:39.383888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 613/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:02:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:02:39.699674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80ec86-059e-4698-a0c1-c427ad1ea577 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:39.845499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80ec86-059e-4698-a0c1-c427ad1ea577 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:39.895977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb302-d045-44a2-b52d-986682b88400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:39.896792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb302-d045-44a2-b52d-986682b88400 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:39.897066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb302-d045-44a2-b52d-986682b88400 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:39.897350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb302-d045-44a2-b52d-986682b88400 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:39.910310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fb302-d045-44a2-b52d-986682b88400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-4d5fb302-d045-44a2-b52d-986682b88400 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:02:39.916014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:39.917093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:02:39.917967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 595/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 01:02:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:39.924518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e76240-739c-490a-a6c3-f35604d99e10 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:39.979876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:40.048784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e76240-739c-490a-a6c3-f35604d99e10 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:40.089149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e9677-f4b4-4e30-8bdb-a598919c03c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:40.091369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e9677-f4b4-4e30-8bdb-a598919c03c3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:40.091369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e9677-f4b4-4e30-8bdb-a598919c03c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:40.091369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e9677-f4b4-4e30-8bdb-a598919c03c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:40.091647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e9677-f4b4-4e30-8bdb-a598919c03c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:40.091905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e9677-f4b4-4e30-8bdb-a598919c03c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:40.093718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e9677-f4b4-4e30-8bdb-a598919c03c3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:40.109917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 614/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 01:02:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:40.111199 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb302-d045-44a2-b52d-986682b88400 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:40.179745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:40.242919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb302-d045-44a2-b52d-986682b88400 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:40.284887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d174d5-380d-41b3-9fdf-6fefd23b8be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:40.285890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d174d5-380d-41b3-9fdf-6fefd23b8be8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:40.286279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d174d5-380d-41b3-9fdf-6fefd23b8be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:40.286559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d174d5-380d-41b3-9fdf-6fefd23b8be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:40.299220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d174d5-380d-41b3-9fdf-6fefd23b8be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:40.300779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d174d5-380d-41b3-9fdf-6fefd23b8be8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e1d174d5-380d-41b3-9fdf-6fefd23b8be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:02:40.320943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:40.322025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:02:40.323496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:02:40.323496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:40.323496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:02:40.323496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 596/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:40.328840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e9677-f4b4-4e30-8bdb-a598919c03c3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:40.440081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:40.442965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e9677-f4b4-4e30-8bdb-a598919c03c3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:40.485417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e4633-fc0e-4fd5-8467-fb8801db12fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:40.486789 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e4633-fc0e-4fd5-8467-fb8801db12fd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:40.486789 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e4633-fc0e-4fd5-8467-fb8801db12fd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:40.486789 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e4633-fc0e-4fd5-8467-fb8801db12fd None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:40.487394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e4633-fc0e-4fd5-8467-fb8801db12fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:40.487701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e4633-fc0e-4fd5-8467-fb8801db12fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:40.489339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e4633-fc0e-4fd5-8467-fb8801db12fd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:40.507997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 615/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:02:40.509311 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d174d5-380d-41b3-9fdf-6fefd23b8be8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:40.620513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d174d5-380d-41b3-9fdf-6fefd23b8be8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:40.622822 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:40.662801 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6539d5-a4a4-49c6-bd42-f2210a3ab3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:40.663647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6539d5-a4a4-49c6-bd42-f2210a3ab3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:40.664323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6539d5-a4a4-49c6-bd42-f2210a3ab3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:40.664909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6539d5-a4a4-49c6-bd42-f2210a3ab3a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:40.675471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6539d5-a4a4-49c6-bd42-f2210a3ab3a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:40.677274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6539d5-a4a4-49c6-bd42-f2210a3ab3a4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-ac6539d5-a4a4-49c6-bd42-f2210a3ab3a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:02:40.691000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:40.693825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:40.695388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:40.695388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:40.695388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:02:40.695388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:02:40.695388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:02:40.695388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:02:40.695388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:02:40.695388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:02:40.695388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 01:02:40.695388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:02:40.695388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 597/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:40.698782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e4633-fc0e-4fd5-8467-fb8801db12fd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:40.816357 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e4633-fc0e-4fd5-8467-fb8801db12fd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:40.857015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee5f38-4526-43ba-94d9-3d7cb930e6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:40.857602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee5f38-4526-43ba-94d9-3d7cb930e6eb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:40.857876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee5f38-4526-43ba-94d9-3d7cb930e6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:40.858596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee5f38-4526-43ba-94d9-3d7cb930e6eb None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:40.858851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee5f38-4526-43ba-94d9-3d7cb930e6eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:40.859150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee5f38-4526-43ba-94d9-3d7cb930e6eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:40.860743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee5f38-4526-43ba-94d9-3d7cb930e6eb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:40.884807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 616/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Sep 6 01:02:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:40.890998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6539d5-a4a4-49c6-bd42-f2210a3ab3a4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:41.017432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6539d5-a4a4-49c6-bd42-f2210a3ab3a4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:41.059930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3153d-cbf0-4373-bfff-cc54bd07b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:41.060579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3153d-cbf0-4373-bfff-cc54bd07b3ff None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:41.063260 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3153d-cbf0-4373-bfff-cc54bd07b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:41.063608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3153d-cbf0-4373-bfff-cc54bd07b3ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:41.102451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:41.152930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3153d-cbf0-4373-bfff-cc54bd07b3ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:41.154994 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3153d-cbf0-4373-bfff-cc54bd07b3ff None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:41.275635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 598/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:02:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:02:41.276128 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee5f38-4526-43ba-94d9-3d7cb930e6eb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:41.297200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:41.395122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee5f38-4526-43ba-94d9-3d7cb930e6eb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:41.435136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678b250-147f-4b85-9c6e-33101bebf772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:41.435919 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678b250-147f-4b85-9c6e-33101bebf772 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:41.436198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678b250-147f-4b85-9c6e-33101bebf772 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:41.437670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678b250-147f-4b85-9c6e-33101bebf772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:41.448313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678b250-147f-4b85-9c6e-33101bebf772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:41.450267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678b250-147f-4b85-9c6e-33101bebf772 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3678b250-147f-4b85-9c6e-33101bebf772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:02:41.467291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:41.468390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:02:41.469330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:02:41.469330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:41.469330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:41.469330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 617/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:41.474621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3153d-cbf0-4373-bfff-cc54bd07b3ff None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:41.543866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:41.588745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3153d-cbf0-4373-bfff-cc54bd07b3ff None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:41.628502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2352c4-d25d-4f1a-a2ed-87360bbb87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:41.629144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2352c4-d25d-4f1a-a2ed-87360bbb87e2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:41.629414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2352c4-d25d-4f1a-a2ed-87360bbb87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:41.629678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2352c4-d25d-4f1a-a2ed-87360bbb87e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:41.630314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2352c4-d25d-4f1a-a2ed-87360bbb87e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:41.630612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2352c4-d25d-4f1a-a2ed-87360bbb87e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:41.632146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2352c4-d25d-4f1a-a2ed-87360bbb87e2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:41.645415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 599/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:02:41.651717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678b250-147f-4b85-9c6e-33101bebf772 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:41.731387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:41.768728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678b250-147f-4b85-9c6e-33101bebf772 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:41.808985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850a4ce-1491-4336-84af-7477931822a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:41.809654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850a4ce-1491-4336-84af-7477931822a9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:41.809969 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850a4ce-1491-4336-84af-7477931822a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:41.810263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850a4ce-1491-4336-84af-7477931822a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:41.817427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850a4ce-1491-4336-84af-7477931822a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:41.818916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850a4ce-1491-4336-84af-7477931822a9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-a850a4ce-1491-4336-84af-7477931822a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:02:41.830113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:41.831096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:41.832064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:02:41.832064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:02:41.832064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:02:41.832064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:02:41.832064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:02:41.832064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:02:41.832064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:02:41.832064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:41.832064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 618/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:02:41.837376 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2352c4-d25d-4f1a-a2ed-87360bbb87e2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:41.945985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2352c4-d25d-4f1a-a2ed-87360bbb87e2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:41.975330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:41.993356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e8a1b-a9d9-40e6-be54-48b734eec1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:41.994129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e8a1b-a9d9-40e6-be54-48b734eec1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:41.994429 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e8a1b-a9d9-40e6-be54-48b734eec1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:41.994699 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e8a1b-a9d9-40e6-be54-48b734eec1b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:41.995462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e8a1b-a9d9-40e6-be54-48b734eec1b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:41.995802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e8a1b-a9d9-40e6-be54-48b734eec1b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:41.997420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e8a1b-a9d9-40e6-be54-48b734eec1b0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:42.013211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 600/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:02:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:02:42.019577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850a4ce-1491-4336-84af-7477931822a9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:42.142917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850a4ce-1491-4336-84af-7477931822a9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:42.181533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:42.192336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bdd4f-9dea-486e-8e67-6fda13aafbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:42.192966 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bdd4f-9dea-486e-8e67-6fda13aafbea None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:42.193247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bdd4f-9dea-486e-8e67-6fda13aafbea None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:42.193529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bdd4f-9dea-486e-8e67-6fda13aafbea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:42.194270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bdd4f-9dea-486e-8e67-6fda13aafbea None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=1823402195ab4e89aa865967afc62b9b) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:42.194580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bdd4f-9dea-486e-8e67-6fda13aafbea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:42.196195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bdd4f-9dea-486e-8e67-6fda13aafbea None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:42.202172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 619/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:02:42 2022] GET /identity/v3/role_assignments?user.id=1823402195ab4e89aa865967afc62b9b&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:44.196940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5f672-b53a-4556-ad6d-1e322c751583 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:44.197739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5f672-b53a-4556-ad6d-1e322c751583 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:44.197739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5f672-b53a-4556-ad6d-1e322c751583 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:44.199422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 601/1220] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:02:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:02:44.205222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dc286-e0c4-4d51-9aa6-457d82f327b0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:44.205732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dc286-e0c4-4d51-9aa6-457d82f327b0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:44.205732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dc286-e0c4-4d51-9aa6-457d82f327b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:44.226470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b02dc286-e0c4-4d51-9aa6-457d82f327b0 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:02:44.227672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b02dc286-e0c4-4d51-9aa6-457d82f327b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:02:44.304738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 620/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:02:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:02:44.578421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5f672-b53a-4556-ad6d-1e322c751583 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:44.701189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5f672-b53a-4556-ad6d-1e322c751583 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:44.739363 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df09567-d584-4629-b2b1-d9d67f80c9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:44.739999 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df09567-d584-4629-b2b1-d9d67f80c9bd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:44.740378 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df09567-d584-4629-b2b1-d9d67f80c9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:44.740581 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df09567-d584-4629-b2b1-d9d67f80c9bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:44.752354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df09567-d584-4629-b2b1-d9d67f80c9bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-2df09567-d584-4629-b2b1-d9d67f80c9bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:02:44.757213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:44.758631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:02:44.759639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 602/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 01:02:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:44.765317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dc286-e0c4-4d51-9aa6-457d82f327b0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:44.874730 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dc286-e0c4-4d51-9aa6-457d82f327b0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:44.901149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:44.914915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46959329-29db-47cb-a643-df87132a3ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:44.915452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959329-29db-47cb-a643-df87132a3ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:44.915725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959329-29db-47cb-a643-df87132a3ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:44.915989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959329-29db-47cb-a643-df87132a3ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:44.916685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46959329-29db-47cb-a643-df87132a3ea4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:44.916988 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46959329-29db-47cb-a643-df87132a3ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:44.918443 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46959329-29db-47cb-a643-df87132a3ea4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:44.927152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 621/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 01:02:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:44.933083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df09567-d584-4629-b2b1-d9d67f80c9bd None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:44.981428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:45.044487 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df09567-d584-4629-b2b1-d9d67f80c9bd None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:45.080791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df0298-f877-4654-9ffe-8e7f6ba1d813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:45.082017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0298-f877-4654-9ffe-8e7f6ba1d813 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:45.082408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0298-f877-4654-9ffe-8e7f6ba1d813 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:45.082787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0298-f877-4654-9ffe-8e7f6ba1d813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:45.094534 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df0298-f877-4654-9ffe-8e7f6ba1d813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:45.096090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df0298-f877-4654-9ffe-8e7f6ba1d813 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e7df0298-f877-4654-9ffe-8e7f6ba1d813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:02:45.110772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:45.111924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:02:45.117985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:02:45.117985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:45.117985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:02:45.117985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 603/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:45.118249 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46959329-29db-47cb-a643-df87132a3ea4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:45.227608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46959329-29db-47cb-a643-df87132a3ea4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:45.277753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a53c2-40e3-4890-ba30-3ba0ad9829e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:45.278471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a53c2-40e3-4890-ba30-3ba0ad9829e7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:45.278738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a53c2-40e3-4890-ba30-3ba0ad9829e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:45.279327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a53c2-40e3-4890-ba30-3ba0ad9829e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:45.279968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a53c2-40e3-4890-ba30-3ba0ad9829e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:45.280259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a53c2-40e3-4890-ba30-3ba0ad9829e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:45.281711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a53c2-40e3-4890-ba30-3ba0ad9829e7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:45.295328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 622/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:45.301191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df0298-f877-4654-9ffe-8e7f6ba1d813 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:45.406939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:45.415229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df0298-f877-4654-9ffe-8e7f6ba1d813 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:45.454224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f3e54-d47d-4e74-a43a-090d02ac48f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:45.454986 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f3e54-d47d-4e74-a43a-090d02ac48f4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:45.455340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f3e54-d47d-4e74-a43a-090d02ac48f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:45.455662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f3e54-d47d-4e74-a43a-090d02ac48f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:45.463922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f3e54-d47d-4e74-a43a-090d02ac48f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:45.465537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f3e54-d47d-4e74-a43a-090d02ac48f4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-516f3e54-d47d-4e74-a43a-090d02ac48f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:02:45.478122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:45.479366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:45.480779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:45.480779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:45.480779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:02:45.480779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:02:45.480779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:02:45.480779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:02:45.480779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:02:45.480779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:02:45.480779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 01:02:45.480779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:02:45.480779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 604/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:45.486917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a53c2-40e3-4890-ba30-3ba0ad9829e7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:45.543819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:45.601720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a53c2-40e3-4890-ba30-3ba0ad9829e7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:45.636140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f291d76-3c98-4260-a813-900f9fa85028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:45.636704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f291d76-3c98-4260-a813-900f9fa85028 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:45.637039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f291d76-3c98-4260-a813-900f9fa85028 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:45.637302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f291d76-3c98-4260-a813-900f9fa85028 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:45.638120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f291d76-3c98-4260-a813-900f9fa85028 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:45.638429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f291d76-3c98-4260-a813-900f9fa85028 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:45.640127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f291d76-3c98-4260-a813-900f9fa85028 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:45.659019 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 623/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Sep 6 01:02:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:02:45.665611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f3e54-d47d-4e74-a43a-090d02ac48f4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:45.773556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f3e54-d47d-4e74-a43a-090d02ac48f4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:45.810168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cea93d-6690-4ea1-a29c-8c11655aa140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:45.810799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cea93d-6690-4ea1-a29c-8c11655aa140 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:45.811071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cea93d-6690-4ea1-a29c-8c11655aa140 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:45.811337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cea93d-6690-4ea1-a29c-8c11655aa140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:45.823542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cea93d-6690-4ea1-a29c-8c11655aa140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:45.825095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cea93d-6690-4ea1-a29c-8c11655aa140 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-68cea93d-6690-4ea1-a29c-8c11655aa140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:02:45.839619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:45.845602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:02:45.846944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:02:45.846944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:45.846944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:02:45.846944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 605/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:45.847237 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f291d76-3c98-4260-a813-900f9fa85028 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:45.974626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f291d76-3c98-4260-a813-900f9fa85028 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:45.977128 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:46.010243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6522bf8-5b3b-4bfe-8b08-f1418eadcad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:46.010981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6522bf8-5b3b-4bfe-8b08-f1418eadcad0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:46.011269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6522bf8-5b3b-4bfe-8b08-f1418eadcad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:46.011572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6522bf8-5b3b-4bfe-8b08-f1418eadcad0 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:46.012243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6522bf8-5b3b-4bfe-8b08-f1418eadcad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:46.012580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6522bf8-5b3b-4bfe-8b08-f1418eadcad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:46.014068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6522bf8-5b3b-4bfe-8b08-f1418eadcad0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:46.026552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 624/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:46.032725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cea93d-6690-4ea1-a29c-8c11655aa140 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:46.044069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:46.144659 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cea93d-6690-4ea1-a29c-8c11655aa140 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:46.184157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f48b3-c17e-4e48-9de5-3388795d6407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:46.184864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f48b3-c17e-4e48-9de5-3388795d6407 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:46.185183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f48b3-c17e-4e48-9de5-3388795d6407 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:46.185468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f48b3-c17e-4e48-9de5-3388795d6407 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:46.194373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f48b3-c17e-4e48-9de5-3388795d6407 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:46.196159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f48b3-c17e-4e48-9de5-3388795d6407 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e27f48b3-c17e-4e48-9de5-3388795d6407 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:02:46.210440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:46.211550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:46.212690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:02:46.212690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:02:46.212690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:02:46.212690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:02:46.212690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:02:46.212690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:02:46.212690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:02:46.212690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:02:46.212690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 606/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:46.218703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6522bf8-5b3b-4bfe-8b08-f1418eadcad0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:46.332535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6522bf8-5b3b-4bfe-8b08-f1418eadcad0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:46.370387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc850fe7-baf5-462b-86f9-6ba780d2b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:46.371051 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc850fe7-baf5-462b-86f9-6ba780d2b223 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:46.371330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc850fe7-baf5-462b-86f9-6ba780d2b223 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:46.371603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc850fe7-baf5-462b-86f9-6ba780d2b223 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:46.372361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc850fe7-baf5-462b-86f9-6ba780d2b223 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:46.372629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc850fe7-baf5-462b-86f9-6ba780d2b223 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:46.374122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc850fe7-baf5-462b-86f9-6ba780d2b223 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:46.387120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 625/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:46.394119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f48b3-c17e-4e48-9de5-3388795d6407 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:46.468275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:46.510246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f48b3-c17e-4e48-9de5-3388795d6407 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:46.545224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eb26d-a915-4ff2-9c13-f303299569d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:46.545906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb26d-a915-4ff2-9c13-f303299569d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:46.546179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb26d-a915-4ff2-9c13-f303299569d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:46.546438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb26d-a915-4ff2-9c13-f303299569d2 None admin] PATH_INFO: `/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/1823402195ab4e89aa865967afc62b9b/roles/200ce779351e41d0b4f43970f4008cd0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:46.561520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eb26d-a915-4ff2-9c13-f303299569d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d31b0823b61d4895accd0f27e6006b08, user_id=1823402195ab4e89aa865967afc62b9b, role_id=200ce779351e41d0b4f43970f4008cd0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:46.562987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eb26d-a915-4ff2-9c13-f303299569d2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:46.576623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 607/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 01:02:46 2022] PUT /identity/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/1823402195ab4e89aa865967afc62b9b/roles/200ce779351e41d0b4f43970f4008cd0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:02:48.657652 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e0df4-68f2-48d6-9aa1-fe84ab768123 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:48.658239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e0df4-68f2-48d6-9aa1-fe84ab768123 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:48.658239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e0df4-68f2-48d6-9aa1-fe84ab768123 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:48.659635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 626/1233] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:02:48.665496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec60cb-6293-4b3e-858e-b6ded8a38439 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:48.665949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec60cb-6293-4b3e-858e-b6ded8a38439 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:48.666067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec60cb-6293-4b3e-858e-b6ded8a38439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:48.686161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-49ec60cb-6293-4b3e-858e-b6ded8a38439 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:02:48.687491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-49ec60cb-6293-4b3e-858e-b6ded8a38439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:02:48.760348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 608/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:02:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:02:49.025653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e0df4-68f2-48d6-9aa1-fe84ab768123 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:49.054792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:49.133654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e0df4-68f2-48d6-9aa1-fe84ab768123 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:49.167583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fafe-d221-47cd-864f-a97822f218d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:49.168213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fafe-d221-47cd-864f-a97822f218d5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:49.168509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fafe-d221-47cd-864f-a97822f218d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:49.168774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fafe-d221-47cd-864f-a97822f218d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:49.179063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fafe-d221-47cd-864f-a97822f218d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5b07fafe-d221-47cd-864f-a97822f218d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:02:49.184010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:49.185054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:49.186370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 627/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 6 01:02:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:49.191556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec60cb-6293-4b3e-858e-b6ded8a38439 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:49.241392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:49.299509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec60cb-6293-4b3e-858e-b6ded8a38439 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:49.337498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161aab1-78a8-4a9a-88c6-1c7988d8b923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:49.338107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161aab1-78a8-4a9a-88c6-1c7988d8b923 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:49.338383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161aab1-78a8-4a9a-88c6-1c7988d8b923 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:49.338650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161aab1-78a8-4a9a-88c6-1c7988d8b923 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:49.339310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161aab1-78a8-4a9a-88c6-1c7988d8b923 None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:49.339612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161aab1-78a8-4a9a-88c6-1c7988d8b923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:49.341052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161aab1-78a8-4a9a-88c6-1c7988d8b923 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:49.349780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 609/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 6 01:02:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:49.357086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fafe-d221-47cd-864f-a97822f218d5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:49.448773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:49.468606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fafe-d221-47cd-864f-a97822f218d5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:49.516946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efd6e7-b02f-427c-a566-8df4b197392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:49.517571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efd6e7-b02f-427c-a566-8df4b197392f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:49.517891 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efd6e7-b02f-427c-a566-8df4b197392f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:49.518287 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efd6e7-b02f-427c-a566-8df4b197392f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:49.529697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efd6e7-b02f-427c-a566-8df4b197392f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:49.531218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efd6e7-b02f-427c-a566-8df4b197392f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-94efd6e7-b02f-427c-a566-8df4b197392f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:02:49.545691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:49.546799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:02:49.547773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:02:49.547773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:49.547773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:49.547773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 628/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:49.553074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161aab1-78a8-4a9a-88c6-1c7988d8b923 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:49.663533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161aab1-78a8-4a9a-88c6-1c7988d8b923 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:49.674382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:49.700897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed5077-90d3-4cca-bdea-ef085ffa3782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:49.701534 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed5077-90d3-4cca-bdea-ef085ffa3782 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:49.701794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed5077-90d3-4cca-bdea-ef085ffa3782 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:49.702066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed5077-90d3-4cca-bdea-ef085ffa3782 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:49.702802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed5077-90d3-4cca-bdea-ef085ffa3782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:49.703205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed5077-90d3-4cca-bdea-ef085ffa3782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:49.704892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed5077-90d3-4cca-bdea-ef085ffa3782 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:49.723055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 610/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:49.724364 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efd6e7-b02f-427c-a566-8df4b197392f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:49.836718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efd6e7-b02f-427c-a566-8df4b197392f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:49.875833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7f928-af44-46ed-b6e7-b0f2c674e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:49.876495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7f928-af44-46ed-b6e7-b0f2c674e40a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:49.876841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7f928-af44-46ed-b6e7-b0f2c674e40a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:49.877028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7f928-af44-46ed-b6e7-b0f2c674e40a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:49.879959 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:49.885559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7f928-af44-46ed-b6e7-b0f2c674e40a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:49.887325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7f928-af44-46ed-b6e7-b0f2c674e40a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9fc7f928-af44-46ed-b6e7-b0f2c674e40a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:02:49.899379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:49.900705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:49.902090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:49.902090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:49.902090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:02:49.902090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:02:49.902090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:02:49.902090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:02:49.902090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:02:49.902090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:02:49.902090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 01:02:49.902090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:49.902090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 629/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:49.907058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed5077-90d3-4cca-bdea-ef085ffa3782 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:50.023591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed5077-90d3-4cca-bdea-ef085ffa3782 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:50.061814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc4d6d-2108-4ead-af07-a57c9c098cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:50.062427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc4d6d-2108-4ead-af07-a57c9c098cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:50.062699 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc4d6d-2108-4ead-af07-a57c9c098cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:50.062968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc4d6d-2108-4ead-af07-a57c9c098cb8 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:50.063789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc4d6d-2108-4ead-af07-a57c9c098cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:50.063995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc4d6d-2108-4ead-af07-a57c9c098cb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:50.065565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc4d6d-2108-4ead-af07-a57c9c098cb8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:50.085846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 611/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Sep 6 01:02:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:50.091882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7f928-af44-46ed-b6e7-b0f2c674e40a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:50.201207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7f928-af44-46ed-b6e7-b0f2c674e40a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:50.235767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20bd0a-158f-4ac5-80e8-be4a2198aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:50.236411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20bd0a-158f-4ac5-80e8-be4a2198aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:50.236681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20bd0a-158f-4ac5-80e8-be4a2198aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:50.236943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20bd0a-158f-4ac5-80e8-be4a2198aeb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:50.305551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:50.312601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20bd0a-158f-4ac5-80e8-be4a2198aeb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:50.314451 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20bd0a-158f-4ac5-80e8-be4a2198aeb4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:50.425035 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 630/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:02:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:02:50.426925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc4d6d-2108-4ead-af07-a57c9c098cb8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:50.458570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:50.544944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc4d6d-2108-4ead-af07-a57c9c098cb8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:50.580815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08b412-8253-4379-9bba-417458111dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:50.581735 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08b412-8253-4379-9bba-417458111dfa None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:50.582008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08b412-8253-4379-9bba-417458111dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:50.582257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08b412-8253-4379-9bba-417458111dfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:50.593479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08b412-8253-4379-9bba-417458111dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:50.594966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08b412-8253-4379-9bba-417458111dfa None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-9e08b412-8253-4379-9bba-417458111dfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:02:50.609673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:50.610803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:02:50.611773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:02:50.611773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:50.611773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:02:50.611773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 612/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 01:02:50.617518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20bd0a-158f-4ac5-80e8-be4a2198aeb4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:50.719731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:50.726806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20bd0a-158f-4ac5-80e8-be4a2198aeb4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:50.764374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dceca-3893-4842-87d8-a5c763a06379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:50.765113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dceca-3893-4842-87d8-a5c763a06379 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:50.765421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dceca-3893-4842-87d8-a5c763a06379 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:50.765700 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dceca-3893-4842-87d8-a5c763a06379 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:50.766422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dceca-3893-4842-87d8-a5c763a06379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:50.766776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dceca-3893-4842-87d8-a5c763a06379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:50.768348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dceca-3893-4842-87d8-a5c763a06379 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:50.781799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 631/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:02:50.787844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08b412-8253-4379-9bba-417458111dfa None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:50.871994 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:50.896078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08b412-8253-4379-9bba-417458111dfa None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:50.934432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08875c-1792-4e24-a0cc-5ef934faa72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:50.935980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08875c-1792-4e24-a0cc-5ef934faa72a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:50.935980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08875c-1792-4e24-a0cc-5ef934faa72a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:50.935980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08875c-1792-4e24-a0cc-5ef934faa72a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:50.942836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08875c-1792-4e24-a0cc-5ef934faa72a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:50.944496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08875c-1792-4e24-a0cc-5ef934faa72a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-9d08875c-1792-4e24-a0cc-5ef934faa72a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:02:50.959553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:50.960762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:50.961885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:02:50.961885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:02:50.961885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:02:50.961885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:02:50.961885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:02:50.961885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:02:50.961885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:02:50.961885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:02:50.961885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 613/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:50.967291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dceca-3893-4842-87d8-a5c763a06379 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:51.069080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dceca-3893-4842-87d8-a5c763a06379 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:51.103177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527aa42c-0000-4761-b221-6fdd3241ffa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:51.103781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aa42c-0000-4761-b221-6fdd3241ffa4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:51.104054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aa42c-0000-4761-b221-6fdd3241ffa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:51.104344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aa42c-0000-4761-b221-6fdd3241ffa4 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:51.105033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aa42c-0000-4761-b221-6fdd3241ffa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:51.105334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aa42c-0000-4761-b221-6fdd3241ffa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:51.106853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aa42c-0000-4761-b221-6fdd3241ffa4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:51.119176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 632/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:51.127015 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08875c-1792-4e24-a0cc-5ef934faa72a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:51.239738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08875c-1792-4e24-a0cc-5ef934faa72a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:51.281492 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635e264-fe27-48fe-ae7d-c74f20482c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:51.282135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635e264-fe27-48fe-ae7d-c74f20482c21 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:51.282669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635e264-fe27-48fe-ae7d-c74f20482c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:51.283127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635e264-fe27-48fe-ae7d-c74f20482c21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:51.284115 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635e264-fe27-48fe-ae7d-c74f20482c21 None admin] RBAC: Adding query filter params (role.id=200ce779351e41d0b4f43970f4008cd0, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=1823402195ab4e89aa865967afc62b9b) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:51.284479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635e264-fe27-48fe-ae7d-c74f20482c21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:51.286294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635e264-fe27-48fe-ae7d-c74f20482c21 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:51.296022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 614/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:02:51 2022] GET /identity/v3/role_assignments?user.id=1823402195ab4e89aa865967afc62b9b&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=200ce779351e41d0b4f43970f4008cd0 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:02:53.411056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846cc74-83f0-429a-b828-61f909c9efde None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:53.411761 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846cc74-83f0-429a-b828-61f909c9efde None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:53.411761 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846cc74-83f0-429a-b828-61f909c9efde None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:53.413394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 633/1247] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:02:53.419683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ca90-4823-4061-b714-ee9997d2768a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:53.420154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ca90-4823-4061-b714-ee9997d2768a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:53.420249 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ca90-4823-4061-b714-ee9997d2768a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:53.427129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:53.440317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7ba9ca90-4823-4061-b714-ee9997d2768a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:02:53.441580 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7ba9ca90-4823-4061-b714-ee9997d2768a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:02:53.527130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 615/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:02:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:02:53.794030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846cc74-83f0-429a-b828-61f909c9efde None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:53.813533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:53.917159 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846cc74-83f0-429a-b828-61f909c9efde None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:53.956088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb20265-083c-486d-8826-e2dd63d1ee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:53.956829 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb20265-083c-486d-8826-e2dd63d1ee43 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:53.957140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb20265-083c-486d-8826-e2dd63d1ee43 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:53.957429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb20265-083c-486d-8826-e2dd63d1ee43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:53.968651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb20265-083c-486d-8826-e2dd63d1ee43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5fb20265-083c-486d-8826-e2dd63d1ee43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:02:53.974098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:53.975323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:53.976429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 634/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:53.981688 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9ca90-4823-4061-b714-ee9997d2768a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:54.091265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9ca90-4823-4061-b714-ee9997d2768a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:54.120933 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:54.126827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a4383-d66f-4774-a17b-0a957a40f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:54.127443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a4383-d66f-4774-a17b-0a957a40f952 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:54.127717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a4383-d66f-4774-a17b-0a957a40f952 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:54.127984 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a4383-d66f-4774-a17b-0a957a40f952 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:54.128682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a4383-d66f-4774-a17b-0a957a40f952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:54.128979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a4383-d66f-4774-a17b-0a957a40f952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:54.130384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a4383-d66f-4774-a17b-0a957a40f952 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:54.139675 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 616/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:54.145585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb20265-083c-486d-8826-e2dd63d1ee43 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:54.233408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:54.256985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb20265-083c-486d-8826-e2dd63d1ee43 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:54.294232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc6d34-6fe6-47a3-85a1-12e13414036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:54.294868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6d34-6fe6-47a3-85a1-12e13414036c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:54.295147 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6d34-6fe6-47a3-85a1-12e13414036c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:54.295418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6d34-6fe6-47a3-85a1-12e13414036c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:54.306312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc6d34-6fe6-47a3-85a1-12e13414036c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:54.307827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc6d34-6fe6-47a3-85a1-12e13414036c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-bbfc6d34-6fe6-47a3-85a1-12e13414036c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:02:54.322709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:54.323871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:02:54.324968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:02:54.324968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:54.324968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:54.324968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 635/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:54.332128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a4383-d66f-4774-a17b-0a957a40f952 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:54.445264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a4383-d66f-4774-a17b-0a957a40f952 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:54.487802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02954f96-9f91-4c80-844a-da84e85d788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:54.488464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02954f96-9f91-4c80-844a-da84e85d788d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:54.488729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02954f96-9f91-4c80-844a-da84e85d788d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:54.489001 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02954f96-9f91-4c80-844a-da84e85d788d None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:54.489650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02954f96-9f91-4c80-844a-da84e85d788d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:54.489947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02954f96-9f91-4c80-844a-da84e85d788d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:54.492172 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02954f96-9f91-4c80-844a-da84e85d788d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:54.506399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 617/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:54.512725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc6d34-6fe6-47a3-85a1-12e13414036c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:54.621938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc6d34-6fe6-47a3-85a1-12e13414036c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:54.650399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:54.661133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb8c82-6417-458e-9461-5e771a53f888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:54.661839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb8c82-6417-458e-9461-5e771a53f888 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:54.662139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb8c82-6417-458e-9461-5e771a53f888 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:54.662462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb8c82-6417-458e-9461-5e771a53f888 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:54.671049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb8c82-6417-458e-9461-5e771a53f888 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:54.672824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb8c82-6417-458e-9461-5e771a53f888 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ddfb8c82-6417-458e-9461-5e771a53f888 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:02:54.685640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:54.686733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:54.687860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:54.687860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:54.687860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:02:54.687860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:02:54.687860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:02:54.687860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:02:54.687860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:02:54.687860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:02:54.687860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 01:02:54.687860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:54.687860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 636/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:54.693427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02954f96-9f91-4c80-844a-da84e85d788d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:54.762600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:54.818840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02954f96-9f91-4c80-844a-da84e85d788d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:54.858939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea61f7-7185-43e8-900d-728964e7ebc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:54.859563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea61f7-7185-43e8-900d-728964e7ebc8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:54.859891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea61f7-7185-43e8-900d-728964e7ebc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:54.860161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea61f7-7185-43e8-900d-728964e7ebc8 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:54.861093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea61f7-7185-43e8-900d-728964e7ebc8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:54.861560 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea61f7-7185-43e8-900d-728964e7ebc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:54.863251 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea61f7-7185-43e8-900d-728964e7ebc8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:54.884615 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 618/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Sep 6 01:02:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:54.890270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb8c82-6417-458e-9461-5e771a53f888 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:55.014435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb8c82-6417-458e-9461-5e771a53f888 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:55.051806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3af8f-3aea-4e8e-b821-4c1437c701f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:55.052541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3af8f-3aea-4e8e-b821-4c1437c701f5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:55.052819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3af8f-3aea-4e8e-b821-4c1437c701f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:55.053107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3af8f-3aea-4e8e-b821-4c1437c701f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:55.113961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:55.129004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3af8f-3aea-4e8e-b821-4c1437c701f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:55.130791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3af8f-3aea-4e8e-b821-4c1437c701f5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:55.244400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 637/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:02:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:02:55.250438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea61f7-7185-43e8-900d-728964e7ebc8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:55.367881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea61f7-7185-43e8-900d-728964e7ebc8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:55.381664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:55.407258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcc791-f87a-45ac-9a46-8b0bbcc1a748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:55.408003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc791-f87a-45ac-9a46-8b0bbcc1a748 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:55.408282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc791-f87a-45ac-9a46-8b0bbcc1a748 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:55.408579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc791-f87a-45ac-9a46-8b0bbcc1a748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:55.420231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcc791-f87a-45ac-9a46-8b0bbcc1a748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:55.421808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcc791-f87a-45ac-9a46-8b0bbcc1a748 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-47fcc791-f87a-45ac-9a46-8b0bbcc1a748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:02:55.439164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:55.440396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:02:55.441462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:02:55.441462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:55.441462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:02:55.441462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 619/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:55.446946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3af8f-3aea-4e8e-b821-4c1437c701f5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:55.547243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:55.563545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3af8f-3aea-4e8e-b821-4c1437c701f5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:55.607310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc558e5-bbaf-47d6-8e79-4db2bfdc01bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:55.607954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc558e5-bbaf-47d6-8e79-4db2bfdc01bb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:55.608233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc558e5-bbaf-47d6-8e79-4db2bfdc01bb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:55.608538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc558e5-bbaf-47d6-8e79-4db2bfdc01bb None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:55.609381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc558e5-bbaf-47d6-8e79-4db2bfdc01bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:55.609719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc558e5-bbaf-47d6-8e79-4db2bfdc01bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:55.611322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc558e5-bbaf-47d6-8e79-4db2bfdc01bb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:55.624229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 638/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:55.630142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcc791-f87a-45ac-9a46-8b0bbcc1a748 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:55.744925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcc791-f87a-45ac-9a46-8b0bbcc1a748 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:55.782401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647334b-856d-4d85-ba3d-511dacae8c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:55.783048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647334b-856d-4d85-ba3d-511dacae8c3e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:55.783329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647334b-856d-4d85-ba3d-511dacae8c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:55.783598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647334b-856d-4d85-ba3d-511dacae8c3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:55.790879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647334b-856d-4d85-ba3d-511dacae8c3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:55.792467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647334b-856d-4d85-ba3d-511dacae8c3e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-8647334b-856d-4d85-ba3d-511dacae8c3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:02:55.805498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:55.806684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:55.807966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:02:55.807966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:02:55.807966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:02:55.807966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:02:55.807966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:02:55.807966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:02:55.807966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:02:55.807966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:02:55.807966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 620/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:55.813822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc558e5-bbaf-47d6-8e79-4db2bfdc01bb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:55.925093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc558e5-bbaf-47d6-8e79-4db2bfdc01bb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:55.959320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb9fdb-883a-457e-a71f-d4707a7f5982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:55.960201 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9fdb-883a-457e-a71f-d4707a7f5982 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:55.960481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9fdb-883a-457e-a71f-d4707a7f5982 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:55.960753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9fdb-883a-457e-a71f-d4707a7f5982 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:55.961503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb9fdb-883a-457e-a71f-d4707a7f5982 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:55.961804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb9fdb-883a-457e-a71f-d4707a7f5982 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:55.963322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb9fdb-883a-457e-a71f-d4707a7f5982 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:55.977850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 639/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:55.983910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647334b-856d-4d85-ba3d-511dacae8c3e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:56.012506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:56.094708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647334b-856d-4d85-ba3d-511dacae8c3e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:56.134340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc950b3-78f6-4a59-9e12-2aeef6131ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:56.134940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc950b3-78f6-4a59-9e12-2aeef6131ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:56.135267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc950b3-78f6-4a59-9e12-2aeef6131ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:56.135548 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc950b3-78f6-4a59-9e12-2aeef6131ae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:56.136264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc950b3-78f6-4a59-9e12-2aeef6131ae0 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=1823402195ab4e89aa865967afc62b9b) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:56.136588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc950b3-78f6-4a59-9e12-2aeef6131ae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:56.138051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc950b3-78f6-4a59-9e12-2aeef6131ae0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:56.156962 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 621/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:02:55 2022] GET /identity/v3/role_assignments?user.id=1823402195ab4e89aa865967afc62b9b&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:58.060986 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b65ff7-f57c-4ee3-8c8a-c70fe490d8b5 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:58.061613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b65ff7-f57c-4ee3-8c8a-c70fe490d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:58.061613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b65ff7-f57c-4ee3-8c8a-c70fe490d8b5 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:58.062819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 640/1261] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:02:58.068517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f552a9c-555a-4a86-a29d-f10c3dcaa131 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:58.069114 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f552a9c-555a-4a86-a29d-f10c3dcaa131 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:58.069331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f552a9c-555a-4a86-a29d-f10c3dcaa131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:58.089414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7f552a9c-555a-4a86-a29d-f10c3dcaa131 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:02:58.090631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7f552a9c-555a-4a86-a29d-f10c3dcaa131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:02:58.164106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 622/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:02:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:02:58.430530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b65ff7-f57c-4ee3-8c8a-c70fe490d8b5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:58.442973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:58.543343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b65ff7-f57c-4ee3-8c8a-c70fe490d8b5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:58.585556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fba2e-0280-4be7-a430-77b2efd55f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:58.586430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fba2e-0280-4be7-a430-77b2efd55f0e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:58.586749 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fba2e-0280-4be7-a430-77b2efd55f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:58.587133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fba2e-0280-4be7-a430-77b2efd55f0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:58.602503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fba2e-0280-4be7-a430-77b2efd55f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-807fba2e-0280-4be7-a430-77b2efd55f0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:02:58.607263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:58.608313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:58.609330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 641/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:02:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:58.617167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f552a9c-555a-4a86-a29d-f10c3dcaa131 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:58.641146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:58.726305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f552a9c-555a-4a86-a29d-f10c3dcaa131 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:58.762486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506298e-d4cc-4204-bdd2-20763baaa17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:58.763080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506298e-d4cc-4204-bdd2-20763baaa17e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:58.763354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506298e-d4cc-4204-bdd2-20763baaa17e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:58.763619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506298e-d4cc-4204-bdd2-20763baaa17e None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:58.764273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506298e-d4cc-4204-bdd2-20763baaa17e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:58.764606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506298e-d4cc-4204-bdd2-20763baaa17e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:58.766023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506298e-d4cc-4204-bdd2-20763baaa17e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:58.774797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 623/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:02:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:58.784550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fba2e-0280-4be7-a430-77b2efd55f0e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:58.862935 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:58.896707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fba2e-0280-4be7-a430-77b2efd55f0e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:58.932161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859fed-510b-4e95-b666-2591d2cd8e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:58.932798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859fed-510b-4e95-b666-2591d2cd8e09 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:58.933069 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859fed-510b-4e95-b666-2591d2cd8e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:58.933404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859fed-510b-4e95-b666-2591d2cd8e09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:58.943788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3859fed-510b-4e95-b666-2591d2cd8e09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:58.945321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3859fed-510b-4e95-b666-2591d2cd8e09 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c3859fed-510b-4e95-b666-2591d2cd8e09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:02:58.961484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:58.962559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:02:58.963632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:02:58.963632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:58.963632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:58.964492 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 642/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:58.968539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506298e-d4cc-4204-bdd2-20763baaa17e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:59.056911 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:59.076537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506298e-d4cc-4204-bdd2-20763baaa17e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:59.110905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ee6cb-17d2-4100-84d8-8ac0e8bdfe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:59.111503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ee6cb-17d2-4100-84d8-8ac0e8bdfe27 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:59.111774 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ee6cb-17d2-4100-84d8-8ac0e8bdfe27 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:59.112043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ee6cb-17d2-4100-84d8-8ac0e8bdfe27 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:59.112711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ee6cb-17d2-4100-84d8-8ac0e8bdfe27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:59.113110 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ee6cb-17d2-4100-84d8-8ac0e8bdfe27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:59.114554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ee6cb-17d2-4100-84d8-8ac0e8bdfe27 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:59.135217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 624/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:59.141654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859fed-510b-4e95-b666-2591d2cd8e09 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:59.260076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859fed-510b-4e95-b666-2591d2cd8e09 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:59.279525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:59.295299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a174d-4d72-4bd0-88b1-fe2ea7d6db17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:59.295847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a174d-4d72-4bd0-88b1-fe2ea7d6db17 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:59.296124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a174d-4d72-4bd0-88b1-fe2ea7d6db17 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:59.296423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a174d-4d72-4bd0-88b1-fe2ea7d6db17 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:59.304941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a174d-4d72-4bd0-88b1-fe2ea7d6db17 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:59.306427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a174d-4d72-4bd0-88b1-fe2ea7d6db17 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-0e4a174d-4d72-4bd0-88b1-fe2ea7d6db17 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:02:59.317586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:59.318701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:59.320081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:59.320081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:59.320081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:02:59.320081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:02:59.320081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:02:59.320081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:02:59.320081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:02:59.320081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:02:59.320081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 01:02:59.320081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:59.320081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 643/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:59.325081 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ee6cb-17d2-4100-84d8-8ac0e8bdfe27 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:59.446489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ee6cb-17d2-4100-84d8-8ac0e8bdfe27 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:59.488996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0119d28-12ff-432a-b712-2333e04b8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:59.489669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0119d28-12ff-432a-b712-2333e04b8580 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:59.490009 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0119d28-12ff-432a-b712-2333e04b8580 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:59.490428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0119d28-12ff-432a-b712-2333e04b8580 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:59.491255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0119d28-12ff-432a-b712-2333e04b8580 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:59.491660 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0119d28-12ff-432a-b712-2333e04b8580 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:59.493983 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0119d28-12ff-432a-b712-2333e04b8580 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:59.504021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:59.514615 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 625/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Sep 6 01:02:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:59.521107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a174d-4d72-4bd0-88b1-fe2ea7d6db17 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:59.628622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a174d-4d72-4bd0-88b1-fe2ea7d6db17 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:59.663597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37465744-9276-4697-a7a5-e556dbcbef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:59.664244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37465744-9276-4697-a7a5-e556dbcbef43 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:59.664544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37465744-9276-4697-a7a5-e556dbcbef43 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:59.664808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37465744-9276-4697-a7a5-e556dbcbef43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:59.675487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37465744-9276-4697-a7a5-e556dbcbef43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:59.677009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37465744-9276-4697-a7a5-e556dbcbef43 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-37465744-9276-4697-a7a5-e556dbcbef43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:02:59.691568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:02:59.692721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:02:59.693836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:02:59.693836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:02:59.693836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:02:59.696530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 644/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:02:59.699771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0119d28-12ff-432a-b712-2333e04b8580 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:59.810023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0119d28-12ff-432a-b712-2333e04b8580 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:02:59.846239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff67f5-e710-48f1-8021-e2494209232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:02:59.846835 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff67f5-e710-48f1-8021-e2494209232c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:02:59.847104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff67f5-e710-48f1-8021-e2494209232c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:02:59.847370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff67f5-e710-48f1-8021-e2494209232c None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:02:59.848007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff67f5-e710-48f1-8021-e2494209232c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:02:59.848318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff67f5-e710-48f1-8021-e2494209232c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:02:59.849741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff67f5-e710-48f1-8021-e2494209232c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:02:59.861109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 626/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:02:59.866934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37465744-9276-4697-a7a5-e556dbcbef43 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:02:59.912667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:02:59.989279 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37465744-9276-4697-a7a5-e556dbcbef43 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:00.025528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eea05-b64b-4428-acf4-2f029aed5a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:00.026148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eea05-b64b-4428-acf4-2f029aed5a9c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:00.026420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eea05-b64b-4428-acf4-2f029aed5a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:00.026673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eea05-b64b-4428-acf4-2f029aed5a9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:00.033687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eea05-b64b-4428-acf4-2f029aed5a9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:00.035180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eea05-b64b-4428-acf4-2f029aed5a9c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2e7eea05-b64b-4428-acf4-2f029aed5a9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:03:00.046521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:03:00.047489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:03:00.048528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:03:00.048528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:03:00.048528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:03:00.048528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:03:00.048528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:03:00.048528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:03:00.048528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:03:00.048528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:03:00.048528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 645/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:03:00.054416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff67f5-e710-48f1-8021-e2494209232c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:00.123380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:00.171428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff67f5-e710-48f1-8021-e2494209232c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:00.209397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b21b8f-4772-4e4f-a0e6-d9d994359298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:00.209999 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21b8f-4772-4e4f-a0e6-d9d994359298 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:00.210270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21b8f-4772-4e4f-a0e6-d9d994359298 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:00.210536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21b8f-4772-4e4f-a0e6-d9d994359298 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:00.211347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b21b8f-4772-4e4f-a0e6-d9d994359298 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:03:00.211604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b21b8f-4772-4e4f-a0e6-d9d994359298 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:00.213112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b21b8f-4772-4e4f-a0e6-d9d994359298 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:00.225363 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 627/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:03:00.234907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eea05-b64b-4428-acf4-2f029aed5a9c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:00.338030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:00.350300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eea05-b64b-4428-acf4-2f029aed5a9c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:00.388489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68222bdd-ed02-474a-a0e9-10f826364f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:00.389138 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68222bdd-ed02-474a-a0e9-10f826364f46 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:00.389409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68222bdd-ed02-474a-a0e9-10f826364f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:00.389678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68222bdd-ed02-474a-a0e9-10f826364f46 None admin] PATH_INFO: `/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/1823402195ab4e89aa865967afc62b9b/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:00.391629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68222bdd-ed02-474a-a0e9-10f826364f46 None admin] RBAC: Authorizing `identity:create_grant(project_id=d31b0823b61d4895accd0f27e6006b08, user_id=1823402195ab4e89aa865967afc62b9b, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:00.393131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68222bdd-ed02-474a-a0e9-10f826364f46 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:00.408774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 646/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 6 01:03:00 2022] PUT /identity/v3/projects/d31b0823b61d4895accd0f27e6006b08/users/1823402195ab4e89aa865967afc62b9b/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:03:02.277012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2a922-861a-446c-84cb-3850100a2034 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:02.277558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2a922-861a-446c-84cb-3850100a2034 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:02.277558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2a922-861a-446c-84cb-3850100a2034 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:02.280012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 628/1274] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:03:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:03:02.287970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90f3e1-6553-4531-a3b9-a71ed5674f84 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:02.288462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90f3e1-6553-4531-a3b9-a71ed5674f84 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:02.288561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90f3e1-6553-4531-a3b9-a71ed5674f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:02.308533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6e90f3e1-6553-4531-a3b9-a71ed5674f84 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:03:02.309629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6e90f3e1-6553-4531-a3b9-a71ed5674f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:03:02.384665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 647/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:03:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:03:02.659675 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2a922-861a-446c-84cb-3850100a2034 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:02.765858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2a922-861a-446c-84cb-3850100a2034 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:02.783676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:02.800907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6654bdc-b938-4222-b533-835f20a67c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:02.801518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6654bdc-b938-4222-b533-835f20a67c3b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:02.801787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6654bdc-b938-4222-b533-835f20a67c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:02.802052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6654bdc-b938-4222-b533-835f20a67c3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:02.812120 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6654bdc-b938-4222-b533-835f20a67c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-b6654bdc-b938-4222-b533-835f20a67c3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 01:03:02.816871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:03:02.817977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:03:02.819224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 629/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 6 01:03:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:03:02.824281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90f3e1-6553-4531-a3b9-a71ed5674f84 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:02.908964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:02.929847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90f3e1-6553-4531-a3b9-a71ed5674f84 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:02.966537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77df630-252b-4dee-bcf0-e4df77aa68bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:02.967158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77df630-252b-4dee-bcf0-e4df77aa68bf None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:02.967429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77df630-252b-4dee-bcf0-e4df77aa68bf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:02.967696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77df630-252b-4dee-bcf0-e4df77aa68bf None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:02.968352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77df630-252b-4dee-bcf0-e4df77aa68bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:03:02.968671 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77df630-252b-4dee-bcf0-e4df77aa68bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:02.970092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77df630-252b-4dee-bcf0-e4df77aa68bf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:02.978074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 648/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 6 01:03:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:03:02.984091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6654bdc-b938-4222-b533-835f20a67c3b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:03.096522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6654bdc-b938-4222-b533-835f20a67c3b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:03.135428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b11edf-b9b1-4760-93d6-50b4f23679b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:03.136043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b11edf-b9b1-4760-93d6-50b4f23679b5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:03.136330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b11edf-b9b1-4760-93d6-50b4f23679b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:03.136612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b11edf-b9b1-4760-93d6-50b4f23679b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:03.147149 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b11edf-b9b1-4760-93d6-50b4f23679b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:03.149258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b11edf-b9b1-4760-93d6-50b4f23679b5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-00b11edf-b9b1-4760-93d6-50b4f23679b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:03:03.165568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:03:03.171349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:03:03.172465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:03:03.172465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:03:03.172465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:03:03.172465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 630/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:03:03.174710 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77df630-252b-4dee-bcf0-e4df77aa68bf None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:03.281617 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77df630-252b-4dee-bcf0-e4df77aa68bf None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:03.316955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94415e7-29ab-40aa-9a74-21307977c875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:03.317571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94415e7-29ab-40aa-9a74-21307977c875 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:03.317811 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94415e7-29ab-40aa-9a74-21307977c875 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:03.318075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94415e7-29ab-40aa-9a74-21307977c875 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:03.318714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94415e7-29ab-40aa-9a74-21307977c875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:03:03.319012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94415e7-29ab-40aa-9a74-21307977c875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:03.320993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94415e7-29ab-40aa-9a74-21307977c875 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:03.332618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 649/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:03:03.341678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b11edf-b9b1-4760-93d6-50b4f23679b5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:03.378271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:03.455434 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b11edf-b9b1-4760-93d6-50b4f23679b5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:03.498650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dbf0c-cede-425e-a21c-05b178bcf92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:03.499365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dbf0c-cede-425e-a21c-05b178bcf92f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:03.499680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dbf0c-cede-425e-a21c-05b178bcf92f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:03.499955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dbf0c-cede-425e-a21c-05b178bcf92f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:03.507996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dbf0c-cede-425e-a21c-05b178bcf92f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:03.509536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dbf0c-cede-425e-a21c-05b178bcf92f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f35dbf0c-cede-425e-a21c-05b178bcf92f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 01:03:03.520757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:03:03.521840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:03:03.523142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:03:03.523142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:03:03.523142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 01:03:03.523142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 01:03:03.523142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 01:03:03.523142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 01:03:03.523142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 01:03:03.523142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 01:03:03.523142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 01:03:03.523142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:03:03.523142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 631/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:03:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:03:03.528073 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94415e7-29ab-40aa-9a74-21307977c875 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:03.532460 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:03.634039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94415e7-29ab-40aa-9a74-21307977c875 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:03.673651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146cec1-b0a9-4e6c-8d4b-8b830dc94586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:03.674259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146cec1-b0a9-4e6c-8d4b-8b830dc94586 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:03.674529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146cec1-b0a9-4e6c-8d4b-8b830dc94586 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:03.674794 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146cec1-b0a9-4e6c-8d4b-8b830dc94586 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:03.675528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146cec1-b0a9-4e6c-8d4b-8b830dc94586 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:03:03.675832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146cec1-b0a9-4e6c-8d4b-8b830dc94586 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:03.677385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146cec1-b0a9-4e6c-8d4b-8b830dc94586 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:03.694359 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 650/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Sep 6 01:03:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:03:03.704040 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dbf0c-cede-425e-a21c-05b178bcf92f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:03.806487 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:03.816965 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dbf0c-cede-425e-a21c-05b178bcf92f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:03.855974 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d020af6-cb74-4c00-9438-933f6a531f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:03.856606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020af6-cb74-4c00-9438-933f6a531f21 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:03.856878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020af6-cb74-4c00-9438-933f6a531f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:03.857143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020af6-cb74-4c00-9438-933f6a531f21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:03.927728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d020af6-cb74-4c00-9438-933f6a531f21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:03.929243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d020af6-cb74-4c00-9438-933f6a531f21 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:04.019950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:04.033361 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 632/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 6 01:03:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 01:03:04.039462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146cec1-b0a9-4e6c-8d4b-8b830dc94586 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:04.105435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:04.145249 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146cec1-b0a9-4e6c-8d4b-8b830dc94586 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:04.183171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22898ec5-d92f-42c4-b9c9-af4b898701ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:04.183805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22898ec5-d92f-42c4-b9c9-af4b898701ff None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:04.184082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22898ec5-d92f-42c4-b9c9-af4b898701ff None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:04.184377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22898ec5-d92f-42c4-b9c9-af4b898701ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:04.195475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22898ec5-d92f-42c4-b9c9-af4b898701ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:04.197154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22898ec5-d92f-42c4-b9c9-af4b898701ff None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-22898ec5-d92f-42c4-b9c9-af4b898701ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 01:03:04.212604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:03:04.213714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 01:03:04.215029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 01:03:04.215029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 01:03:04.215029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:03:04.215029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 651/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:03:04.221300 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d020af6-cb74-4c00-9438-933f6a531f21 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:04.326587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d020af6-cb74-4c00-9438-933f6a531f21 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:04.362885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59a962-3691-440c-ba82-fcec0cf3ba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:04.363500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59a962-3691-440c-ba82-fcec0cf3ba6b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:04.363679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59a962-3691-440c-ba82-fcec0cf3ba6b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:04.363944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59a962-3691-440c-ba82-fcec0cf3ba6b None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:04.364600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59a962-3691-440c-ba82-fcec0cf3ba6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:03:04.364899 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59a962-3691-440c-ba82-fcec0cf3ba6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:04.366298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59a962-3691-440c-ba82-fcec0cf3ba6b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:04.377475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 633/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 6 01:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:03:04.384672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22898ec5-d92f-42c4-b9c9-af4b898701ff None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:04.493939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22898ec5-d92f-42c4-b9c9-af4b898701ff None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:04.507311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:04.527695 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe5f8c-1d00-4ffb-b01b-66f2160f9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:04.528683 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe5f8c-1d00-4ffb-b01b-66f2160f9d8b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:04.528959 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe5f8c-1d00-4ffb-b01b-66f2160f9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:04.529230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe5f8c-1d00-4ffb-b01b-66f2160f9d8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:04.535934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe5f8c-1d00-4ffb-b01b-66f2160f9d8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:04.537473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe5f8c-1d00-4ffb-b01b-66f2160f9d8b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-80fe5f8c-1d00-4ffb-b01b-66f2160f9d8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 01:03:04.549675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:03:04.550675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:03:04.555464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 01:03:04.555464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 01:03:04.555464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 01:03:04.555464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 01:03:04.555464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 01:03:04.555464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 01:03:04.555464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 01:03:04.555464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Sep 06 01:03:04.555464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 652/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 6 01:03:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:03:04.556990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59a962-3691-440c-ba82-fcec0cf3ba6b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:04.611794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:04.675383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59a962-3691-440c-ba82-fcec0cf3ba6b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:04.710298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989357ef-fc59-4a01-a690-c41fad59413b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:04.710945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989357ef-fc59-4a01-a690-c41fad59413b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:04.711211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989357ef-fc59-4a01-a690-c41fad59413b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:04.711473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989357ef-fc59-4a01-a690-c41fad59413b None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:04.712149 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989357ef-fc59-4a01-a690-c41fad59413b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:03:04.712477 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989357ef-fc59-4a01-a690-c41fad59413b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:04.713945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989357ef-fc59-4a01-a690-c41fad59413b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:04.725801 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 634/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 6 01:03:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:03:04.732353 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe5f8c-1d00-4ffb-b01b-66f2160f9d8b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:04.834636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe5f8c-1d00-4ffb-b01b-66f2160f9d8b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:04.869509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca3051-2daf-413a-8d4a-ed6661a3cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:04.870094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3051-2daf-413a-8d4a-ed6661a3cd23 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:04.870375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3051-2daf-413a-8d4a-ed6661a3cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:04.870631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3051-2daf-413a-8d4a-ed6661a3cd23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:04.871350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca3051-2daf-413a-8d4a-ed6661a3cd23 None admin] RBAC: Adding query filter params (role.id=8c3e1d1e8c74417c922e6978cdf1c28c, scope.project.id=d31b0823b61d4895accd0f27e6006b08, user.id=1823402195ab4e89aa865967afc62b9b) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:03:04.871651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca3051-2daf-413a-8d4a-ed6661a3cd23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:04.873152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca3051-2daf-413a-8d4a-ed6661a3cd23 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:04.878946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 653/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 6 01:03:04 2022] GET /identity/v3/role_assignments?user.id=1823402195ab4e89aa865967afc62b9b&scope.project.id=d31b0823b61d4895accd0f27e6006b08&role.id=8c3e1d1e8c74417c922e6978cdf1c28c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:03:06.781319 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342c638-b048-47e4-980e-ded7cbc46e58 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:06.781911 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342c638-b048-47e4-980e-ded7cbc46e58 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:06.781911 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342c638-b048-47e4-980e-ded7cbc46e58 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:06.783197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 635/1288] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:03:06.788543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ccc4a-1572-45a0-be28-47b6648b68d0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:06.788983 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ccc4a-1572-45a0-be28-47b6648b68d0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:06.789123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ccc4a-1572-45a0-be28-47b6648b68d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:06.809398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-245ccc4a-1572-45a0-be28-47b6648b68d0 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:03:06.810576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-245ccc4a-1572-45a0-be28-47b6648b68d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:03:06.842106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:06.881812 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 654/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:03:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:03:07.144230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342c638-b048-47e4-980e-ded7cbc46e58 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:07.256207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342c638-b048-47e4-980e-ded7cbc46e58 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:07.266944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:07.294631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b8db7-2b0f-4346-a897-1c127da4fb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:07.295181 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b8db7-2b0f-4346-a897-1c127da4fb19 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:07.295451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b8db7-2b0f-4346-a897-1c127da4fb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:07.295717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b8db7-2b0f-4346-a897-1c127da4fb19 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:07.296428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b8db7-2b0f-4346-a897-1c127da4fb19 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:07.297839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b8db7-2b0f-4346-a897-1c127da4fb19 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-541b8db7-2b0f-4346-a897-1c127da4fb19 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:03:07.306864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:03:07.308109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:03:07.309083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 636/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 6 01:03:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:03:07.314093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ccc4a-1572-45a0-be28-47b6648b68d0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:07.426893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ccc4a-1572-45a0-be28-47b6648b68d0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:07.467286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc777f-8778-47d4-a802-b71608cd1222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:07.467998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc777f-8778-47d4-a802-b71608cd1222 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:07.468430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc777f-8778-47d4-a802-b71608cd1222 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:07.468666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc777f-8778-47d4-a802-b71608cd1222 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:07.469403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc777f-8778-47d4-a802-b71608cd1222 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:03:07.469738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc777f-8778-47d4-a802-b71608cd1222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:07.471200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc777f-8778-47d4-a802-b71608cd1222 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:07.477140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 655/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Sep 6 01:03:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:03:07.483972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b8db7-2b0f-4346-a897-1c127da4fb19 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:07.610117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b8db7-2b0f-4346-a897-1c127da4fb19 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:07.644956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae48f5-c4e7-471d-8a2a-7f2abd553c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:07.645554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae48f5-c4e7-471d-8a2a-7f2abd553c1e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:07.645805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae48f5-c4e7-471d-8a2a-7f2abd553c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:07.646101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae48f5-c4e7-471d-8a2a-7f2abd553c1e None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:07.646724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae48f5-c4e7-471d-8a2a-7f2abd553c1e None admin] RBAC: Adding query filter params (type=placement) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:03:07.647025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae48f5-c4e7-471d-8a2a-7f2abd553c1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:07.649099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae48f5-c4e7-471d-8a2a-7f2abd553c1e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:07.654031 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 637/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Sep 6 01:03:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:03:09.529363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9698-84e5-4d83-99b0-77460c62b5cd None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:09.530267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9698-84e5-4d83-99b0-77460c62b5cd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:09.530267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9698-84e5-4d83-99b0-77460c62b5cd None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:09.532392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 656/1293] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:03:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:03:09.541416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431cb7a-9b88-4105-9953-fdf1364f47ad None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:09.542126 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431cb7a-9b88-4105-9953-fdf1364f47ad None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:09.542301 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431cb7a-9b88-4105-9953-fdf1364f47ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:09.571552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7431cb7a-9b88-4105-9953-fdf1364f47ad None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:03:09.572759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7431cb7a-9b88-4105-9953-fdf1364f47ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:03:09.604415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:09.644746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 638/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:03:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 01:03:09.914496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9698-84e5-4d83-99b0-77460c62b5cd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:09.958814 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:10.039416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9698-84e5-4d83-99b0-77460c62b5cd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:10.073966 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f3ee8-144e-4fe5-87ab-70d276178695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:10.074564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f3ee8-144e-4fe5-87ab-70d276178695 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:10.074834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f3ee8-144e-4fe5-87ab-70d276178695 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:10.075099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f3ee8-144e-4fe5-87ab-70d276178695 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:10.075744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f3ee8-144e-4fe5-87ab-70d276178695 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:10.077199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f3ee8-144e-4fe5-87ab-70d276178695 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:10.095584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 657/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 6 01:03:09 2022] POST /identity/v3/services => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:03:11.976933 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435e262-25f5-466e-881d-10b326725769 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:11.977532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435e262-25f5-466e-881d-10b326725769 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:11.977532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435e262-25f5-466e-881d-10b326725769 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:11.978826 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 639/1296] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:03:11.985112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac216991-7a1d-47a0-bfb1-d46ab22de2a2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:11.985877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac216991-7a1d-47a0-bfb1-d46ab22de2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:11.986026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac216991-7a1d-47a0-bfb1-d46ab22de2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:12.014799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ac216991-7a1d-47a0-bfb1-d46ab22de2a2 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:03:12.016565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ac216991-7a1d-47a0-bfb1-d46ab22de2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:03:12.105381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 658/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:03:11 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:03:12.367711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435e262-25f5-466e-881d-10b326725769 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:12.479220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435e262-25f5-466e-881d-10b326725769 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:12.518473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f0fd3-fcc5-49a1-b6f1-56961ef1ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:12.519146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f0fd3-fcc5-49a1-b6f1-56961ef1ee9e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:12.519418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f0fd3-fcc5-49a1-b6f1-56961ef1ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:12.519683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f0fd3-fcc5-49a1-b6f1-56961ef1ee9e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:12.520264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f0fd3-fcc5-49a1-b6f1-56961ef1ee9e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:12.521732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f0fd3-fcc5-49a1-b6f1-56961ef1ee9e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-0a1f0fd3-fcc5-49a1-b6f1-56961ef1ee9e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:03:12.533901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:03:12.535500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:03:12.536681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 640/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 6 01:03:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:03:12.541795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac216991-7a1d-47a0-bfb1-d46ab22de2a2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:12.561271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:12.647923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac216991-7a1d-47a0-bfb1-d46ab22de2a2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:12.684162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dcd2a-3d72-4014-b7cb-138bc1570553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:12.684796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dcd2a-3d72-4014-b7cb-138bc1570553 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:12.685074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dcd2a-3d72-4014-b7cb-138bc1570553 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:12.685340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dcd2a-3d72-4014-b7cb-138bc1570553 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:12.685965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dcd2a-3d72-4014-b7cb-138bc1570553 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:03:12.686331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dcd2a-3d72-4014-b7cb-138bc1570553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:12.687757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dcd2a-3d72-4014-b7cb-138bc1570553 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:12.692938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 659/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Sep 6 01:03:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:03:12.702670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f0fd3-fcc5-49a1-b6f1-56961ef1ee9e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:12.745574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:12.824870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f0fd3-fcc5-49a1-b6f1-56961ef1ee9e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:12.862222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead239d0-525c-468b-ae83-113644b57f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:12.862823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead239d0-525c-468b-ae83-113644b57f21 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:12.863097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead239d0-525c-468b-ae83-113644b57f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:12.863366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead239d0-525c-468b-ae83-113644b57f21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:12.864060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead239d0-525c-468b-ae83-113644b57f21 None admin] RBAC: Adding query filter params (interface=public, service_id=ddaf2bab259940c8ae069b5594742217, region_id=RegionOne) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:03:12.864388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead239d0-525c-468b-ae83-113644b57f21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:12.865785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead239d0-525c-468b-ae83-113644b57f21 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:12.871120 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 641/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 6 01:03:12 2022] GET /identity/v3/endpoints?service_id=ddaf2bab259940c8ae069b5594742217&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:03:12.877289 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dcd2a-3d72-4014-b7cb-138bc1570553 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:12.975433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:13.000316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dcd2a-3d72-4014-b7cb-138bc1570553 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:13.036475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641e548-5f57-49b8-bb8e-1c22ee6826cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:13.037073 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641e548-5f57-49b8-bb8e-1c22ee6826cf None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:13.037341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641e548-5f57-49b8-bb8e-1c22ee6826cf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:13.037604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641e548-5f57-49b8-bb8e-1c22ee6826cf None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:13.038235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641e548-5f57-49b8-bb8e-1c22ee6826cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:13.039646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641e548-5f57-49b8-bb8e-1c22ee6826cf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:13.047410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 660/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 6 01:03:12 2022] GET /identity/v3/services => generated 2191 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:03:14.942194 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe140c4-07fe-4a46-924a-bcc0bade5ccd None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:14.942798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe140c4-07fe-4a46-924a-bcc0bade5ccd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:14.942798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe140c4-07fe-4a46-924a-bcc0bade5ccd None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:14.944091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 642/1302] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:03:14.950625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65e628-af7a-47b2-aa90-a67986f3fab5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:14.951351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65e628-af7a-47b2-aa90-a67986f3fab5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:14.951510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65e628-af7a-47b2-aa90-a67986f3fab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:14.979283 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6e65e628-af7a-47b2-aa90-a67986f3fab5 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:03:14.980516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6e65e628-af7a-47b2-aa90-a67986f3fab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:03:15.057195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 661/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:03:14 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 01:03:15.325783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe140c4-07fe-4a46-924a-bcc0bade5ccd None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:15.435525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:15.443600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe140c4-07fe-4a46-924a-bcc0bade5ccd None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:15.479277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7256b-f715-482c-b2e1-df36bec096c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:15.479917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7256b-f715-482c-b2e1-df36bec096c1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:15.480188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7256b-f715-482c-b2e1-df36bec096c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:15.480484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7256b-f715-482c-b2e1-df36bec096c1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:15.481061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7256b-f715-482c-b2e1-df36bec096c1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:15.482471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7256b-f715-482c-b2e1-df36bec096c1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-a0d7256b-f715-482c-b2e1-df36bec096c1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 01:03:15.491077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 01:03:15.492259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: ERROR keystone.server.flask.application Sep 06 01:03:15.493347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 643/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 6 01:03:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 01:03:15.498586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65e628-af7a-47b2-aa90-a67986f3fab5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:15.578868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:15.608950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65e628-af7a-47b2-aa90-a67986f3fab5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:15.650112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e3005-420c-443a-813e-fae7ba24a287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:15.650709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3005-420c-443a-813e-fae7ba24a287 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:15.650983 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3005-420c-443a-813e-fae7ba24a287 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:15.651247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3005-420c-443a-813e-fae7ba24a287 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:15.651870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e3005-420c-443a-813e-fae7ba24a287 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:03:15.652170 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e3005-420c-443a-813e-fae7ba24a287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:15.653941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e3005-420c-443a-813e-fae7ba24a287 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:15.659708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 662/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Sep 6 01:03:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:03:15.667105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7256b-f715-482c-b2e1-df36bec096c1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:03:15.776787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7256b-f715-482c-b2e1-df36bec096c1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:03:15.814765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079dde0-bd29-409a-8a9d-86611c8ee162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:03:15.815365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079dde0-bd29-409a-8a9d-86611c8ee162 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:03:15.815637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079dde0-bd29-409a-8a9d-86611c8ee162 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:03:15.815908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079dde0-bd29-409a-8a9d-86611c8ee162 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:03:15.816599 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079dde0-bd29-409a-8a9d-86611c8ee162 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:03:15.818022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079dde0-bd29-409a-8a9d-86611c8ee162 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:03:15.842792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 644/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:03:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:03:25.656210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=30 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:03:25.838695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:20.152551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c8bf-2c66-4c8e-afef-f9d7405b11c3 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:20.153041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c8bf-2c66-4c8e-afef-f9d7405b11c3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:20.153129 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c8bf-2c66-4c8e-afef-f9d7405b11c3 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:20.156658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 663/1307] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:04:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:20.159611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbc66d-9d6a-4f1e-8fc0-4543de5d7e8f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:20.160009 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbc66d-9d6a-4f1e-8fc0-4543de5d7e8f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:20.160191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbc66d-9d6a-4f1e-8fc0-4543de5d7e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:20.329794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-addbc66d-9d6a-4f1e-8fc0-4543de5d7e8f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:20.331346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-addbc66d-9d6a-4f1e-8fc0-4543de5d7e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:20.474914 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 645/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:04:20.759597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d60cd-fa54-4e9a-8e8c-840c9429e05d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:20.759986 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d60cd-fa54-4e9a-8e8c-840c9429e05d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:20.760162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d60cd-fa54-4e9a-8e8c-840c9429e05d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:20.761699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 664/1309] 10.222.0.25 () {54 vars in 965 bytes} [Tue Sep 6 01:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:20.767657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07320-7a4a-4662-a2a1-99b8b844feca None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:20.768022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07320-7a4a-4662-a2a1-99b8b844feca None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:20.768402 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07320-7a4a-4662-a2a1-99b8b844feca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:20.852701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f7e07320-7a4a-4662-a2a1-99b8b844feca None None] MFA Rules not processed for user `2fc30f3a335f428082e9178227dcb4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:20.853936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f7e07320-7a4a-4662-a2a1-99b8b844feca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:20.876204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:20.938677 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 646/1310] 10.222.0.25 () {58 vars in 1062 bytes} [Tue Sep 6 01:04:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:04:20.948308 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d60cd-fa54-4e9a-8e8c-840c9429e05d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:04:20.950108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-147d60cd-fa54-4e9a-8e8c-840c9429e05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:21.074353 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d60cd-fa54-4e9a-8e8c-840c9429e05d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:04:21.165591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4384a49-b994-4dea-9580-0d1ff32b6936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:04:21.166301 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4384a49-b994-4dea-9580-0d1ff32b6936 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:21.166516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4384a49-b994-4dea-9580-0d1ff32b6936 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:21.166950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4384a49-b994-4dea-9580-0d1ff32b6936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:21.168741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e4384a49-b994-4dea-9580-0d1ff32b6936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:21.233995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:21.296934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4384a49-b994-4dea-9580-0d1ff32b6936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:04:21.298364 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4384a49-b994-4dea-9580-0d1ff32b6936 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:04:21.317100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 665/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:04:23.478045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9a6d-6181-46b5-9071-b0dc7413a609 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:23.478603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9a6d-6181-46b5-9071-b0dc7413a609 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:23.478603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9a6d-6181-46b5-9071-b0dc7413a609 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:23.479962 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 647/1312] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:23.485914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1415bbb-8949-4ccf-94cd-ca464ba3ecbe None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:23.486481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1415bbb-8949-4ccf-94cd-ca464ba3ecbe None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:23.486481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1415bbb-8949-4ccf-94cd-ca464ba3ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:23.566469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f1415bbb-8949-4ccf-94cd-ca464ba3ecbe None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:23.567609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f1415bbb-8949-4ccf-94cd-ca464ba3ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:23.667911 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 666/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:04:23.950128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9a6d-6181-46b5-9071-b0dc7413a609 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:04:23.951718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2d9c9a6d-6181-46b5-9071-b0dc7413a609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:24.066188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9a6d-6181-46b5-9071-b0dc7413a609 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:04:24.139674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:24.142144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2de91-a83c-4ff8-9391-d704202f0ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:04:24.142828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2de91-a83c-4ff8-9391-d704202f0ecb service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:24.143104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2de91-a83c-4ff8-9391-d704202f0ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:24.143373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2de91-a83c-4ff8-9391-d704202f0ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:24.145831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bea2de91-a83c-4ff8-9391-d704202f0ecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:24.261595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2de91-a83c-4ff8-9391-d704202f0ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:04:24.263093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2de91-a83c-4ff8-9391-d704202f0ecb service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:04:24.282490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 648/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:04:26.511759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8e8a8-3223-4d3e-aa01-947960b39b91 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:26.512662 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8e8a8-3223-4d3e-aa01-947960b39b91 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:26.512662 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8e8a8-3223-4d3e-aa01-947960b39b91 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:26.514868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 667/1315] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:04:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:26.521195 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231da7a-362f-4e99-884d-64ac3ca0a57c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:26.521606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231da7a-362f-4e99-884d-64ac3ca0a57c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:26.521747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231da7a-362f-4e99-884d-64ac3ca0a57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:26.592448 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1231da7a-362f-4e99-884d-64ac3ca0a57c None None] MFA Rules not processed for user `cb2704ce6ab6495682d66c927e5856fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:26.593654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1231da7a-362f-4e99-884d-64ac3ca0a57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:26.651551 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:26.701635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 649/1316] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:04:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:04:26.985799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8e8a8-3223-4d3e-aa01-947960b39b91 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:04:26.988411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e1e8e8a8-3223-4d3e-aa01-947960b39b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:27.006105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:27.105475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8e8a8-3223-4d3e-aa01-947960b39b91 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:04:27.183266 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0b7a8-583e-4d47-8331-88543f2b62c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:04:27.183877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0b7a8-583e-4d47-8331-88543f2b62c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:27.184154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0b7a8-583e-4d47-8331-88543f2b62c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:27.184458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0b7a8-583e-4d47-8331-88543f2b62c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:27.186061 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-21e0b7a8-583e-4d47-8331-88543f2b62c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:27.249376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:27.300068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0b7a8-583e-4d47-8331-88543f2b62c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:04:27.301649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0b7a8-583e-4d47-8331-88543f2b62c0 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:04:27.322787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 668/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:04:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:04:29.794139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1296999-72fa-41e3-b594-2d82cad33f39 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:29.795154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1296999-72fa-41e3-b594-2d82cad33f39 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:29.795154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1296999-72fa-41e3-b594-2d82cad33f39 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:29.797244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 650/1318] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:04:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:29.805317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da118281-45d2-48f4-9257-b499389a352f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:29.805764 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da118281-45d2-48f4-9257-b499389a352f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:29.805965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da118281-45d2-48f4-9257-b499389a352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:29.874538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-da118281-45d2-48f4-9257-b499389a352f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:29.875766 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-da118281-45d2-48f4-9257-b499389a352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:29.977600 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 669/1319] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:04:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:04:30.271412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1296999-72fa-41e3-b594-2d82cad33f39 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:04:30.272990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a1296999-72fa-41e3-b594-2d82cad33f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:30.382383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1296999-72fa-41e3-b594-2d82cad33f39 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:04:30.483773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04278553-313a-4d13-9d5c-a56d16efecfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:04:30.484505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04278553-313a-4d13-9d5c-a56d16efecfc service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:30.484909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04278553-313a-4d13-9d5c-a56d16efecfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:30.485227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04278553-313a-4d13-9d5c-a56d16efecfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:30.487005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-04278553-313a-4d13-9d5c-a56d16efecfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:30.496467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:30.613950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04278553-313a-4d13-9d5c-a56d16efecfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:04:30.615352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04278553-313a-4d13-9d5c-a56d16efecfc service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:04:30.633725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 651/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:04:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:04:33.253123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d1b3-4c8b-42f1-bbc4-903969087354 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:33.253746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d1b3-4c8b-42f1-bbc4-903969087354 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:33.253746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d1b3-4c8b-42f1-bbc4-903969087354 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:33.255031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 670/1321] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:33.260389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175b151-acbb-4b53-846c-63a5a64507c4 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:33.260852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175b151-acbb-4b53-846c-63a5a64507c4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:33.260944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175b151-acbb-4b53-846c-63a5a64507c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:33.330732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8175b151-acbb-4b53-846c-63a5a64507c4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:33.331895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8175b151-acbb-4b53-846c-63a5a64507c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:33.391978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:33.435762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 652/1322] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:04:33.718526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5d1b3-4c8b-42f1-bbc4-903969087354 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:04:33.720061 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0fd5d1b3-4c8b-42f1-bbc4-903969087354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:33.740894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:33.827446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5d1b3-4c8b-42f1-bbc4-903969087354 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:04:33.903873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ab43f-ae1e-407b-ba52-e2fa012bb356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:04:33.904426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ab43f-ae1e-407b-ba52-e2fa012bb356 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:33.904700 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ab43f-ae1e-407b-ba52-e2fa012bb356 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:33.905595 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ab43f-ae1e-407b-ba52-e2fa012bb356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:33.907208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b73ab43f-ae1e-407b-ba52-e2fa012bb356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:33.982262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:34.024612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ab43f-ae1e-407b-ba52-e2fa012bb356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:04:34.026115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ab43f-ae1e-407b-ba52-e2fa012bb356 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:04:34.045286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 671/1323] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:04:35.984512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7fd1f-6468-4119-8379-48174ef49eca None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:35.985059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7fd1f-6468-4119-8379-48174ef49eca None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:35.985059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7fd1f-6468-4119-8379-48174ef49eca None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:35.986605 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 653/1324] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:35.991702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7c723-6b79-4a59-8167-99ee8afce543 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:35.992179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7c723-6b79-4a59-8167-99ee8afce543 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:35.992179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7c723-6b79-4a59-8167-99ee8afce543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:36.067130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-44e7c723-6b79-4a59-8167-99ee8afce543 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:36.068398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-44e7c723-6b79-4a59-8167-99ee8afce543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:36.167193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 672/1325] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:04:36.446245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7fd1f-6468-4119-8379-48174ef49eca None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:04:36.447803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-36f7fd1f-6468-4119-8379-48174ef49eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:36.553281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7fd1f-6468-4119-8379-48174ef49eca None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:04:36.643531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34227c-db8c-4e49-aa93-f97aba381f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:04:36.644140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34227c-db8c-4e49-aa93-f97aba381f63 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:36.644440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34227c-db8c-4e49-aa93-f97aba381f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:36.644719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34227c-db8c-4e49-aa93-f97aba381f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:36.646434 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ef34227c-db8c-4e49-aa93-f97aba381f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:36.664196 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:36.761150 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34227c-db8c-4e49-aa93-f97aba381f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:04:36.762639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34227c-db8c-4e49-aa93-f97aba381f63 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:04:36.781947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 654/1326] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:04:38.726417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617188c-a69e-4936-8eca-3b31a1aeb3d1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:38.726919 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617188c-a69e-4936-8eca-3b31a1aeb3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:38.727017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617188c-a69e-4936-8eca-3b31a1aeb3d1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:38.728842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 673/1327] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:38.734362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f1321-47e2-4f87-9052-df982eaedb15 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:38.734826 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f1321-47e2-4f87-9052-df982eaedb15 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:38.734906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f1321-47e2-4f87-9052-df982eaedb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:38.810593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b29f1321-47e2-4f87-9052-df982eaedb15 None None] MFA Rules not processed for user `cb2704ce6ab6495682d66c927e5856fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:38.811840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b29f1321-47e2-4f87-9052-df982eaedb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:38.883330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:38.921515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 655/1328] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:04:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:04:39.269815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833038eb-e8dc-4e42-9055-143c1572bd6f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:39.270115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833038eb-e8dc-4e42-9055-143c1572bd6f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:39.270380 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833038eb-e8dc-4e42-9055-143c1572bd6f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:39.272383 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 674/1329] 10.222.0.25 () {54 vars in 965 bytes} [Tue Sep 6 01:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:39.279173 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda3d40-b57a-41da-9290-432867972cbd None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:39.279785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda3d40-b57a-41da-9290-432867972cbd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:39.280385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda3d40-b57a-41da-9290-432867972cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:39.378856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-fcda3d40-b57a-41da-9290-432867972cbd None None] MFA Rules not processed for user `2fc30f3a335f428082e9178227dcb4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:39.380084 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fcda3d40-b57a-41da-9290-432867972cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:39.470844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 656/1330] 10.222.0.25 () {58 vars in 1062 bytes} [Tue Sep 6 01:04:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:04:39.483382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833038eb-e8dc-4e42-9055-143c1572bd6f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:04:39.484976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-833038eb-e8dc-4e42-9055-143c1572bd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:39.526874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:39.630090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833038eb-e8dc-4e42-9055-143c1572bd6f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:04:39.714581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c59b3-7b62-4ee6-bd54-1d28e4dfa205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:04:39.715193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c59b3-7b62-4ee6-bd54-1d28e4dfa205 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:39.715465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c59b3-7b62-4ee6-bd54-1d28e4dfa205 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:39.715737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c59b3-7b62-4ee6-bd54-1d28e4dfa205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:39.717411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-996c59b3-7b62-4ee6-bd54-1d28e4dfa205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:39.809660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:39.852314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c59b3-7b62-4ee6-bd54-1d28e4dfa205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:04:39.854041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c59b3-7b62-4ee6-bd54-1d28e4dfa205 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:04:39.876515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 675/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:04:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:04:42.450405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a574b-fdb0-4620-81fe-683efa448a46 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:42.451000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a574b-fdb0-4620-81fe-683efa448a46 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:42.451000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a574b-fdb0-4620-81fe-683efa448a46 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:42.452339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 657/1332] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:42.459918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe76504-f8a8-451f-835a-0358fe8f0b3b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:42.460610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe76504-f8a8-451f-835a-0358fe8f0b3b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:42.460610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe76504-f8a8-451f-835a-0358fe8f0b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:42.540304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ebe76504-f8a8-451f-835a-0358fe8f0b3b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:42.542122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ebe76504-f8a8-451f-835a-0358fe8f0b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:42.655191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 676/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:04:42.936359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a574b-fdb0-4620-81fe-683efa448a46 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:04:42.938863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7c7a574b-fdb0-4620-81fe-683efa448a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:43.024759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:43.057933 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a574b-fdb0-4620-81fe-683efa448a46 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:04:43.134741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6c681-53dd-4655-9972-9fa6478a06db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:04:43.135360 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6c681-53dd-4655-9972-9fa6478a06db service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:43.135635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6c681-53dd-4655-9972-9fa6478a06db service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:43.135904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6c681-53dd-4655-9972-9fa6478a06db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:43.137557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8bf6c681-53dd-4655-9972-9fa6478a06db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:43.255808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6c681-53dd-4655-9972-9fa6478a06db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:04:43.257343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6c681-53dd-4655-9972-9fa6478a06db service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:04:43.268078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:43.277908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 658/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:04:45.230576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a8d7c-75cb-4168-b18f-0410ea5f0045 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:45.231174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a8d7c-75cb-4168-b18f-0410ea5f0045 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:45.231174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a8d7c-75cb-4168-b18f-0410ea5f0045 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:45.232512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 677/1335] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:45.239166 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee61a6-fc8c-40e4-8c68-a39c07b81960 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:45.239597 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee61a6-fc8c-40e4-8c68-a39c07b81960 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:45.239714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee61a6-fc8c-40e4-8c68-a39c07b81960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:45.321772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e6ee61a6-fc8c-40e4-8c68-a39c07b81960 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:45.322906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e6ee61a6-fc8c-40e4-8c68-a39c07b81960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:45.432926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 659/1336] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:04:45.738171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a8d7c-75cb-4168-b18f-0410ea5f0045 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:04:45.741010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ab4a8d7c-75cb-4168-b18f-0410ea5f0045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:45.799350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:45.865048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a8d7c-75cb-4168-b18f-0410ea5f0045 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:04:45.942212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a6748-21fb-46ce-9eae-05991766c2e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:04:45.942778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a6748-21fb-46ce-9eae-05991766c2e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:45.943054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a6748-21fb-46ce-9eae-05991766c2e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:45.943352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a6748-21fb-46ce-9eae-05991766c2e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:45.945089 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-df6a6748-21fb-46ce-9eae-05991766c2e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:46.059183 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:46.087526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a6748-21fb-46ce-9eae-05991766c2e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:04:46.089059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a6748-21fb-46ce-9eae-05991766c2e9 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:04:46.107483 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 678/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:04:48.311983 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9b907-42cc-4967-b233-fbf69a9df563 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:48.312631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9b907-42cc-4967-b233-fbf69a9df563 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:48.312631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9b907-42cc-4967-b233-fbf69a9df563 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:48.313908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 660/1338] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:48.320524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c384-942c-4f26-92e5-9f15c255f10e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:48.321239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c384-942c-4f26-92e5-9f15c255f10e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:48.321566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c384-942c-4f26-92e5-9f15c255f10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:48.396497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ea07c384-942c-4f26-92e5-9f15c255f10e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:48.397717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ea07c384-942c-4f26-92e5-9f15c255f10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:48.499838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 679/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:04:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:04:48.786975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9b907-42cc-4967-b233-fbf69a9df563 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:04:48.789373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f1c9b907-42cc-4967-b233-fbf69a9df563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:48.875584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:48.905011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9b907-42cc-4967-b233-fbf69a9df563 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:04:48.985159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80a5ff-2740-408a-9089-5fbd588aaaa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:04:48.985758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a5ff-2740-408a-9089-5fbd588aaaa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:48.985992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a5ff-2740-408a-9089-5fbd588aaaa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:48.986287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a5ff-2740-408a-9089-5fbd588aaaa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:48.987936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7e80a5ff-2740-408a-9089-5fbd588aaaa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:49.114897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80a5ff-2740-408a-9089-5fbd588aaaa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:04:49.116391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80a5ff-2740-408a-9089-5fbd588aaaa0 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:04:49.134441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 661/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:04:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:04:53.071160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dd620-8c62-4b1b-850e-478ce7583aa1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:53.071679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dd620-8c62-4b1b-850e-478ce7583aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:53.071884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dd620-8c62-4b1b-850e-478ce7583aa1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:53.073387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 680/1341] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:53.078359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc349706-aa8e-4287-acfb-7d8c7bd36584 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:53.078799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc349706-aa8e-4287-acfb-7d8c7bd36584 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:53.078895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc349706-aa8e-4287-acfb-7d8c7bd36584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:53.084441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:53.151209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-bc349706-aa8e-4287-acfb-7d8c7bd36584 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:53.152470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bc349706-aa8e-4287-acfb-7d8c7bd36584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:53.251722 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 662/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:04:53.535800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dd620-8c62-4b1b-850e-478ce7583aa1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:04:53.537473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5f4dd620-8c62-4b1b-850e-478ce7583aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:53.586723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:53.645936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dd620-8c62-4b1b-850e-478ce7583aa1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:04:53.723283 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a176e-8873-464a-bcef-a61f687b9a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:04:53.723891 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a176e-8873-464a-bcef-a61f687b9a99 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:53.724161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a176e-8873-464a-bcef-a61f687b9a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:53.724459 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a176e-8873-464a-bcef-a61f687b9a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:53.726060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-db8a176e-8873-464a-bcef-a61f687b9a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:53.824856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:53.841914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a176e-8873-464a-bcef-a61f687b9a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:04:53.843412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a176e-8873-464a-bcef-a61f687b9a99 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:04:53.861380 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 681/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:04:56.426911 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f9c4-9a67-44d8-b8c7-cf21ab38cafa None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:56.427536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f9c4-9a67-44d8-b8c7-cf21ab38cafa None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:56.427536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f9c4-9a67-44d8-b8c7-cf21ab38cafa None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:56.428844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 663/1344] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:04:56.434531 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12ac8-116b-40a2-ad31-a6e4106c1624 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:56.435066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12ac8-116b-40a2-ad31-a6e4106c1624 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:56.435066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12ac8-116b-40a2-ad31-a6e4106c1624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:56.507079 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-40e12ac8-116b-40a2-ad31-a6e4106c1624 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:04:56.508323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-40e12ac8-116b-40a2-ad31-a6e4106c1624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:56.609842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 682/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:04:56.891172 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f9c4-9a67-44d8-b8c7-cf21ab38cafa None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:04:56.892819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-42c1f9c4-9a67-44d8-b8c7-cf21ab38cafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:56.985149 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:57.004076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f9c4-9a67-44d8-b8c7-cf21ab38cafa None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:04:57.087333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52623680-f537-4836-bb67-16548321fac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:04:57.087956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52623680-f537-4836-bb67-16548321fac6 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:04:57.088230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52623680-f537-4836-bb67-16548321fac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:04:57.088533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52623680-f537-4836-bb67-16548321fac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:04:57.090215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-52623680-f537-4836-bb67-16548321fac6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:04:57.211683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52623680-f537-4836-bb67-16548321fac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:04:57.213118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52623680-f537-4836-bb67-16548321fac6 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:04:57.232207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 664/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:04:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:01.130338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466bba-c9eb-437f-a903-4314139d0e4c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:01.130824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466bba-c9eb-437f-a903-4314139d0e4c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:01.130932 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466bba-c9eb-437f-a903-4314139d0e4c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:01.137281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 683/1347] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:01.138463 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e45cd6-040e-425e-876c-28ec033ee52c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:01.138908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e45cd6-040e-425e-876c-28ec033ee52c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:01.138908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e45cd6-040e-425e-876c-28ec033ee52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:01.157646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:01.221478 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b5e45cd6-040e-425e-876c-28ec033ee52c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:01.222753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b5e45cd6-040e-425e-876c-28ec033ee52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:01.348323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 665/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:01.619191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd466bba-c9eb-437f-a903-4314139d0e4c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:01.620812 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bd466bba-c9eb-437f-a903-4314139d0e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:01.683234 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:01.731411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd466bba-c9eb-437f-a903-4314139d0e4c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:01.807344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddeb567-d508-4b07-89e4-b35407b56962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:01.807872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddeb567-d508-4b07-89e4-b35407b56962 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:01.808147 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddeb567-d508-4b07-89e4-b35407b56962 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:01.808439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddeb567-d508-4b07-89e4-b35407b56962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:01.810031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cddeb567-d508-4b07-89e4-b35407b56962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:01.928900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:01.932100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddeb567-d508-4b07-89e4-b35407b56962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:01.934050 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddeb567-d508-4b07-89e4-b35407b56962 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:01.952988 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 684/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:06.821246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318f8ab-766f-468b-9334-4ed144b84e72 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:06.821699 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318f8ab-766f-468b-9334-4ed144b84e72 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:06.821799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318f8ab-766f-468b-9334-4ed144b84e72 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:06.823460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 666/1350] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 6 01:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:06.833109 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae4be-d40f-448c-b642-a8c962f5bca0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:06.833906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae4be-d40f-448c-b642-a8c962f5bca0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:06.834307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae4be-d40f-448c-b642-a8c962f5bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:06.929880 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-11fae4be-d40f-448c-b642-a8c962f5bca0 None None] MFA Rules not processed for user `1823402195ab4e89aa865967afc62b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:06.931085 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-11fae4be-d40f-448c-b642-a8c962f5bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:07.109260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 685/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 6 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:11.337378 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=59 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:11.348569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83103a-226a-4a0d-9d5f-d20403640fab None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:11.348569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83103a-226a-4a0d-9d5f-d20403640fab None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:11.348569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83103a-226a-4a0d-9d5f-d20403640fab None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:11.349930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 667/1352] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 6 01:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:11.355033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa7087-bc4d-4457-bfb0-0fba7740f1f3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:11.355794 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa7087-bc4d-4457-bfb0-0fba7740f1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:11.355794 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa7087-bc4d-4457-bfb0-0fba7740f1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:11.418432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:11.445878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c2aa7087-bc4d-4457-bfb0-0fba7740f1f3 None None] MFA Rules not processed for user `1823402195ab4e89aa865967afc62b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:11.447102 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c2aa7087-bc4d-4457-bfb0-0fba7740f1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:11.574058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 686/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 6 01:05:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:12.745800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c605ff-e778-4430-bce2-d183e06623d7 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:12.746335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c605ff-e778-4430-bce2-d183e06623d7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:12.746335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c605ff-e778-4430-bce2-d183e06623d7 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:12.747883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 668/1354] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 6 01:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:12.753353 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a031e69-72d9-40c4-a3b5-57d5c2ee836f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:12.754148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a031e69-72d9-40c4-a3b5-57d5c2ee836f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:12.754421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a031e69-72d9-40c4-a3b5-57d5c2ee836f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:12.834295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2a031e69-72d9-40c4-a3b5-57d5c2ee836f None None] MFA Rules not processed for user `1823402195ab4e89aa865967afc62b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:12.835499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2a031e69-72d9-40c4-a3b5-57d5c2ee836f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:12.878801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:12.947269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 687/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 6 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:16.256993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6e617-5b13-49ee-aa9f-3d541c4aa7fb None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:16.257584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6e617-5b13-49ee-aa9f-3d541c4aa7fb None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:16.257584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6e617-5b13-49ee-aa9f-3d541c4aa7fb None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:16.258887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 669/1356] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:16.264264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab512bd2-d37b-461a-846c-b1b376f8940f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:16.264752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab512bd2-d37b-461a-846c-b1b376f8940f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:16.264834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab512bd2-d37b-461a-846c-b1b376f8940f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:16.339247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ab512bd2-d37b-461a-846c-b1b376f8940f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:16.339247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ab512bd2-d37b-461a-846c-b1b376f8940f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:16.460639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 688/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:16.758542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889932ba-c379-47f7-a3a2-dee25973863b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:16.758835 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889932ba-c379-47f7-a3a2-dee25973863b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:16.759117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889932ba-c379-47f7-a3a2-dee25973863b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:16.760543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 670/1358] 10.222.0.25 () {54 vars in 962 bytes} [Tue Sep 6 01:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:16.771106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a821-fec3-4bdd-9445-d6c73395e8d7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:16.771524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a821-fec3-4bdd-9445-d6c73395e8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:16.772513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a821-fec3-4bdd-9445-d6c73395e8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:16.793527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:16.866961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f162a821-fec3-4bdd-9445-d6c73395e8d7 None None] MFA Rules not processed for user `42b9c25e98fe4b1bbc33a601d4150071`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:16.868597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f162a821-fec3-4bdd-9445-d6c73395e8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:17.004142 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 689/1359] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Sep 6 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:17.012116 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889932ba-c379-47f7-a3a2-dee25973863b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:17.013703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-889932ba-c379-47f7-a3a2-dee25973863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:17.205669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889932ba-c379-47f7-a3a2-dee25973863b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:17.291517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:17.341595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb9b12-f6d4-47a1-93d6-cb51c7623f93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:17.342214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb9b12-f6d4-47a1-93d6-cb51c7623f93 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:17.342488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb9b12-f6d4-47a1-93d6-cb51c7623f93 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:17.342759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb9b12-f6d4-47a1-93d6-cb51c7623f93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:17.344420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1bbb9b12-f6d4-47a1-93d6-cb51c7623f93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:17.436851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb9b12-f6d4-47a1-93d6-cb51c7623f93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:17.438517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb9b12-f6d4-47a1-93d6-cb51c7623f93 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:17.457484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 671/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:19.553765 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ed0b7-97c4-4a87-9ce7-0bfc4d638e4c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:19.553765 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ed0b7-97c4-4a87-9ce7-0bfc4d638e4c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:19.554655 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ed0b7-97c4-4a87-9ce7-0bfc4d638e4c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:19.559770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 690/1361] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:19.561762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9426-731c-4f26-b22d-0ca16fd4b072 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:19.562184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9426-731c-4f26-b22d-0ca16fd4b072 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:19.562184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9426-731c-4f26-b22d-0ca16fd4b072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:19.647342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d5ea9426-731c-4f26-b22d-0ca16fd4b072 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:19.648804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d5ea9426-731c-4f26-b22d-0ca16fd4b072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:19.691095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:19.760762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 672/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:20.062419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ed0b7-97c4-4a87-9ce7-0bfc4d638e4c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:20.064065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-040ed0b7-97c4-4a87-9ce7-0bfc4d638e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:20.136459 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:20.222614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ed0b7-97c4-4a87-9ce7-0bfc4d638e4c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:20.345890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37abff9-4715-4f10-b051-476164f25fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:20.346729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37abff9-4715-4f10-b051-476164f25fa7 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:20.347037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37abff9-4715-4f10-b051-476164f25fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:20.347309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37abff9-4715-4f10-b051-476164f25fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:20.349051 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d37abff9-4715-4f10-b051-476164f25fa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:20.376459 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:20.457148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37abff9-4715-4f10-b051-476164f25fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:20.458787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37abff9-4715-4f10-b051-476164f25fa7 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:20.492478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 691/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:22.713998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2250103-f234-43f3-938a-21cd8328b3fd None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:22.714558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2250103-f234-43f3-938a-21cd8328b3fd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:22.714558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2250103-f234-43f3-938a-21cd8328b3fd None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:22.715909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 673/1364] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:05:22.721957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12baabfc-cc35-4ea3-9881-3ba353e38d9e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:22.722454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12baabfc-cc35-4ea3-9881-3ba353e38d9e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:22.722592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12baabfc-cc35-4ea3-9881-3ba353e38d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:22.793856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-12baabfc-cc35-4ea3-9881-3ba353e38d9e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:22.795083 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-12baabfc-cc35-4ea3-9881-3ba353e38d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:22.898340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:22.901528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 692/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:23.197351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6786fa-fced-49a4-93f6-25d1d4a49664 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:23.197666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6786fa-fced-49a4-93f6-25d1d4a49664 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:23.197875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6786fa-fced-49a4-93f6-25d1d4a49664 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:23.199501 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 674/1366] 10.222.0.25 () {54 vars in 962 bytes} [Tue Sep 6 01:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:23.205115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b614f-23fe-43e5-b1a6-5b23d6b3cad7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:23.205499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b614f-23fe-43e5-b1a6-5b23d6b3cad7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:23.205895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b614f-23fe-43e5-b1a6-5b23d6b3cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:23.286780 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-147b614f-23fe-43e5-b1a6-5b23d6b3cad7 None None] MFA Rules not processed for user `42b9c25e98fe4b1bbc33a601d4150071`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:23.288176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-147b614f-23fe-43e5-b1a6-5b23d6b3cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:23.416016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 693/1367] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Sep 6 01:05:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:23.424701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6786fa-fced-49a4-93f6-25d1d4a49664 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:23.426346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2f6786fa-fced-49a4-93f6-25d1d4a49664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:23.584747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6786fa-fced-49a4-93f6-25d1d4a49664 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:23.610027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:23.711871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d9d17-1182-46ce-bb24-1c5c143e7ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:23.712639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d9d17-1182-46ce-bb24-1c5c143e7ac9 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:23.713017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d9d17-1182-46ce-bb24-1c5c143e7ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:23.713389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d9d17-1182-46ce-bb24-1c5c143e7ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:23.715111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1d2d9d17-1182-46ce-bb24-1c5c143e7ac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:23.809548 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d9d17-1182-46ce-bb24-1c5c143e7ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:23.811561 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d9d17-1182-46ce-bb24-1c5c143e7ac9 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:23.833250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 675/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:05:24.419170 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ccf72-751e-49b7-8611-98a388bbdd1c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:24.419735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ccf72-751e-49b7-8611-98a388bbdd1c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:24.419735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ccf72-751e-49b7-8611-98a388bbdd1c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:24.421004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 694/1369] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:24.426623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48c407-305b-4846-b80c-32890825e960 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:24.426973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48c407-305b-4846-b80c-32890825e960 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:24.427313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48c407-305b-4846-b80c-32890825e960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:24.461038 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:24.499387 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9a48c407-305b-4846-b80c-32890825e960 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:24.500659 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9a48c407-305b-4846-b80c-32890825e960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:24.601646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 676/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:25.180470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97919b-2eea-48c2-8737-13ac9ebbad7a None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:25.180470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97919b-2eea-48c2-8737-13ac9ebbad7a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:25.180470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97919b-2eea-48c2-8737-13ac9ebbad7a None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:25.182284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 695/1371] 10.222.0.25 () {54 vars in 964 bytes} [Tue Sep 6 01:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:25.186826 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625841fd-01c5-4132-9ec3-3ec0e508cea9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:25.187408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625841fd-01c5-4132-9ec3-3ec0e508cea9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:25.187691 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625841fd-01c5-4132-9ec3-3ec0e508cea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:25.273157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-625841fd-01c5-4132-9ec3-3ec0e508cea9 None None] MFA Rules not processed for user `eae9814386a444678a292becdfe07332`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:25.274371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-625841fd-01c5-4132-9ec3-3ec0e508cea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:25.322257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:25.354210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 677/1372] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Sep 6 01:05:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:25.363028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97919b-2eea-48c2-8737-13ac9ebbad7a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:25.364590 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bc97919b-2eea-48c2-8737-13ac9ebbad7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:25.419773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:25.474683 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97919b-2eea-48c2-8737-13ac9ebbad7a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:25.560826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cdf03-87cf-4225-a88c-03733ab7716f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:25.561690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cdf03-87cf-4225-a88c-03733ab7716f service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:25.562180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cdf03-87cf-4225-a88c-03733ab7716f service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:25.562634 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cdf03-87cf-4225-a88c-03733ab7716f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:25.565735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-359cdf03-87cf-4225-a88c-03733ab7716f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:25.700466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:25.718833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cdf03-87cf-4225-a88c-03733ab7716f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:25.720813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cdf03-87cf-4225-a88c-03733ab7716f service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:25.740692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 696/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:25.796886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee5351-9a3a-46af-9d1a-1f69966a435c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:25.796886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee5351-9a3a-46af-9d1a-1f69966a435c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:25.796886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee5351-9a3a-46af-9d1a-1f69966a435c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:25.797844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 678/1374] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:25.804182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808eb79-73cc-4d67-b980-91ca3aba4dd4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:25.804768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808eb79-73cc-4d67-b980-91ca3aba4dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:25.805197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808eb79-73cc-4d67-b980-91ca3aba4dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:25.899181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1808eb79-73cc-4d67-b980-91ca3aba4dd4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:25.900418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1808eb79-73cc-4d67-b980-91ca3aba4dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:25.999353 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 697/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:26.283291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee5351-9a3a-46af-9d1a-1f69966a435c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:26.284831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c7ee5351-9a3a-46af-9d1a-1f69966a435c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:26.440711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee5351-9a3a-46af-9d1a-1f69966a435c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:26.494562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:26.559257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed96a4-ce52-41cd-8ef0-f3aa14e0620b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:26.559803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed96a4-ce52-41cd-8ef0-f3aa14e0620b service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:26.560062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed96a4-ce52-41cd-8ef0-f3aa14e0620b service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:26.560334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed96a4-ce52-41cd-8ef0-f3aa14e0620b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:26.561966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f5ed96a4-ce52-41cd-8ef0-f3aa14e0620b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:26.653640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed96a4-ce52-41cd-8ef0-f3aa14e0620b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:26.655321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed96a4-ce52-41cd-8ef0-f3aa14e0620b service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:26.673996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 679/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:28.607868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cea9b8-ca7e-4a32-8c5a-64fbec7cca84 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:28.608534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cea9b8-ca7e-4a32-8c5a-64fbec7cca84 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:28.608534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cea9b8-ca7e-4a32-8c5a-64fbec7cca84 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:28.609822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 698/1377] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:28.615704 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219273e-a605-4276-ab90-cb9e58bd5b04 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:28.616130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219273e-a605-4276-ab90-cb9e58bd5b04 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:28.616234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219273e-a605-4276-ab90-cb9e58bd5b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:28.687765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3219273e-a605-4276-ab90-cb9e58bd5b04 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:28.689229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3219273e-a605-4276-ab90-cb9e58bd5b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:28.702568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:28.815169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 680/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:29.098518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cea9b8-ca7e-4a32-8c5a-64fbec7cca84 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:29.100086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-36cea9b8-ca7e-4a32-8c5a-64fbec7cca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:29.177685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:29.304052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cea9b8-ca7e-4a32-8c5a-64fbec7cca84 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:29.440216 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d813ee-a8f4-4398-9cb4-a2722775ea8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:29.441037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d813ee-a8f4-4398-9cb4-a2722775ea8b service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:29.441421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d813ee-a8f4-4398-9cb4-a2722775ea8b service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:29.441780 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d813ee-a8f4-4398-9cb4-a2722775ea8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:29.444673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e0d813ee-a8f4-4398-9cb4-a2722775ea8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:29.466655 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:29.542166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d813ee-a8f4-4398-9cb4-a2722775ea8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:29.543891 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d813ee-a8f4-4398-9cb4-a2722775ea8b service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:29.563142 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 699/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:31.508069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1ffbd-ab88-4561-8a13-1c26bab6c414 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:31.508669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1ffbd-ab88-4561-8a13-1c26bab6c414 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:31.508669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1ffbd-ab88-4561-8a13-1c26bab6c414 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:31.509975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 681/1380] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:31.515271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24055f-033b-4f70-b92c-007c8aa2cc63 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:31.515675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24055f-033b-4f70-b92c-007c8aa2cc63 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:31.515973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24055f-033b-4f70-b92c-007c8aa2cc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:31.589262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4c24055f-033b-4f70-b92c-007c8aa2cc63 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:31.590471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4c24055f-033b-4f70-b92c-007c8aa2cc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:31.685137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:31.692747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 700/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:31.982809 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1ffbd-ab88-4561-8a13-1c26bab6c414 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:31.984346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4ad1ffbd-ab88-4561-8a13-1c26bab6c414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:32.143548 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:32.155845 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1ffbd-ab88-4561-8a13-1c26bab6c414 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:32.290504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7ee3c-d210-4148-892c-fd795d687642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:32.291104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7ee3c-d210-4148-892c-fd795d687642 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:32.291368 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7ee3c-d210-4148-892c-fd795d687642 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:32.291652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7ee3c-d210-4148-892c-fd795d687642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:32.293277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-13a7ee3c-d210-4148-892c-fd795d687642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:32.390117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7ee3c-d210-4148-892c-fd795d687642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:32.391876 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7ee3c-d210-4148-892c-fd795d687642 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:32.403212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:32.413225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 682/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:34.676486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ecfef-d036-4446-baed-cac02b5e5416 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:34.677106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ecfef-d036-4446-baed-cac02b5e5416 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:34.677106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ecfef-d036-4446-baed-cac02b5e5416 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:34.678458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 701/1383] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:34.684331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932db9f-c2f7-438d-aea5-cad5ad43b1ff None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:34.684798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932db9f-c2f7-438d-aea5-cad5ad43b1ff None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:34.684893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932db9f-c2f7-438d-aea5-cad5ad43b1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:34.756032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-5932db9f-c2f7-438d-aea5-cad5ad43b1ff None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:34.757313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5932db9f-c2f7-438d-aea5-cad5ad43b1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:34.864679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 683/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:35.232177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ecfef-d036-4446-baed-cac02b5e5416 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:35.234267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-db9ecfef-d036-4446-baed-cac02b5e5416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:35.394410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ecfef-d036-4446-baed-cac02b5e5416 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:35.477682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:35.530637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c4049-b09a-4ab9-a52e-2ccb1e24e54a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:35.531275 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c4049-b09a-4ab9-a52e-2ccb1e24e54a service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:35.531545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c4049-b09a-4ab9-a52e-2ccb1e24e54a service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:35.532079 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c4049-b09a-4ab9-a52e-2ccb1e24e54a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:35.533581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4f4c4049-b09a-4ab9-a52e-2ccb1e24e54a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:35.633320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c4049-b09a-4ab9-a52e-2ccb1e24e54a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:35.635479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c4049-b09a-4ab9-a52e-2ccb1e24e54a service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:35.658837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 702/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:37.571623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468de255-12a1-4f40-8e4d-eff7539ef27f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:37.572186 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468de255-12a1-4f40-8e4d-eff7539ef27f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:37.572186 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468de255-12a1-4f40-8e4d-eff7539ef27f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:37.573658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 684/1386] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:37.579779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479b96d-6b0d-40e4-91fc-25afaa17fa4b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:37.580526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479b96d-6b0d-40e4-91fc-25afaa17fa4b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:37.580526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479b96d-6b0d-40e4-91fc-25afaa17fa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:37.651415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5479b96d-6b0d-40e4-91fc-25afaa17fa4b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:37.652699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5479b96d-6b0d-40e4-91fc-25afaa17fa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:37.687515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:37.757488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 703/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:38.044795 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468de255-12a1-4f40-8e4d-eff7539ef27f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:38.046356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-468de255-12a1-4f40-8e4d-eff7539ef27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:38.124276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:38.209245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468de255-12a1-4f40-8e4d-eff7539ef27f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:38.343103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f25a0e-5b0f-4141-891d-c8b6ef0004d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:38.343783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f25a0e-5b0f-4141-891d-c8b6ef0004d2 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:38.344056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f25a0e-5b0f-4141-891d-c8b6ef0004d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:38.344582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f25a0e-5b0f-4141-891d-c8b6ef0004d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:38.346202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-62f25a0e-5b0f-4141-891d-c8b6ef0004d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:38.386250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:38.441638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f25a0e-5b0f-4141-891d-c8b6ef0004d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:38.443312 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f25a0e-5b0f-4141-891d-c8b6ef0004d2 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:38.462886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 685/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:40.503071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d7cff-e71b-44ea-83be-563fa6eb5125 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:40.503651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d7cff-e71b-44ea-83be-563fa6eb5125 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:40.503953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d7cff-e71b-44ea-83be-563fa6eb5125 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:40.505368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 704/1389] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:40.516146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436812e-e36e-4af3-8ef4-cfd827dbcbae None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:40.516806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436812e-e36e-4af3-8ef4-cfd827dbcbae None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:40.516806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436812e-e36e-4af3-8ef4-cfd827dbcbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:40.605528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9436812e-e36e-4af3-8ef4-cfd827dbcbae None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:40.606794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9436812e-e36e-4af3-8ef4-cfd827dbcbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:40.718651 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 686/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:40.738069 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6750355-a294-4c69-b11a-d5bce8c61724 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:40.738364 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6750355-a294-4c69-b11a-d5bce8c61724 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:40.738638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6750355-a294-4c69-b11a-d5bce8c61724 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:40.739990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 705/1391] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:40.745929 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2ad98-99e4-4a17-9deb-353a7625d683 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:40.746423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2ad98-99e4-4a17-9deb-353a7625d683 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:40.746706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2ad98-99e4-4a17-9deb-353a7625d683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:40.768527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:40.837347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a2f2ad98-99e4-4a17-9deb-353a7625d683 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:40.838758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a2f2ad98-99e4-4a17-9deb-353a7625d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:40.939635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 687/1392] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:41.015276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6750355-a294-4c69-b11a-d5bce8c61724 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:41.016870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f6750355-a294-4c69-b11a-d5bce8c61724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:41.166100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6750355-a294-4c69-b11a-d5bce8c61724 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:41.183423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:41.239208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982746d-3eeb-4ca1-a1be-33a4a75c6b3a None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:41.239585 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982746d-3eeb-4ca1-a1be-33a4a75c6b3a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:41.239922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982746d-3eeb-4ca1-a1be-33a4a75c6b3a None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:41.241413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 688/1393] 10.222.0.25 () {54 vars in 961 bytes} [Tue Sep 6 01:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:05:41.246346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2450e3-78fd-46c9-886f-891dedfd5378 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:41.246620 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2450e3-78fd-46c9-886f-891dedfd5378 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:41.246886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2450e3-78fd-46c9-886f-891dedfd5378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:41.285465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39a7e4-aea8-40d2-8a45-51768747b6f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:41.286053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39a7e4-aea8-40d2-8a45-51768747b6f1 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:41.286328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39a7e4-aea8-40d2-8a45-51768747b6f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:41.286591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39a7e4-aea8-40d2-8a45-51768747b6f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:41.288221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0c39a7e4-aea8-40d2-8a45-51768747b6f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:41.332520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7c2450e3-78fd-46c9-886f-891dedfd5378 None None] MFA Rules not processed for user `31ebbadd69da4bc6ad25b5c882962ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:41.333645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7c2450e3-78fd-46c9-886f-891dedfd5378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:41.368374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:41.383390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39a7e4-aea8-40d2-8a45-51768747b6f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:41.385745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39a7e4-aea8-40d2-8a45-51768747b6f1 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:41.404305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 706/1394] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:41.414135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 689/1395] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Sep 6 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:41.422263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39a7e4-aea8-40d2-8a45-51768747b6f1 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:41.423664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0c39a7e4-aea8-40d2-8a45-51768747b6f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:41.446934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:41.508660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39a7e4-aea8-40d2-8a45-51768747b6f1 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:41.599441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bd098-5f7b-4f01-ae80-f5bd2b7a9ab4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31ebbadd69da4bc6ad25b5c882962ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:41.600012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd098-5f7b-4f01-ae80-f5bd2b7a9ab4 service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:41.600280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd098-5f7b-4f01-ae80-f5bd2b7a9ab4 service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:41.600572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd098-5f7b-4f01-ae80-f5bd2b7a9ab4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:41.602254 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5e9bd098-5f7b-4f01-ae80-f5bd2b7a9ab4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:41.706146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:41.719680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bd098-5f7b-4f01-ae80-f5bd2b7a9ab4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:41.721202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bd098-5f7b-4f01-ae80-f5bd2b7a9ab4 service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:41.740167 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 707/1396] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:42.488901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccbf04-8b4b-4818-ba73-41e0a988fac1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:42.489373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccbf04-8b4b-4818-ba73-41e0a988fac1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:42.489373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccbf04-8b4b-4818-ba73-41e0a988fac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:42.558327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-baccbf04-8b4b-4818-ba73-41e0a988fac1 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:42.559647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-baccbf04-8b4b-4818-ba73-41e0a988fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:42.655818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 690/1397] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:05:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:42.712040 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d6e72-8ce2-489b-b90d-32d9342b4d74 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:42.712585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d6e72-8ce2-489b-b90d-32d9342b4d74 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:42.712585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d6e72-8ce2-489b-b90d-32d9342b4d74 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:42.714146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 708/1398] 10.222.0.25 () {54 vars in 943 bytes} [Tue Sep 6 01:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:42.720458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f51031-d395-421d-b405-e1ea7770c627 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:42.720717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f51031-d395-421d-b405-e1ea7770c627 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:42.720993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f51031-d395-421d-b405-e1ea7770c627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:42.782253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:42.802251 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-53f51031-d395-421d-b405-e1ea7770c627 None None] MFA Rules not processed for user `d7e2ea2ab4ae4a14be9bd35af20080c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:42.803479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-53f51031-d395-421d-b405-e1ea7770c627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:42.917161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 691/1399] 10.222.0.25 () {58 vars in 1040 bytes} [Tue Sep 6 01:05:42 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:42.927368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d6e72-8ce2-489b-b90d-32d9342b4d74 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:42.928982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-394d6e72-8ce2-489b-b90d-32d9342b4d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:43.085668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d6e72-8ce2-489b-b90d-32d9342b4d74 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:43.163982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:43.209579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a0970-e155-4279-a2ec-5657debae37c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:43.210191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a0970-e155-4279-a2ec-5657debae37c service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:43.210465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a0970-e155-4279-a2ec-5657debae37c service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:43.210739 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a0970-e155-4279-a2ec-5657debae37c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:43.212428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-922a0970-e155-4279-a2ec-5657debae37c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:43.302161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a0970-e155-4279-a2ec-5657debae37c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:43.303726 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a0970-e155-4279-a2ec-5657debae37c service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:43.312319 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 709/1400] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:05:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:05:43.346627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fdfbc-2158-4644-84b4-0bba86f2f44c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:43.346939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fdfbc-2158-4644-84b4-0bba86f2f44c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:43.347187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fdfbc-2158-4644-84b4-0bba86f2f44c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:43.348613 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 692/1401] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:43.354415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d058f-3385-4b74-8ed4-59e4c5660039 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:43.354508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d058f-3385-4b74-8ed4-59e4c5660039 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:43.354833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d058f-3385-4b74-8ed4-59e4c5660039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:43.431674 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c86d058f-3385-4b74-8ed4-59e4c5660039 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:43.431674 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c86d058f-3385-4b74-8ed4-59e4c5660039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:43.495187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:43.547831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 710/1402] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:43.849931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fdfbc-2158-4644-84b4-0bba86f2f44c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:43.849931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2d4fdfbc-2158-4644-84b4-0bba86f2f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:43.971764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:44.018379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fdfbc-2158-4644-84b4-0bba86f2f44c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:44.147840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0eb29-9d09-467e-a07a-83029f89e9a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:44.148394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0eb29-9d09-467e-a07a-83029f89e9a0 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:44.148669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0eb29-9d09-467e-a07a-83029f89e9a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:44.148934 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0eb29-9d09-467e-a07a-83029f89e9a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:44.150536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0cf0eb29-9d09-467e-a07a-83029f89e9a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:44.227200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:44.250371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0eb29-9d09-467e-a07a-83029f89e9a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:44.252165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0eb29-9d09-467e-a07a-83029f89e9a0 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:44.271630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 693/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:46.213432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578df7d-ebde-4e4a-88df-73a508ea6f6d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:46.213988 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578df7d-ebde-4e4a-88df-73a508ea6f6d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:46.213988 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578df7d-ebde-4e4a-88df-73a508ea6f6d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:46.215581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 711/1404] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:46.220904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de18c4d-2e59-4555-9485-1303bdf192df None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:46.221413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de18c4d-2e59-4555-9485-1303bdf192df None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:46.221514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de18c4d-2e59-4555-9485-1303bdf192df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:46.297886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0de18c4d-2e59-4555-9485-1303bdf192df None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:46.299543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0de18c4d-2e59-4555-9485-1303bdf192df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:46.412452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 694/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:05:46.724151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578df7d-ebde-4e4a-88df-73a508ea6f6d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:46.725782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b578df7d-ebde-4e4a-88df-73a508ea6f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:46.886553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578df7d-ebde-4e4a-88df-73a508ea6f6d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:46.928208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:47.006858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e4ac2-c82c-4334-a49d-bdc94b0905b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:47.007562 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e4ac2-c82c-4334-a49d-bdc94b0905b4 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:47.007897 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e4ac2-c82c-4334-a49d-bdc94b0905b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:47.008255 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e4ac2-c82c-4334-a49d-bdc94b0905b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:47.009981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d94e4ac2-c82c-4334-a49d-bdc94b0905b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:47.114550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e4ac2-c82c-4334-a49d-bdc94b0905b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:47.116551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e4ac2-c82c-4334-a49d-bdc94b0905b4 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:47.138541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 712/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:49.095952 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a78f6-7c27-4977-a7b3-05194f96941b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:49.096584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a78f6-7c27-4977-a7b3-05194f96941b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:49.096584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a78f6-7c27-4977-a7b3-05194f96941b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:49.098018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 695/1407] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:05:49.103236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39100ce-fb9e-42d5-8554-8fabe1ba617b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:49.103692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39100ce-fb9e-42d5-8554-8fabe1ba617b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:49.103793 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39100ce-fb9e-42d5-8554-8fabe1ba617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:49.158985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:49.178593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c39100ce-fb9e-42d5-8554-8fabe1ba617b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:05:49.179812 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c39100ce-fb9e-42d5-8554-8fabe1ba617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:49.290799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 713/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:05:49.605368 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a78f6-7c27-4977-a7b3-05194f96941b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:05:49.606976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6a0a78f6-7c27-4977-a7b3-05194f96941b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:49.670381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:49.797459 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a78f6-7c27-4977-a7b3-05194f96941b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:05:49.927949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3058d0-8e68-4c2b-84b3-b37f4df46c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:05:49.928587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3058d0-8e68-4c2b-84b3-b37f4df46c96 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:05:49.928855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3058d0-8e68-4c2b-84b3-b37f4df46c96 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:05:49.929131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3058d0-8e68-4c2b-84b3-b37f4df46c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:05:49.930712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0e3058d0-8e68-4c2b-84b3-b37f4df46c96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:05:49.940212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:50.037335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3058d0-8e68-4c2b-84b3-b37f4df46c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:05:50.038993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3058d0-8e68-4c2b-84b3-b37f4df46c96 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:05:50.059793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 696/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:59.288355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=46 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:00.057346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=41 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:05.040112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edf428-3ebe-4eec-8262-a8fa1aec75bf None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:05.040784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edf428-3ebe-4eec-8262-a8fa1aec75bf None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:05.040784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edf428-3ebe-4eec-8262-a8fa1aec75bf None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:05.042013 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 714/1410] 10.222.0.25 () {54 vars in 918 bytes} [Tue Sep 6 01:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:05.047639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d586add-c4a0-42a4-8f7a-4f33e4e16154 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:05.048166 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d586add-c4a0-42a4-8f7a-4f33e4e16154 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:05.048166 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d586add-c4a0-42a4-8f7a-4f33e4e16154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:05.126546 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3d586add-c4a0-42a4-8f7a-4f33e4e16154 None None] MFA Rules not processed for user `1823402195ab4e89aa865967afc62b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:05.127749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3d586add-c4a0-42a4-8f7a-4f33e4e16154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:05.255826 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 697/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Sep 6 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:05.271135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d48667-0819-47dd-a817-f8d41fd2063f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:05.271416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d48667-0819-47dd-a817-f8d41fd2063f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:05.271699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d48667-0819-47dd-a817-f8d41fd2063f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:05.273041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 715/1412] 10.222.0.25 () {54 vars in 918 bytes} [Tue Sep 6 01:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:05.278136 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461525e-94b1-438f-8534-8cf4b8531a6b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:05.278454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461525e-94b1-438f-8534-8cf4b8531a6b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:05.278788 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461525e-94b1-438f-8534-8cf4b8531a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:05.363521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:05.366683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a461525e-94b1-438f-8534-8cf4b8531a6b None None] MFA Rules not processed for user `42b9c25e98fe4b1bbc33a601d4150071`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:05.368507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a461525e-94b1-438f-8534-8cf4b8531a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:05.491286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 698/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Sep 6 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:07.849590 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eee289-35cb-4c69-ac31-6fec89b013d5 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:07.850130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eee289-35cb-4c69-ac31-6fec89b013d5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:07.850130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eee289-35cb-4c69-ac31-6fec89b013d5 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:07.851354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:07.858450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fa0cc-7417-436b-972d-88ee74021370 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:07.859182 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fa0cc-7417-436b-972d-88ee74021370 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:07.859309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fa0cc-7417-436b-972d-88ee74021370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:07.941107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4b6fa0cc-7417-436b-972d-88ee74021370 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:07.942320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4b6fa0cc-7417-436b-972d-88ee74021370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:08.000581 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:08.049081 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:08.339990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eee289-35cb-4c69-ac31-6fec89b013d5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:08.341659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-92eee289-35cb-4c69-ac31-6fec89b013d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:08.490568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eee289-35cb-4c69-ac31-6fec89b013d5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:08.567700 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:08.621123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8889a-b367-494c-b865-7dd73dfdce24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:08.621771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8889a-b367-494c-b865-7dd73dfdce24 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:08.622046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8889a-b367-494c-b865-7dd73dfdce24 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:08.622309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8889a-b367-494c-b865-7dd73dfdce24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:08.624755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2da8889a-b367-494c-b865-7dd73dfdce24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:08.728941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8889a-b367-494c-b865-7dd73dfdce24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:08.730588 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8889a-b367-494c-b865-7dd73dfdce24 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:08.749914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 717/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:09.655628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e92d3-1d24-4749-a8dd-530874c6273d None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:09.656214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e92d3-1d24-4749-a8dd-530874c6273d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:09.656214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e92d3-1d24-4749-a8dd-530874c6273d None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:09.657708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 01:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:09.663835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd963aa6-216a-4ce5-a7af-a91178fb6efa None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:09.664606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd963aa6-216a-4ce5-a7af-a91178fb6efa None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:09.664810 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd963aa6-216a-4ce5-a7af-a91178fb6efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:09.748489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bd963aa6-216a-4ce5-a7af-a91178fb6efa None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:09.749705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bd963aa6-216a-4ce5-a7af-a91178fb6efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:09.777556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:09.858121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 01:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:10.013225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e92d3-1d24-4749-a8dd-530874c6273d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:10.015619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c56e92d3-1d24-4749-a8dd-530874c6273d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:10.177871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e92d3-1d24-4749-a8dd-530874c6273d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:10.217730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:10.303017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d0f3b-a672-45bc-88bd-204acb7913ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:10.303542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d0f3b-a672-45bc-88bd-204acb7913ba service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:10.303812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d0f3b-a672-45bc-88bd-204acb7913ba service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:10.304078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d0f3b-a672-45bc-88bd-204acb7913ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:10.305710 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-571d0f3b-a672-45bc-88bd-204acb7913ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:10.407368 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d0f3b-a672-45bc-88bd-204acb7913ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:10.409043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d0f3b-a672-45bc-88bd-204acb7913ba service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:10.428332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 701/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:11.331606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72a392-76b7-4a7f-afcd-1eb7220373b0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:11.332205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72a392-76b7-4a7f-afcd-1eb7220373b0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:11.332205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72a392-76b7-4a7f-afcd-1eb7220373b0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:11.333439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 01:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:11.338648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79555a-cfa6-46cb-af55-9ede777f2c2d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:11.339102 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79555a-cfa6-46cb-af55-9ede777f2c2d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:11.339197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79555a-cfa6-46cb-af55-9ede777f2c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:11.399064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:11.424919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6c79555a-cfa6-46cb-af55-9ede777f2c2d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:11.426144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6c79555a-cfa6-46cb-af55-9ede777f2c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:11.529189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 01:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:11.684385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72a392-76b7-4a7f-afcd-1eb7220373b0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:11.686767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fb72a392-76b7-4a7f-afcd-1eb7220373b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:11.860900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72a392-76b7-4a7f-afcd-1eb7220373b0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:11.873596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:11.983097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cd326-b224-4018-b47d-84a4f76a19a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:11.983616 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cd326-b224-4018-b47d-84a4f76a19a0 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:11.983890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cd326-b224-4018-b47d-84a4f76a19a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:11.984150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cd326-b224-4018-b47d-84a4f76a19a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:11.986235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fa7cd326-b224-4018-b47d-84a4f76a19a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:12.084028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cd326-b224-4018-b47d-84a4f76a19a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:12.085725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cd326-b224-4018-b47d-84a4f76a19a0 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:12.104223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 720/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:12.973881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f0d95-95dc-4225-a954-d29a8f5080e9 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:12.974520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f0d95-95dc-4225-a954-d29a8f5080e9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:12.974520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f0d95-95dc-4225-a954-d29a8f5080e9 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:12.975810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 01:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:12.981673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073489c0-5637-4331-8fca-637cc6b016f4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:12.982252 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073489c0-5637-4331-8fca-637cc6b016f4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:12.982367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073489c0-5637-4331-8fca-637cc6b016f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:13.003913 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:13.072638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-073489c0-5637-4331-8fca-637cc6b016f4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:13.074397 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-073489c0-5637-4331-8fca-637cc6b016f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:13.178935 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 01:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:13.335755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f0d95-95dc-4225-a954-d29a8f5080e9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:13.338165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a29f0d95-95dc-4225-a954-d29a8f5080e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:13.463764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:13.502408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f0d95-95dc-4225-a954-d29a8f5080e9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:13.624820 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac38596-d430-4dd9-9026-b2cc27758283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:13.625340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac38596-d430-4dd9-9026-b2cc27758283 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:13.625611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac38596-d430-4dd9-9026-b2cc27758283 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:13.625931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac38596-d430-4dd9-9026-b2cc27758283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:13.627528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0ac38596-d430-4dd9-9026-b2cc27758283 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:13.711417 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:13.727040 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac38596-d430-4dd9-9026-b2cc27758283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:13.728743 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac38596-d430-4dd9-9026-b2cc27758283 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:13.748041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 704/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:14.614351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d537ec-e782-4def-9fb9-980a0c6ee79e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:14.615267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d537ec-e782-4def-9fb9-980a0c6ee79e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:14.615267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d537ec-e782-4def-9fb9-980a0c6ee79e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:14.617928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 01:06:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:14.626823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3e3a1-868c-4c91-bf95-4093bc96129a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:14.627286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3e3a1-868c-4c91-bf95-4093bc96129a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:14.627379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3e3a1-868c-4c91-bf95-4093bc96129a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:14.716522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-80d3e3a1-868c-4c91-bf95-4093bc96129a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:14.717766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-80d3e3a1-868c-4c91-bf95-4093bc96129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:14.840730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 01:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:14.999870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d537ec-e782-4def-9fb9-980a0c6ee79e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:15.002245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f0d537ec-e782-4def-9fb9-980a0c6ee79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:15.100653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:15.165910 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d537ec-e782-4def-9fb9-980a0c6ee79e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:15.281381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649755c4-5d25-43a5-bf72-2010c8f3c32d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:15.281994 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649755c4-5d25-43a5-bf72-2010c8f3c32d service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:15.282247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649755c4-5d25-43a5-bf72-2010c8f3c32d service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:15.282539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649755c4-5d25-43a5-bf72-2010c8f3c32d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:15.284160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-649755c4-5d25-43a5-bf72-2010c8f3c32d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:15.338087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:15.384947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649755c4-5d25-43a5-bf72-2010c8f3c32d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:15.386592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649755c4-5d25-43a5-bf72-2010c8f3c32d service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:15.404492 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 723/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:16.206581 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5964d-b7df-46e5-863c-01077ef59353 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:16.207152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5964d-b7df-46e5-863c-01077ef59353 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:16.207152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5964d-b7df-46e5-863c-01077ef59353 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:16.208496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 01:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:16.213678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cecd1-40e3-424f-b720-a2c57cf81ff2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:16.214147 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cecd1-40e3-424f-b720-a2c57cf81ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:16.214246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cecd1-40e3-424f-b720-a2c57cf81ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:16.294924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c87cecd1-40e3-424f-b720-a2c57cf81ff2 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:16.296060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c87cecd1-40e3-424f-b720-a2c57cf81ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:16.403356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 01:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:16.558718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5964d-b7df-46e5-863c-01077ef59353 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:16.561071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cdd5964d-b7df-46e5-863c-01077ef59353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:16.613793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:16.735637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5964d-b7df-46e5-863c-01077ef59353 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:16.853254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cb20d-b0e8-411b-8aa5-6b7684555cd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:16.853782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cb20d-b0e8-411b-8aa5-6b7684555cd0 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:16.854062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cb20d-b0e8-411b-8aa5-6b7684555cd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:16.854331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cb20d-b0e8-411b-8aa5-6b7684555cd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:16.855934 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cb9cb20d-b0e8-411b-8aa5-6b7684555cd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:16.863093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:16.953834 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cb20d-b0e8-411b-8aa5-6b7684555cd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:16.955555 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cb20d-b0e8-411b-8aa5-6b7684555cd0 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:16.976765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 707/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:17.791342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da6ea1-aab4-4362-92ca-0457d177f45f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:17.792062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da6ea1-aab4-4362-92ca-0457d177f45f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:17.792062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da6ea1-aab4-4362-92ca-0457d177f45f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:17.793273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 01:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:17.799311 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4e20f-2698-4f55-9ca6-0d2f387051ef None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:17.800097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4e20f-2698-4f55-9ca6-0d2f387051ef None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:17.800259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4e20f-2698-4f55-9ca6-0d2f387051ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:17.883611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-81c4e20f-2698-4f55-9ca6-0d2f387051ef None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:17.884881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-81c4e20f-2698-4f55-9ca6-0d2f387051ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:17.958409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:17.988913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:18.141726 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da6ea1-aab4-4362-92ca-0457d177f45f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:18.143270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-85da6ea1-aab4-4362-92ca-0457d177f45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:18.163145 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:18.294878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da6ea1-aab4-4362-92ca-0457d177f45f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:18.382618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:18.414273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75828f19-16bd-4789-b6bf-87d392975715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:18.415164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75828f19-16bd-4789-b6bf-87d392975715 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:18.415570 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75828f19-16bd-4789-b6bf-87d392975715 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:18.416013 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75828f19-16bd-4789-b6bf-87d392975715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:18.418631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-75828f19-16bd-4789-b6bf-87d392975715 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:18.519259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75828f19-16bd-4789-b6bf-87d392975715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:18.520946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75828f19-16bd-4789-b6bf-87d392975715 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:18.539246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 726/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:19.348751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6691fc0-44bf-4557-b99d-98359bab2fc5 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:19.349367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6691fc0-44bf-4557-b99d-98359bab2fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:19.349367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6691fc0-44bf-4557-b99d-98359bab2fc5 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:19.350620 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 01:06:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:19.356079 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b428d-859a-4499-a328-f4ebdba81ad8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:19.356535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b428d-859a-4499-a328-f4ebdba81ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:19.356692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b428d-859a-4499-a328-f4ebdba81ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:19.443092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-765b428d-859a-4499-a328-f4ebdba81ad8 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:19.444328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-765b428d-859a-4499-a328-f4ebdba81ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:19.488952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:19.550945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 01:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:19.700427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6691fc0-44bf-4557-b99d-98359bab2fc5 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:19.701903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a6691fc0-44bf-4557-b99d-98359bab2fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:19.868347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6691fc0-44bf-4557-b99d-98359bab2fc5 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:19.926538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:19.989527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c6383-6fdf-46d8-89b1-e3c7dc343be5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:19.990064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c6383-6fdf-46d8-89b1-e3c7dc343be5 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:19.990448 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c6383-6fdf-46d8-89b1-e3c7dc343be5 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:19.990724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c6383-6fdf-46d8-89b1-e3c7dc343be5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:19.992339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a48c6383-6fdf-46d8-89b1-e3c7dc343be5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:20.089606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c6383-6fdf-46d8-89b1-e3c7dc343be5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:20.091253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c6383-6fdf-46d8-89b1-e3c7dc343be5 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:20.110474 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 710/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:20.943259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87585e-eff1-49a1-bc0c-850807dad380 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:20.944180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87585e-eff1-49a1-bc0c-850807dad380 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:20.944180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87585e-eff1-49a1-bc0c-850807dad380 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:20.946205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 01:06:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:20.954187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256f658-7302-4944-ace0-d98bec84dec1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:20.954670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256f658-7302-4944-ace0-d98bec84dec1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:20.954776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256f658-7302-4944-ace0-d98bec84dec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:21.039178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4256f658-7302-4944-ace0-d98bec84dec1 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:21.040463 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4256f658-7302-4944-ace0-d98bec84dec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:21.042739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:21.148319 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 01:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:21.303845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87585e-eff1-49a1-bc0c-850807dad380 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:21.306344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ce87585e-eff1-49a1-bc0c-850807dad380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:21.464543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87585e-eff1-49a1-bc0c-850807dad380 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:21.493045 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:21.586273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6e367-bcf3-45b0-b6b5-fbc024c631df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:21.586804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6e367-bcf3-45b0-b6b5-fbc024c631df service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:21.587080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6e367-bcf3-45b0-b6b5-fbc024c631df service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:21.587348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6e367-bcf3-45b0-b6b5-fbc024c631df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:21.589021 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d6d6e367-bcf3-45b0-b6b5-fbc024c631df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:21.691828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6e367-bcf3-45b0-b6b5-fbc024c631df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:21.693607 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6e367-bcf3-45b0-b6b5-fbc024c631df service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:21.715474 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 729/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:23.545899 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aea448-fab2-4680-a9a3-f8c8b076999b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:23.546538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aea448-fab2-4680-a9a3-f8c8b076999b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:23.546538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aea448-fab2-4680-a9a3-f8c8b076999b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:23.547875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:23.554405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d2ec0-cb0f-443e-a8b1-befd5fab8c44 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:23.555151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d2ec0-cb0f-443e-a8b1-befd5fab8c44 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:23.555307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d2ec0-cb0f-443e-a8b1-befd5fab8c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:23.600114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:23.627368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ef9d2ec0-cb0f-443e-a8b1-befd5fab8c44 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:23.628699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ef9d2ec0-cb0f-443e-a8b1-befd5fab8c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:23.733039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:24.023382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aea448-fab2-4680-a9a3-f8c8b076999b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:24.025062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d7aea448-fab2-4680-a9a3-f8c8b076999b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:24.137138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aea448-fab2-4680-a9a3-f8c8b076999b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:24.170080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:24.215919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46847ed-1efc-4392-8338-0478125a722e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:24.216574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46847ed-1efc-4392-8338-0478125a722e service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:24.216849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46847ed-1efc-4392-8338-0478125a722e service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:24.217118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46847ed-1efc-4392-8338-0478125a722e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:24.218702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a46847ed-1efc-4392-8338-0478125a722e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:24.331856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46847ed-1efc-4392-8338-0478125a722e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:24.333445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46847ed-1efc-4392-8338-0478125a722e service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:24.352103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 713/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:26.438971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7106a-ca28-4108-8ff2-b9813d7a79ec None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:26.439624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7106a-ca28-4108-8ff2-b9813d7a79ec None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:26.439624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7106a-ca28-4108-8ff2-b9813d7a79ec None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:26.441592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:26.447796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc9c8d-101e-49d3-8628-f5479fefe10e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:26.448543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc9c8d-101e-49d3-8628-f5479fefe10e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:26.448696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc9c8d-101e-49d3-8628-f5479fefe10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:26.526176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-19dc9c8d-101e-49d3-8628-f5479fefe10e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:26.527388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-19dc9c8d-101e-49d3-8628-f5479fefe10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:26.540730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:26.642004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:26.925864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7106a-ca28-4108-8ff2-b9813d7a79ec None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:26.928230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-eaf7106a-ca28-4108-8ff2-b9813d7a79ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:27.056172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7106a-ca28-4108-8ff2-b9813d7a79ec None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:27.068832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:27.134346 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8f2c2-42af-4738-af08-e3cf2ce43b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:27.134952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8f2c2-42af-4738-af08-e3cf2ce43b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:27.135229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8f2c2-42af-4738-af08-e3cf2ce43b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:27.135455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8f2c2-42af-4738-af08-e3cf2ce43b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:27.137124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-69d8f2c2-42af-4738-af08-e3cf2ce43b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:27.255141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8f2c2-42af-4738-af08-e3cf2ce43b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:27.256718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8f2c2-42af-4738-af08-e3cf2ce43b26 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:27.277151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 732/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:29.611777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15882a34-a93e-443d-b7e5-156f18459bbc None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:29.612426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15882a34-a93e-443d-b7e5-156f18459bbc None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:29.612426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15882a34-a93e-443d-b7e5-156f18459bbc None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:29.613764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:29.620086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0522c3-1549-4d08-903e-f8fa20bc8ca5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:29.620869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0522c3-1549-4d08-903e-f8fa20bc8ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:29.620981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0522c3-1549-4d08-903e-f8fa20bc8ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:29.673066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:29.696700 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7a0522c3-1549-4d08-903e-f8fa20bc8ca5 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:29.697908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7a0522c3-1549-4d08-903e-f8fa20bc8ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:29.804148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:30.100116 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15882a34-a93e-443d-b7e5-156f18459bbc None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:30.101705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-15882a34-a93e-443d-b7e5-156f18459bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:30.212082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15882a34-a93e-443d-b7e5-156f18459bbc None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:30.254695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:30.289571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd873309-952a-4446-bad4-d31aaf0ff4cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:30.290212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd873309-952a-4446-bad4-d31aaf0ff4cc service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:30.290488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd873309-952a-4446-bad4-d31aaf0ff4cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:30.290758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd873309-952a-4446-bad4-d31aaf0ff4cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:30.292398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fd873309-952a-4446-bad4-d31aaf0ff4cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:30.413552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd873309-952a-4446-bad4-d31aaf0ff4cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:30.415045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd873309-952a-4446-bad4-d31aaf0ff4cc service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:30.434010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 716/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:32.473560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10a276-e752-4991-a226-ad44bf529682 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:32.474476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10a276-e752-4991-a226-ad44bf529682 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:32.474476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10a276-e752-4991-a226-ad44bf529682 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:32.476601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:06:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:32.485904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd8be9-8501-4f9e-bb68-c3dbd6c33b35 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:32.486347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd8be9-8501-4f9e-bb68-c3dbd6c33b35 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:32.486528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd8be9-8501-4f9e-bb68-c3dbd6c33b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:32.571350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c7fd8be9-8501-4f9e-bb68-c3dbd6c33b35 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:32.573314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c7fd8be9-8501-4f9e-bb68-c3dbd6c33b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:32.598696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:32.682363 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:32.966856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10a276-e752-4991-a226-ad44bf529682 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:32.969259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3c10a276-e752-4991-a226-ad44bf529682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:33.093738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10a276-e752-4991-a226-ad44bf529682 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:33.114708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:33.172317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cf4f3-5138-436c-b9f9-9b61d12d1c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:33.172954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cf4f3-5138-436c-b9f9-9b61d12d1c47 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:33.173216 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cf4f3-5138-436c-b9f9-9b61d12d1c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:33.173521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cf4f3-5138-436c-b9f9-9b61d12d1c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:33.175170 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a38cf4f3-5138-436c-b9f9-9b61d12d1c47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:33.301280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cf4f3-5138-436c-b9f9-9b61d12d1c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:33.302764 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cf4f3-5138-436c-b9f9-9b61d12d1c47 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:33.321499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 735/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:35.386038 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca79ce-a6df-440b-92be-9e7cf251b784 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:35.386638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca79ce-a6df-440b-92be-9e7cf251b784 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:35.386638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca79ce-a6df-440b-92be-9e7cf251b784 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:35.387835 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:35.394277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f5281-a338-415f-918f-a55dd4aba631 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:35.394970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f5281-a338-415f-918f-a55dd4aba631 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:35.395088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f5281-a338-415f-918f-a55dd4aba631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:35.464534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:35.469325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b71f5281-a338-415f-918f-a55dd4aba631 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:35.471509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b71f5281-a338-415f-918f-a55dd4aba631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:35.572071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:35.863994 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca79ce-a6df-440b-92be-9e7cf251b784 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:35.865570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-79ca79ce-a6df-440b-92be-9e7cf251b784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:35.988601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca79ce-a6df-440b-92be-9e7cf251b784 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:36.041185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:36.067481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09d034-1957-4ca4-a52f-001165317f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:36.068090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09d034-1957-4ca4-a52f-001165317f0e service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:36.068395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09d034-1957-4ca4-a52f-001165317f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:36.068664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09d034-1957-4ca4-a52f-001165317f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:36.070243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ea09d034-1957-4ca4-a52f-001165317f0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:36.195593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09d034-1957-4ca4-a52f-001165317f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:36.197017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09d034-1957-4ca4-a52f-001165317f0e service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:36.215509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 719/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:38.251236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a172b-006c-46a6-b45d-eeabd0b5067b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:38.251730 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a172b-006c-46a6-b45d-eeabd0b5067b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:38.252256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a172b-006c-46a6-b45d-eeabd0b5067b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:38.254690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:06:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:06:38.260461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7cdf5-3e78-4de4-9df9-db7d4476df92 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:38.260920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7cdf5-3e78-4de4-9df9-db7d4476df92 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:38.261044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7cdf5-3e78-4de4-9df9-db7d4476df92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:38.334699 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d1c7cdf5-3e78-4de4-9df9-db7d4476df92 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:38.335958 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d1c7cdf5-3e78-4de4-9df9-db7d4476df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:38.370910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:38.447872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:38.730180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a172b-006c-46a6-b45d-eeabd0b5067b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:38.732680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c63a172b-006c-46a6-b45d-eeabd0b5067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:38.850537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a172b-006c-46a6-b45d-eeabd0b5067b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:38.881320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:38.929488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb926ab1-4b70-40f7-8673-3ace000bfd63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:38.930094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb926ab1-4b70-40f7-8673-3ace000bfd63 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:38.930366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb926ab1-4b70-40f7-8673-3ace000bfd63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:38.930607 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb926ab1-4b70-40f7-8673-3ace000bfd63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:38.932213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cb926ab1-4b70-40f7-8673-3ace000bfd63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:39.043643 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb926ab1-4b70-40f7-8673-3ace000bfd63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:39.045165 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb926ab1-4b70-40f7-8673-3ace000bfd63 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:39.063182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 738/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:41.013579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47c62a-3c90-4e0e-92f7-345e37f40d39 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:41.014177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47c62a-3c90-4e0e-92f7-345e37f40d39 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:41.014177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47c62a-3c90-4e0e-92f7-345e37f40d39 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:41.015491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:41.022676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96102418-9de6-4aef-b883-837207dfb89f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:41.023189 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96102418-9de6-4aef-b883-837207dfb89f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:41.023307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96102418-9de6-4aef-b883-837207dfb89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:41.113541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-96102418-9de6-4aef-b883-837207dfb89f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:41.114805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-96102418-9de6-4aef-b883-837207dfb89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:41.124203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:41.234862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:41.551524 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47c62a-3c90-4e0e-92f7-345e37f40d39 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:41.553385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0b47c62a-3c90-4e0e-92f7-345e37f40d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:41.679550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47c62a-3c90-4e0e-92f7-345e37f40d39 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:41.758275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:41.782725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb83df-7ea6-488c-a53d-23aec0cb9e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:41.783564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb83df-7ea6-488c-a53d-23aec0cb9e68 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:41.783929 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb83df-7ea6-488c-a53d-23aec0cb9e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:41.784316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb83df-7ea6-488c-a53d-23aec0cb9e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:41.785956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-40cb83df-7ea6-488c-a53d-23aec0cb9e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:41.916107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb83df-7ea6-488c-a53d-23aec0cb9e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:41.917681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb83df-7ea6-488c-a53d-23aec0cb9e68 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:41.937268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 722/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:43.900426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd839e3-1788-45f3-93ce-3a806b09d1ca None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:43.901233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd839e3-1788-45f3-93ce-3a806b09d1ca None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:43.901233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd839e3-1788-45f3-93ce-3a806b09d1ca None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:43.903548 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:06:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:43.911299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46029df5-9562-4a53-80c4-2e677dbb8f84 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:43.911762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46029df5-9562-4a53-80c4-2e677dbb8f84 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:43.911858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46029df5-9562-4a53-80c4-2e677dbb8f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:43.983382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-46029df5-9562-4a53-80c4-2e677dbb8f84 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:43.984631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-46029df5-9562-4a53-80c4-2e677dbb8f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:44.026127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:44.088514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:06:44.373103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd839e3-1788-45f3-93ce-3a806b09d1ca None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:44.375624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2bd839e3-1788-45f3-93ce-3a806b09d1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:44.491258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd839e3-1788-45f3-93ce-3a806b09d1ca None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:44.531623 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:44.578897 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c5a2b-4b13-4c0d-9e29-9ebcd5b15698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:44.579478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c5a2b-4b13-4c0d-9e29-9ebcd5b15698 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:44.579750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c5a2b-4b13-4c0d-9e29-9ebcd5b15698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:44.580014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c5a2b-4b13-4c0d-9e29-9ebcd5b15698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:44.581635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ac2c5a2b-4b13-4c0d-9e29-9ebcd5b15698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:44.694602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c5a2b-4b13-4c0d-9e29-9ebcd5b15698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:44.695992 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c5a2b-4b13-4c0d-9e29-9ebcd5b15698 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:44.714551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 741/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:46.624941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18170672-4bd4-4e9b-bb2f-db198d23c69c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:46.625559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18170672-4bd4-4e9b-bb2f-db198d23c69c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:46.625559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18170672-4bd4-4e9b-bb2f-db198d23c69c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:46.626926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:46.633247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406acc90-15e2-4023-807b-1b747c158d36 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:46.633755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406acc90-15e2-4023-807b-1b747c158d36 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:46.633877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406acc90-15e2-4023-807b-1b747c158d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:46.715323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-406acc90-15e2-4023-807b-1b747c158d36 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:46.716471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-406acc90-15e2-4023-807b-1b747c158d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:46.735010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:46.819025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:47.114549 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18170672-4bd4-4e9b-bb2f-db198d23c69c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:47.116162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-18170672-4bd4-4e9b-bb2f-db198d23c69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:47.234985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18170672-4bd4-4e9b-bb2f-db198d23c69c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:47.309789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:47.317816 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a9e59-b7e4-4d7b-addf-6bc1f2fd137f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:47.318429 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a9e59-b7e4-4d7b-addf-6bc1f2fd137f service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:47.318702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a9e59-b7e4-4d7b-addf-6bc1f2fd137f service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:47.318969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a9e59-b7e4-4d7b-addf-6bc1f2fd137f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:47.320646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6b2a9e59-b7e4-4d7b-addf-6bc1f2fd137f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:47.449591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a9e59-b7e4-4d7b-addf-6bc1f2fd137f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:47.451151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a9e59-b7e4-4d7b-addf-6bc1f2fd137f service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:47.471469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 725/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:49.446544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7daf8c-ffe9-409f-b61a-23d4805226d7 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:49.447509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7daf8c-ffe9-409f-b61a-23d4805226d7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:49.447509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7daf8c-ffe9-409f-b61a-23d4805226d7 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:49.449467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:06:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:06:49.455750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e97e80-8fe8-4fdc-a8b1-c346251bbf75 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:49.456215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e97e80-8fe8-4fdc-a8b1-c346251bbf75 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:49.456344 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e97e80-8fe8-4fdc-a8b1-c346251bbf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:49.536252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c8e97e80-8fe8-4fdc-a8b1-c346251bbf75 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:06:49.537539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c8e97e80-8fe8-4fdc-a8b1-c346251bbf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:49.712949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:49.771611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:06:50.062211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7daf8c-ffe9-409f-b61a-23d4805226d7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:06:50.063896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8c7daf8c-ffe9-409f-b61a-23d4805226d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:50.178217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7daf8c-ffe9-409f-b61a-23d4805226d7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:06:50.226551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:50.253961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3409a-d18c-4ab8-a3b0-a6031a78cd01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:06:50.254568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3409a-d18c-4ab8-a3b0-a6031a78cd01 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:06:50.254845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3409a-d18c-4ab8-a3b0-a6031a78cd01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:06:50.255117 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3409a-d18c-4ab8-a3b0-a6031a78cd01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:06:50.256759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-35b3409a-d18c-4ab8-a3b0-a6031a78cd01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:06:50.368649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3409a-d18c-4ab8-a3b0-a6031a78cd01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:06:50.370145 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3409a-d18c-4ab8-a3b0-a6031a78cd01 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:06:50.388909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 744/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:06:59.769530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=22 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:00.386506 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=66 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:09.776353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5bed4-0c4d-40ef-aa06-1134164560f6 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:09.777240 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5bed4-0c4d-40ef-aa06-1134164560f6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:09.777452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5bed4-0c4d-40ef-aa06-1134164560f6 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:09.779709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 727/1471] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:07:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:07:09.785965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bf5a3-65b9-4783-a393-ad0bd08f819a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:09.786695 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bf5a3-65b9-4783-a393-ad0bd08f819a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:09.786927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bf5a3-65b9-4783-a393-ad0bd08f819a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:09.860010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-de1bf5a3-65b9-4783-a393-ad0bd08f819a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:07:09.861331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-de1bf5a3-65b9-4783-a393-ad0bd08f819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:09.967139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 745/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:07:10.275547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b7082-1011-4fbe-9041-cd39fa7ae4c0 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:10.275829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b7082-1011-4fbe-9041-cd39fa7ae4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:10.276136 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b7082-1011-4fbe-9041-cd39fa7ae4c0 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:10.277515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 728/1473] 10.222.0.25 () {54 vars in 961 bytes} [Tue Sep 6 01:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:07:10.282523 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3919fc-2193-497a-b4de-96355665c264 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:10.283103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3919fc-2193-497a-b4de-96355665c264 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:10.283399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3919fc-2193-497a-b4de-96355665c264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:10.373509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3f3919fc-2193-497a-b4de-96355665c264 None None] MFA Rules not processed for user `31ebbadd69da4bc6ad25b5c882962ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:07:10.374658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3f3919fc-2193-497a-b4de-96355665c264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:10.402384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:10.462012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 746/1474] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Sep 6 01:07:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:07:10.470214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b7082-1011-4fbe-9041-cd39fa7ae4c0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:07:10.472739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e86b7082-1011-4fbe-9041-cd39fa7ae4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:10.593701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b7082-1011-4fbe-9041-cd39fa7ae4c0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:07:10.668197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da760ead-7331-4b3f-a497-a67973cf4245 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31ebbadd69da4bc6ad25b5c882962ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:07:10.668748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760ead-7331-4b3f-a497-a67973cf4245 service glance] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:10.669018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760ead-7331-4b3f-a497-a67973cf4245 service glance] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:10.669245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760ead-7331-4b3f-a497-a67973cf4245 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:10.670852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-da760ead-7331-4b3f-a497-a67973cf4245 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:10.725860 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:10.785660 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da760ead-7331-4b3f-a497-a67973cf4245 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:07:10.787174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da760ead-7331-4b3f-a497-a67973cf4245 service glance] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:07:10.805595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 729/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:07:12.786745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4dbc1-dfa9-46a8-b1db-5a89fc8f2e2e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:12.787448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4dbc1-dfa9-46a8-b1db-5a89fc8f2e2e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:12.787448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4dbc1-dfa9-46a8-b1db-5a89fc8f2e2e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:12.788973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 747/1476] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:07:12.794468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39970c21-0a6a-4480-a920-5fbcd55c8c37 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:12.794924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39970c21-0a6a-4480-a920-5fbcd55c8c37 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:12.795031 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39970c21-0a6a-4480-a920-5fbcd55c8c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:12.863274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-39970c21-0a6a-4480-a920-5fbcd55c8c37 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:07:12.864515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-39970c21-0a6a-4480-a920-5fbcd55c8c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:12.992178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 730/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:07:13.266558 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4dbc1-dfa9-46a8-b1db-5a89fc8f2e2e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:07:13.268508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-51c4dbc1-dfa9-46a8-b1db-5a89fc8f2e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:13.422829 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4dbc1-dfa9-46a8-b1db-5a89fc8f2e2e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:07:13.478831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:13.529746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0d8b1-34eb-46c9-8438-88c7f82ab7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:07:13.530359 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0d8b1-34eb-46c9-8438-88c7f82ab7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:13.530629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0d8b1-34eb-46c9-8438-88c7f82ab7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:13.530890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0d8b1-34eb-46c9-8438-88c7f82ab7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:13.531525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0d8b1-34eb-46c9-8438-88c7f82ab7d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:07:13.533675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-f5f0d8b1-34eb-46c9-8438-88c7f82ab7d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:07:13.533675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: warnings.warn(msg) Sep 06 01:07:13.533675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: Sep 06 01:07:13.534831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0d8b1-34eb-46c9-8438-88c7f82ab7d8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:07:13.553972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 748/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 6 01:07:13 2022] GET /identity/v3/projects => generated 2553 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:07:15.469910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dec66-53c5-475b-9163-17178dc00a9e None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:15.470807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dec66-53c5-475b-9163-17178dc00a9e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:15.470807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dec66-53c5-475b-9163-17178dc00a9e None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:15.473161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 731/1479] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:07:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:07:15.479660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266a0d1-de97-4fc0-9036-1582bb4774da None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:15.480436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266a0d1-de97-4fc0-9036-1582bb4774da None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:15.480622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266a0d1-de97-4fc0-9036-1582bb4774da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:15.677541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7266a0d1-de97-4fc0-9036-1582bb4774da None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:07:15.678778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7266a0d1-de97-4fc0-9036-1582bb4774da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:15.780045 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 749/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:07:16.070882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1dec66-53c5-475b-9163-17178dc00a9e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:07:16.072540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3e1dec66-53c5-475b-9163-17178dc00a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:16.082811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:16.223877 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1dec66-53c5-475b-9163-17178dc00a9e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:07:16.312203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:16.346121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae0c3c-e7a4-4a97-ad7c-5160bc84ef38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:07:16.346799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae0c3c-e7a4-4a97-ad7c-5160bc84ef38 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:16.347067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae0c3c-e7a4-4a97-ad7c-5160bc84ef38 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:16.347302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae0c3c-e7a4-4a97-ad7c-5160bc84ef38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:16.348972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-12ae0c3c-e7a4-4a97-ad7c-5160bc84ef38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:16.451311 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae0c3c-e7a4-4a97-ad7c-5160bc84ef38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:07:16.452977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae0c3c-e7a4-4a97-ad7c-5160bc84ef38 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:07:16.475458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 732/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:07:18.582055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e67954-5a3e-4be5-a3a0-cb78f8d9118b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:18.582872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e67954-5a3e-4be5-a3a0-cb78f8d9118b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:18.582872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e67954-5a3e-4be5-a3a0-cb78f8d9118b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:18.585329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 750/1482] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:07:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:07:18.593315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed9c28-5783-455b-9f70-2ead564a198e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:18.593789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed9c28-5783-455b-9f70-2ead564a198e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:18.593894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed9c28-5783-455b-9f70-2ead564a198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:18.681385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ffed9c28-5783-455b-9f70-2ead564a198e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:07:18.682626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ffed9c28-5783-455b-9f70-2ead564a198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:18.733527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:18.788059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 733/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:07:19.082723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e67954-5a3e-4be5-a3a0-cb78f8d9118b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:07:19.084270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-53e67954-5a3e-4be5-a3a0-cb78f8d9118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:19.110211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:19.195308 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e67954-5a3e-4be5-a3a0-cb78f8d9118b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:07:19.272883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f7475-522e-457c-aea3-0e468ab21cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:07:19.273826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f7475-522e-457c-aea3-0e468ab21cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:19.274103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f7475-522e-457c-aea3-0e468ab21cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:19.274375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f7475-522e-457c-aea3-0e468ab21cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:19.275984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1b7f7475-522e-457c-aea3-0e468ab21cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:19.352847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:19.390088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f7475-522e-457c-aea3-0e468ab21cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:07:19.391576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f7475-522e-457c-aea3-0e468ab21cd9 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:07:19.411153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 751/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:07:21.368921 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72ac35-1d10-45d7-9c04-407bdb960a94 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:21.369505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72ac35-1d10-45d7-9c04-407bdb960a94 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:21.369505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72ac35-1d10-45d7-9c04-407bdb960a94 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:21.370792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 734/1485] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:07:21.377181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8a7fe-f6d5-411c-b95e-c086ae21ce8f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:21.378950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8a7fe-f6d5-411c-b95e-c086ae21ce8f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:21.378950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8a7fe-f6d5-411c-b95e-c086ae21ce8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:21.452030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-eec8a7fe-f6d5-411c-b95e-c086ae21ce8f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:07:21.453283 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-eec8a7fe-f6d5-411c-b95e-c086ae21ce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:21.554679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 752/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:07:21.852186 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72ac35-1d10-45d7-9c04-407bdb960a94 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:07:21.854702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cc72ac35-1d10-45d7-9c04-407bdb960a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:21.968253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72ac35-1d10-45d7-9c04-407bdb960a94 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:07:22.051628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:22.053534 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44799434-df39-452d-bd44-ae933246419a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:07:22.054163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44799434-df39-452d-bd44-ae933246419a service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:22.054473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44799434-df39-452d-bd44-ae933246419a service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:22.054753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44799434-df39-452d-bd44-ae933246419a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:22.057123 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-44799434-df39-452d-bd44-ae933246419a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:22.170216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44799434-df39-452d-bd44-ae933246419a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:07:22.171654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44799434-df39-452d-bd44-ae933246419a service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:07:22.189396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 735/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:07:24.188839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fb8f-660f-467c-a63d-d73850f8e937 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:24.189746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fb8f-660f-467c-a63d-d73850f8e937 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:24.189746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fb8f-660f-467c-a63d-d73850f8e937 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:24.191882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 753/1488] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:07:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:07:24.197438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006be386-ad00-4cd7-af1f-f958250d5c2c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:24.197907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006be386-ad00-4cd7-af1f-f958250d5c2c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:24.198005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006be386-ad00-4cd7-af1f-f958250d5c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:24.274888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-006be386-ad00-4cd7-af1f-f958250d5c2c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:07:24.276118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-006be386-ad00-4cd7-af1f-f958250d5c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:24.332756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:24.383953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 736/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:07:24.681956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148fb8f-660f-467c-a63d-d73850f8e937 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:07:24.684423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b148fb8f-660f-467c-a63d-d73850f8e937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:24.727062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:24.799975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148fb8f-660f-467c-a63d-d73850f8e937 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:07:24.884103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b1992-6f0d-42eb-bae3-9bb364469414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:07:24.884968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b1992-6f0d-42eb-bae3-9bb364469414 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:24.885294 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b1992-6f0d-42eb-bae3-9bb364469414 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:24.885632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b1992-6f0d-42eb-bae3-9bb364469414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:24.888049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7b5b1992-6f0d-42eb-bae3-9bb364469414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:24.976132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:25.006785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b1992-6f0d-42eb-bae3-9bb364469414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:07:25.008277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b1992-6f0d-42eb-bae3-9bb364469414 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:07:25.030747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 754/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:07:27.202026 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc5d30-9a7d-4f6f-b805-deed697ab37e None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:27.202636 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc5d30-9a7d-4f6f-b805-deed697ab37e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:27.202636 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc5d30-9a7d-4f6f-b805-deed697ab37e None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:27.204357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 737/1491] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 6 01:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:07:27.210904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2b8a1-bf0d-4581-8f7f-0d288c925412 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:27.211384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2b8a1-bf0d-4581-8f7f-0d288c925412 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:27.211569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2b8a1-bf0d-4581-8f7f-0d288c925412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:27.287025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b9f2b8a1-bf0d-4581-8f7f-0d288c925412 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:07:27.288239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b9f2b8a1-bf0d-4581-8f7f-0d288c925412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:27.391633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 755/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 6 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:07:27.676600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc5d30-9a7d-4f6f-b805-deed697ab37e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:07:27.679039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fffc5d30-9a7d-4f6f-b805-deed697ab37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:27.801470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc5d30-9a7d-4f6f-b805-deed697ab37e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:07:27.880450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e8c5a-f4ad-48ca-9afe-fe3d39ae900b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:07:27.881049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e8c5a-f4ad-48ca-9afe-fe3d39ae900b service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:07:27.881321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e8c5a-f4ad-48ca-9afe-fe3d39ae900b service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:07:27.881584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e8c5a-f4ad-48ca-9afe-fe3d39ae900b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:07:27.883253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-452e8c5a-f4ad-48ca-9afe-fe3d39ae900b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:07:27.893039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:28.000154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e8c5a-f4ad-48ca-9afe-fe3d39ae900b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:07:28.001599 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e8c5a-f4ad-48ca-9afe-fe3d39ae900b service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:07:28.020167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 738/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:07:37.389729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=82 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:07:38.017802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=50 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:08:41.209360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4c371-6b21-40d2-9bb5-6be146b2788e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:41.209984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4c371-6b21-40d2-9bb5-6be146b2788e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:41.209984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4c371-6b21-40d2-9bb5-6be146b2788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:41.294921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-edd4c371-6b21-40d2-9bb5-6be146b2788e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:08:41.296076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-edd4c371-6b21-40d2-9bb5-6be146b2788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:41.406180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 756/1494] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:08:41.415745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73630bae-bf7d-4da8-89b8-df1521da44da None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:41.416328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73630bae-bf7d-4da8-89b8-df1521da44da None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:41.416328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73630bae-bf7d-4da8-89b8-df1521da44da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:41.503576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-73630bae-bf7d-4da8-89b8-df1521da44da None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:08:41.504831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-73630bae-bf7d-4da8-89b8-df1521da44da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:41.611969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 739/1495] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:08:41.617178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4c371-6b21-40d2-9bb5-6be146b2788e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:08:41.618410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-edd4c371-6b21-40d2-9bb5-6be146b2788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:41.630652 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4c371-6b21-40d2-9bb5-6be146b2788e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:08:41.698407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:08:41.732738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a126c-08b5-4023-b3ce-b2d82bb80681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:08:41.733338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a126c-08b5-4023-b3ce-b2d82bb80681 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:41.733605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a126c-08b5-4023-b3ce-b2d82bb80681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:41.733868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a126c-08b5-4023-b3ce-b2d82bb80681 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:41.734504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a126c-08b5-4023-b3ce-b2d82bb80681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:08:41.734797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a126c-08b5-4023-b3ce-b2d82bb80681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:08:41.735855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-684a126c-08b5-4023-b3ce-b2d82bb80681 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:08:41.735855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: warnings.warn(msg) Sep 06 01:08:41.735855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: Sep 06 01:08:41.736768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a126c-08b5-4023-b3ce-b2d82bb80681 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:08:41.748599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 757/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:08:41.757326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73630bae-bf7d-4da8-89b8-df1521da44da None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:08:41.766686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73630bae-bf7d-4da8-89b8-df1521da44da None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:08:41.837584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:08:41.876002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff831c-82a2-4881-9f89-9350cd77cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:08:41.876565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff831c-82a2-4881-9f89-9350cd77cfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:41.876840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff831c-82a2-4881-9f89-9350cd77cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:41.877107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff831c-82a2-4881-9f89-9350cd77cfb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:41.877733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff831c-82a2-4881-9f89-9350cd77cfb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:08:41.879529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: WARNING py.warnings [None req-b8ff831c-82a2-4881-9f89-9350cd77cfb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:08:41.879529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: warnings.warn(msg) Sep 06 01:08:41.879529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: Sep 06 01:08:41.880923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff831c-82a2-4881-9f89-9350cd77cfb6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:08:41.948407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 740/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:08:41 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:08:41.949536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a126c-08b5-4023-b3ce-b2d82bb80681 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:08:41.951053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-684a126c-08b5-4023-b3ce-b2d82bb80681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:41.985213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a126c-08b5-4023-b3ce-b2d82bb80681 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:08:42.085513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32a38-e652-42ab-917c-a6c3c6934544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:08:42.086123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32a38-e652-42ab-917c-a6c3c6934544 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:42.086399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32a38-e652-42ab-917c-a6c3c6934544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:42.086650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32a38-e652-42ab-917c-a6c3c6934544 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:42.087283 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e32a38-e652-42ab-917c-a6c3c6934544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:08:42.088373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-a6e32a38-e652-42ab-917c-a6c3c6934544 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:08:42.088373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: warnings.warn(msg) Sep 06 01:08:42.088373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: Sep 06 01:08:42.089835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e32a38-e652-42ab-917c-a6c3c6934544 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:08:42.139598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 758/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:08:41 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:08:42.143924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff831c-82a2-4881-9f89-9350cd77cfb6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:08:42.145488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b8ff831c-82a2-4881-9f89-9350cd77cfb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:42.212573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff831c-82a2-4881-9f89-9350cd77cfb6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:08:42.299568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:08:42.311011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36042434-2fe5-44fe-97af-1b1373fd3a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:08:42.311626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36042434-2fe5-44fe-97af-1b1373fd3a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:42.311901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36042434-2fe5-44fe-97af-1b1373fd3a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:42.312189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36042434-2fe5-44fe-97af-1b1373fd3a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:42.312861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36042434-2fe5-44fe-97af-1b1373fd3a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:08:42.313942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: WARNING py.warnings [None req-36042434-2fe5-44fe-97af-1b1373fd3a72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:08:42.313942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: warnings.warn(msg) Sep 06 01:08:42.313942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: Sep 06 01:08:42.314833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36042434-2fe5-44fe-97af-1b1373fd3a72 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:08:42.327431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 741/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:08:42.331885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32a38-e652-42ab-917c-a6c3c6934544 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:08:42.333483 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a6e32a38-e652-42ab-917c-a6c3c6934544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:42.344970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32a38-e652-42ab-917c-a6c3c6934544 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:08:42.370087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:08:42.445599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4752ef-0a2a-4238-936c-9865b2d72a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:08:42.446108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4752ef-0a2a-4238-936c-9865b2d72a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:42.446374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4752ef-0a2a-4238-936c-9865b2d72a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:42.446640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4752ef-0a2a-4238-936c-9865b2d72a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:42.447269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4752ef-0a2a-4238-936c-9865b2d72a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:08:42.448339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-fd4752ef-0a2a-4238-936c-9865b2d72a91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:08:42.448339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: warnings.warn(msg) Sep 06 01:08:42.448339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: Sep 06 01:08:42.449226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4752ef-0a2a-4238-936c-9865b2d72a91 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:08:42.461676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 759/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:08:42.466180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36042434-2fe5-44fe-97af-1b1373fd3a72 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:08:42.467855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-36042434-2fe5-44fe-97af-1b1373fd3a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:42.503577 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36042434-2fe5-44fe-97af-1b1373fd3a72 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:08:42.606941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1c3d5-4a61-4969-971c-77c5a203da24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:08:42.607590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1c3d5-4a61-4969-971c-77c5a203da24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:42.607895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1c3d5-4a61-4969-971c-77c5a203da24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:42.608159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1c3d5-4a61-4969-971c-77c5a203da24 admin admin] PATH_INFO: `/v3/projects/17e51231a5e84fc784e135d2bbb9f670/users/e19ab2fd401c495090343c87a44d2854/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:42.631190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1c3d5-4a61-4969-971c-77c5a203da24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e51231a5e84fc784e135d2bbb9f670, user_id=e19ab2fd401c495090343c87a44d2854, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:08:42.632849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: WARNING py.warnings [None req-a4b1c3d5-4a61-4969-971c-77c5a203da24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:08:42.632849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: warnings.warn(msg) Sep 06 01:08:42.632849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: Sep 06 01:08:42.634782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1c3d5-4a61-4969-971c-77c5a203da24 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:08:42.664656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 742/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:08:42 2022] PUT /identity/v3/projects/17e51231a5e84fc784e135d2bbb9f670/users/e19ab2fd401c495090343c87a44d2854/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:08:42.676983 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f51ddb-7f76-4db3-b674-4f0d81765eb2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:42.677260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f51ddb-7f76-4db3-b674-4f0d81765eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:42.677522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f51ddb-7f76-4db3-b674-4f0d81765eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:42.737360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b1f51ddb-7f76-4db3-b674-4f0d81765eb2 None None] MFA Rules not processed for user `e19ab2fd401c495090343c87a44d2854`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:08:42.738699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b1f51ddb-7f76-4db3-b674-4f0d81765eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:42.820821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 760/1502] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:08:42.838526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb63e9b-9487-4a81-8bce-8c8e61931d65 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:42.838817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb63e9b-9487-4a81-8bce-8c8e61931d65 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:42.839124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb63e9b-9487-4a81-8bce-8c8e61931d65 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:42.840511 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 743/1503] 10.222.0.25 () {54 vars in 964 bytes} [Tue Sep 6 01:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:08:42.845990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf442d-02f5-44f2-957d-047dc2e55363 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:42.846426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf442d-02f5-44f2-957d-047dc2e55363 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:42.846838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf442d-02f5-44f2-957d-047dc2e55363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:42.880596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:08:42.929332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a9bf442d-02f5-44f2-957d-047dc2e55363 None None] MFA Rules not processed for user `eae9814386a444678a292becdfe07332`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:08:42.930562 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a9bf442d-02f5-44f2-957d-047dc2e55363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:43.009259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 761/1504] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Sep 6 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:08:43.017450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb63e9b-9487-4a81-8bce-8c8e61931d65 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:08:43.018976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ddb63e9b-9487-4a81-8bce-8c8e61931d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:43.072696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:08:43.129769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb63e9b-9487-4a81-8bce-8c8e61931d65 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:08:43.205457 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c8b3d-cd8c-4374-a347-2d2e0ca112e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:08:43.206067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c8b3d-cd8c-4374-a347-2d2e0ca112e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:43.206338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c8b3d-cd8c-4374-a347-2d2e0ca112e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:43.206629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c8b3d-cd8c-4374-a347-2d2e0ca112e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:43.208222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9b0c8b3d-cd8c-4374-a347-2d2e0ca112e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:43.313833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c8b3d-cd8c-4374-a347-2d2e0ca112e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:08:43.315249 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c8b3d-cd8c-4374-a347-2d2e0ca112e2 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:08:43.318802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:08:43.335064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 744/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:08:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:08:43.388931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2eeb-1b26-49e7-b7ae-0e422cbb7afa None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:43.389356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2eeb-1b26-49e7-b7ae-0e422cbb7afa None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:43.389505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2eeb-1b26-49e7-b7ae-0e422cbb7afa None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:43.390773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 762/1506] 10.222.0.25 () {52 vars in 830 bytes} [Tue Sep 6 01:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:08:43.394685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c8b3d-cd8c-4374-a347-2d2e0ca112e2 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:08:43.395913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9b0c8b3d-cd8c-4374-a347-2d2e0ca112e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:43.519767 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c8b3d-cd8c-4374-a347-2d2e0ca112e2 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:08:43.617833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:08:43.618376 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:43.618646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:43.618911 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] PATH_INFO: `/v3/users/e19ab2fd401c495090343c87a44d2854` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:43.632031 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19ab2fd401c495090343c87a44d2854)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:08:43.633189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: WARNING py.warnings [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:08:43.633189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: warnings.warn(msg) Sep 06 01:08:43.633189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: Sep 06 01:08:43.634445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:08:43.645111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:08:43.704553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19ab2fd401c495090343c87a44d2854'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:08:43.705003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19ab2fd401c495090343c87a44d2854'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:08:43.719527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19ab2fd401c495090343c87a44d2854'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:08:43.720082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19ab2fd401c495090343c87a44d2854'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:08:43.749776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19ab2fd401c495090343c87a44d2854'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:08:43.771622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 745/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:08:43 2022] DELETE /identity/v3/users/e19ab2fd401c495090343c87a44d2854 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:08:43.777893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e16a1-aa5b-4f58-b430-9cec57426420 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:43.778172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e16a1-aa5b-4f58-b430-9cec57426420 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:43.779104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e16a1-aa5b-4f58-b430-9cec57426420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:43.845180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-748e16a1-aa5b-4f58-b430-9cec57426420 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:08:43.846402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-748e16a1-aa5b-4f58-b430-9cec57426420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:43.930418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:08:43.947830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 763/1508] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:08:43.959910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:08:43.961281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:44.081392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d57bb9-a15c-4118-a60d-072e8db0a1e6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:08:44.142451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:08:44.166685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f9f9a-31d2-46bc-99ab-1b5d742fb135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:08:44.167310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f9f9a-31d2-46bc-99ab-1b5d742fb135 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:44.167591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f9f9a-31d2-46bc-99ab-1b5d742fb135 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:44.167863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f9f9a-31d2-46bc-99ab-1b5d742fb135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:44.169563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b76f9f9a-31d2-46bc-99ab-1b5d742fb135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:44.302029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f9f9a-31d2-46bc-99ab-1b5d742fb135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:08:44.305616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f9f9a-31d2-46bc-99ab-1b5d742fb135 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:08:44.327006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 746/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:08:44.745552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e16a1-aa5b-4f58-b430-9cec57426420 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:08:44.746857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-748e16a1-aa5b-4f58-b430-9cec57426420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:08:44.759268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e16a1-aa5b-4f58-b430-9cec57426420 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:08:44.876692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:08:44.877239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:08:44.877512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:08:44.877781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] PATH_INFO: `/v3/projects/17e51231a5e84fc784e135d2bbb9f670` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:08:44.888667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e51231a5e84fc784e135d2bbb9f670)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:08:44.889771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:08:44.889771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: warnings.warn(msg) Sep 06 01:08:44.889771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: Sep 06 01:08:44.891014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:08:44.955850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e51231a5e84fc784e135d2bbb9f670', 'request_id': 'req-47ba6b12-d973-442a-9826-0fdb93334dfc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:08:44.962792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e51231a5e84fc784e135d2bbb9f670', 'request_id': 'req-47ba6b12-d973-442a-9826-0fdb93334dfc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:08:44.976212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e51231a5e84fc784e135d2bbb9f670', 'request_id': 'req-47ba6b12-d973-442a-9826-0fdb93334dfc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:08:45.003601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] The token cache is being invalidate because project 17e51231a5e84fc784e135d2bbb9f670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:08:45.003923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:08:45.004481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-47ba6b12-d973-442a-9826-0fdb93334dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:08:45.005809 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 764/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:08:44 2022] DELETE /identity/v3/projects/17e51231a5e84fc784e135d2bbb9f670 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:08:54.323741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=62 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:08:55.001432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:10:13.704996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d54d70-53e8-4250-a172-f7dab5cc4bb7 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:13.705629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d54d70-53e8-4250-a172-f7dab5cc4bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:13.705629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d54d70-53e8-4250-a172-f7dab5cc4bb7 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:13.707642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 01:10:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:10:13.716467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8c34-8b33-412c-a470-961c0c28dff5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:13.716900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8c34-8b33-412c-a470-961c0c28dff5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:13.717032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8c34-8b33-412c-a470-961c0c28dff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:13.817640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-667d8c34-8b33-412c-a470-961c0c28dff5 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:10:13.819006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-667d8c34-8b33-412c-a470-961c0c28dff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:13.937429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:10:14.091347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d54d70-53e8-4250-a172-f7dab5cc4bb7 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:10:14.094604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a7d54d70-53e8-4250-a172-f7dab5cc4bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:14.222796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d54d70-53e8-4250-a172-f7dab5cc4bb7 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:10:14.229631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dfe80-212b-47d5-892d-13134c549854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:10:14.230246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dfe80-212b-47d5-892d-13134c549854 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:14.230525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dfe80-212b-47d5-892d-13134c549854 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:14.230801 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dfe80-212b-47d5-892d-13134c549854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:14.239611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313dfe80-212b-47d5-892d-13134c549854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:10:14.241272 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313dfe80-212b-47d5-892d-13134c549854 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:10:14.250567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 748/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:10:15.075179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801260cf-f4f6-4646-a39a-c32140d7f7da None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:15.075638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801260cf-f4f6-4646-a39a-c32140d7f7da None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:15.075751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801260cf-f4f6-4646-a39a-c32140d7f7da None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:15.077692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 01:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:10:15.083533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac38f2-8101-452d-91ad-8567b52413b3 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:15.083987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac38f2-8101-452d-91ad-8567b52413b3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:15.084176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac38f2-8101-452d-91ad-8567b52413b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:15.104698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b3ac38f2-8101-452d-91ad-8567b52413b3 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:10:15.105938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b3ac38f2-8101-452d-91ad-8567b52413b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:15.114680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:10:15.268040 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801260cf-f4f6-4646-a39a-c32140d7f7da None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:10:15.289592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801260cf-f4f6-4646-a39a-c32140d7f7da None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:10:15.297835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804b400-9aaa-4ae8-b567-43614c185466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:10:15.298391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804b400-9aaa-4ae8-b567-43614c185466 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:15.298663 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804b400-9aaa-4ae8-b567-43614c185466 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:15.298931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804b400-9aaa-4ae8-b567-43614c185466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:15.311779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804b400-9aaa-4ae8-b567-43614c185466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:10:15.313522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804b400-9aaa-4ae8-b567-43614c185466 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:10:15.323214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 767/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:10:16.101207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d4c81-6b8e-4915-a0ff-de4959444b41 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:16.101791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d4c81-6b8e-4915-a0ff-de4959444b41 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:16.101791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d4c81-6b8e-4915-a0ff-de4959444b41 None None] PATH_INFO: `/v3` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:16.103279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 750/1517] 10.222.0.20 () {54 vars in 925 bytes} [Tue Sep 6 01:10:16 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:10:16.110733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ab2a1-f962-4bb5-85ef-50b55bfd42f2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:16.111163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ab2a1-f962-4bb5-85ef-50b55bfd42f2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:16.111305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ab2a1-f962-4bb5-85ef-50b55bfd42f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:16.188907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b42ab2a1-f962-4bb5-85ef-50b55bfd42f2 None None] MFA Rules not processed for user `1823402195ab4e89aa865967afc62b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:10:16.190128 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b42ab2a1-f962-4bb5-85ef-50b55bfd42f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:16.208506 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:10:16.266625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 768/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Sep 6 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:10:20.216114 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92623081-b273-4873-bf16-27f9e04f0841 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:20.216739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92623081-b273-4873-bf16-27f9e04f0841 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:20.216739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92623081-b273-4873-bf16-27f9e04f0841 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:20.218083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 751/1519] 10.222.0.25 () {54 vars in 961 bytes} [Tue Sep 6 01:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:10:20.224345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02dfda-9fdf-42c8-8fb4-8b6e94884cca None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:20.225150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02dfda-9fdf-42c8-8fb4-8b6e94884cca None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:20.225338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02dfda-9fdf-42c8-8fb4-8b6e94884cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:20.251232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8f02dfda-9fdf-42c8-8fb4-8b6e94884cca None None] MFA Rules not processed for user `1823402195ab4e89aa865967afc62b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:10:20.252479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8f02dfda-9fdf-42c8-8fb4-8b6e94884cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:20.262672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 769/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Sep 6 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:10:20.270450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92623081-b273-4873-bf16-27f9e04f0841 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:10:20.292159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92623081-b273-4873-bf16-27f9e04f0841 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:10:20.301791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce85928-256d-4084-8188-ead2c4c68cf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:10:20.302669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce85928-256d-4084-8188-ead2c4c68cf1 service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:20.303275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce85928-256d-4084-8188-ead2c4c68cf1 service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:20.303469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce85928-256d-4084-8188-ead2c4c68cf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:20.313014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce85928-256d-4084-8188-ead2c4c68cf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:10:20.314678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce85928-256d-4084-8188-ead2c4c68cf1 service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:10:20.324680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 752/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:10:26.616334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf480ec-1b79-48cd-9036-a42af9159847 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:26.617286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf480ec-1b79-48cd-9036-a42af9159847 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:26.617286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf480ec-1b79-48cd-9036-a42af9159847 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:26.620343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 01:10:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:10:26.625403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7d099-ce40-403a-9440-018207c90bb1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:26.625904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7d099-ce40-403a-9440-018207c90bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:26.625904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7d099-ce40-403a-9440-018207c90bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:26.646387 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-95c7d099-ce40-403a-9440-018207c90bb1 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:10:26.647570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-95c7d099-ce40-403a-9440-018207c90bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:26.656420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 01:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:10:26.818980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf480ec-1b79-48cd-9036-a42af9159847 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:10:26.840124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf480ec-1b79-48cd-9036-a42af9159847 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:10:26.848082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71ca4f-bd9c-4ca0-bf40-5ee525c4dccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:10:26.849074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ca4f-bd9c-4ca0-bf40-5ee525c4dccc service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:26.849431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ca4f-bd9c-4ca0-bf40-5ee525c4dccc service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:26.849853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ca4f-bd9c-4ca0-bf40-5ee525c4dccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:26.863845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71ca4f-bd9c-4ca0-bf40-5ee525c4dccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:10:26.865931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71ca4f-bd9c-4ca0-bf40-5ee525c4dccc service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:10:26.879266 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 771/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:10:27.716276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507b332-67ba-4134-a444-7bff16ba246a None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:27.716945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507b332-67ba-4134-a444-7bff16ba246a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:27.716945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507b332-67ba-4134-a444-7bff16ba246a None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:27.718234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 01:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:10:27.723951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ff099-ad23-4ff6-a2f5-3952ebe91cc3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:27.724426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ff099-ad23-4ff6-a2f5-3952ebe91cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:27.724545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ff099-ad23-4ff6-a2f5-3952ebe91cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:27.751410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fa7ff099-ad23-4ff6-a2f5-3952ebe91cc3 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:10:27.752659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fa7ff099-ad23-4ff6-a2f5-3952ebe91cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:27.762243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 01:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:10:27.912645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507b332-67ba-4134-a444-7bff16ba246a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:10:27.934622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507b332-67ba-4134-a444-7bff16ba246a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:10:27.944748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6debfeb-c1b8-4bc1-ac09-3c558977f681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:10:27.945651 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6debfeb-c1b8-4bc1-ac09-3c558977f681 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:27.946039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6debfeb-c1b8-4bc1-ac09-3c558977f681 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:27.946355 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6debfeb-c1b8-4bc1-ac09-3c558977f681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:27.955224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6debfeb-c1b8-4bc1-ac09-3c558977f681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:10:27.956914 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6debfeb-c1b8-4bc1-ac09-3c558977f681 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:10:27.969292 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 755/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:10:31.676980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d29e9a-e223-42eb-adcd-16220e43fc96 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:31.677916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d29e9a-e223-42eb-adcd-16220e43fc96 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:31.677916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d29e9a-e223-42eb-adcd-16220e43fc96 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:31.679927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:10:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:10:31.685841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c7c52-c398-4b5d-a2bc-b84f31a5d053 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:31.686300 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c7c52-c398-4b5d-a2bc-b84f31a5d053 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:31.686418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c7c52-c398-4b5d-a2bc-b84f31a5d053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:31.707793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-798c7c52-c398-4b5d-a2bc-b84f31a5d053 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:10:31.709024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-798c7c52-c398-4b5d-a2bc-b84f31a5d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:31.723152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:10:32.023965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d29e9a-e223-42eb-adcd-16220e43fc96 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:10:32.026558 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a9d29e9a-e223-42eb-adcd-16220e43fc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:32.114905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d29e9a-e223-42eb-adcd-16220e43fc96 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:10:32.119388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efa7b3-f7b6-499e-8256-486bd673526f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:10:32.119964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa7b3-f7b6-499e-8256-486bd673526f service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:32.120239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa7b3-f7b6-499e-8256-486bd673526f service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:32.120541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa7b3-f7b6-499e-8256-486bd673526f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:32.130176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efa7b3-f7b6-499e-8256-486bd673526f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:10:32.131649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efa7b3-f7b6-499e-8256-486bd673526f service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:10:32.141595 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 774/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:10:34.006630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9e7d9-9291-490c-b088-d2a1a81ac056 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:34.007200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9e7d9-9291-490c-b088-d2a1a81ac056 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:34.007200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9e7d9-9291-490c-b088-d2a1a81ac056 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:34.009006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:10:34.015818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8f9e1-eeb4-461c-85fa-34b07dffe1b2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:34.016224 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8f9e1-eeb4-461c-85fa-34b07dffe1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:34.016541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8f9e1-eeb4-461c-85fa-34b07dffe1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:34.040960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-52a8f9e1-eeb4-461c-85fa-34b07dffe1b2 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:10:34.042174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-52a8f9e1-eeb4-461c-85fa-34b07dffe1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:34.051654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:10:34.339922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9e7d9-9291-490c-b088-d2a1a81ac056 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:10:34.346335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=75 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:10:34.353491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9e7d9-9291-490c-b088-d2a1a81ac056 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:10:34.360320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8024aa9-b0c6-4f49-a6b3-3148c9184935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:10:34.361326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8024aa9-b0c6-4f49-a6b3-3148c9184935 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:34.361746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8024aa9-b0c6-4f49-a6b3-3148c9184935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:34.362142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8024aa9-b0c6-4f49-a6b3-3148c9184935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:34.374482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8024aa9-b0c6-4f49-a6b3-3148c9184935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:10:34.375985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8024aa9-b0c6-4f49-a6b3-3148c9184935 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:10:34.385968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 758/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:10:37.823505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ec5a5-0414-4699-bded-1260a08fc719 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:37.824072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ec5a5-0414-4699-bded-1260a08fc719 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:37.824072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ec5a5-0414-4699-bded-1260a08fc719 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:37.826065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:10:37.833520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fe7ad-8a72-4311-a6a9-c48f2b1061bf None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:37.833958 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fe7ad-8a72-4311-a6a9-c48f2b1061bf None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:37.834065 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fe7ad-8a72-4311-a6a9-c48f2b1061bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:37.856618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8e7fe7ad-8a72-4311-a6a9-c48f2b1061bf None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:10:37.857850 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8e7fe7ad-8a72-4311-a6a9-c48f2b1061bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:37.866518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:10:38.429012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ec5a5-0414-4699-bded-1260a08fc719 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:10:38.432031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1b1ec5a5-0414-4699-bded-1260a08fc719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:38.504904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:10:38.518932 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ec5a5-0414-4699-bded-1260a08fc719 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:10:38.522732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca8909-d3fd-4513-8655-add114c1b3b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:10:38.523347 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca8909-d3fd-4513-8655-add114c1b3b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:38.523620 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca8909-d3fd-4513-8655-add114c1b3b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:38.523885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca8909-d3fd-4513-8655-add114c1b3b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:38.533558 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca8909-d3fd-4513-8655-add114c1b3b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:10:38.535031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca8909-d3fd-4513-8655-add114c1b3b5 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:10:38.544533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 777/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:10:40.474136 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c1951-3953-4f32-898f-a633a6547c06 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:40.474996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c1951-3953-4f32-898f-a633a6547c06 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:40.474996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c1951-3953-4f32-898f-a633a6547c06 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:40.478074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 01:10:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:10:40.483544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bac33-8b07-457e-a27f-f7a99e7fd48b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:40.483989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bac33-8b07-457e-a27f-f7a99e7fd48b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:40.484084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bac33-8b07-457e-a27f-f7a99e7fd48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:40.506162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ed4bac33-8b07-457e-a27f-f7a99e7fd48b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:10:40.507358 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ed4bac33-8b07-457e-a27f-f7a99e7fd48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:40.515985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 01:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:10:41.060607 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c1951-3953-4f32-898f-a633a6547c06 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:10:41.063487 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d94c1951-3953-4f32-898f-a633a6547c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:10:41.086499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c1951-3953-4f32-898f-a633a6547c06 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:10:41.091558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8fdf3-c2d9-4385-afe5-4f78c4d30993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:10:41.092156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8fdf3-c2d9-4385-afe5-4f78c4d30993 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:10:41.092460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8fdf3-c2d9-4385-afe5-4f78c4d30993 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:10:41.092728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8fdf3-c2d9-4385-afe5-4f78c4d30993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:10:41.103480 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8fdf3-c2d9-4385-afe5-4f78c4d30993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:10:41.105880 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8fdf3-c2d9-4385-afe5-4f78c4d30993 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:10:41.120327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 761/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:10:50.499930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=11 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:10:51.114339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=14 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:13.724026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3469661-238c-469b-bddf-7f9bf9815475 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:13.724767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3469661-238c-469b-bddf-7f9bf9815475 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:13.724767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3469661-238c-469b-bddf-7f9bf9815475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:13.750777 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a3469661-238c-469b-bddf-7f9bf9815475 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:13.752357 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a3469661-238c-469b-bddf-7f9bf9815475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:13.767507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 779/1540] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:13.776800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272f443-24c3-443a-b756-09e7e0f83106 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:13.777461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272f443-24c3-443a-b756-09e7e0f83106 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:13.777461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272f443-24c3-443a-b756-09e7e0f83106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:13.809555 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1272f443-24c3-443a-b756-09e7e0f83106 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:13.810829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1272f443-24c3-443a-b756-09e7e0f83106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:13.824597 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 762/1541] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:13.829651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3469661-238c-469b-bddf-7f9bf9815475 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:13.842319 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3469661-238c-469b-bddf-7f9bf9815475 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:13.850161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1c3a2-e8e1-4b6f-97db-4131c92b9f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:13.850805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1c3a2-e8e1-4b6f-97db-4131c92b9f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:13.851220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1c3a2-e8e1-4b6f-97db-4131c92b9f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:13.851634 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1c3a2-e8e1-4b6f-97db-4131c92b9f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:13.852314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1c3a2-e8e1-4b6f-97db-4131c92b9f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:13.852637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1c3a2-e8e1-4b6f-97db-4131c92b9f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:13.854346 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1c3a2-e8e1-4b6f-97db-4131c92b9f78 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:13.872414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 780/1542] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:12:13.880843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272f443-24c3-443a-b756-09e7e0f83106 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:13.895258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272f443-24c3-443a-b756-09e7e0f83106 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:13.901259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a3114-7f28-472d-80b5-03b7e9ce5e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:13.901898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a3114-7f28-472d-80b5-03b7e9ce5e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:13.902174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a3114-7f28-472d-80b5-03b7e9ce5e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:13.902445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a3114-7f28-472d-80b5-03b7e9ce5e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:13.903093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a3114-7f28-472d-80b5-03b7e9ce5e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:13.905266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a3114-7f28-472d-80b5-03b7e9ce5e69 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:13.965178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 763/1543] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:13 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:13.969174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1c3a2-e8e1-4b6f-97db-4131c92b9f78 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:13.984931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1c3a2-e8e1-4b6f-97db-4131c92b9f78 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.071955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f4a67-960d-4884-907a-2bdeefeae6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.072632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f4a67-960d-4884-907a-2bdeefeae6ad admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.072908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f4a67-960d-4884-907a-2bdeefeae6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.073194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f4a67-960d-4884-907a-2bdeefeae6ad admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.073827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f4a67-960d-4884-907a-2bdeefeae6ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.076055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f4a67-960d-4884-907a-2bdeefeae6ad admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.107118 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 781/1544] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:13 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:14.111279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a3114-7f28-472d-80b5-03b7e9ce5e69 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.127074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a3114-7f28-472d-80b5-03b7e9ce5e69 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.134755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69342afc-565c-4d06-adce-a89379c85f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.135390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69342afc-565c-4d06-adce-a89379c85f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.135669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69342afc-565c-4d06-adce-a89379c85f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.135943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69342afc-565c-4d06-adce-a89379c85f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.136623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69342afc-565c-4d06-adce-a89379c85f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.138290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69342afc-565c-4d06-adce-a89379c85f24 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.152465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 764/1545] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:14.156461 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f4a67-960d-4884-907a-2bdeefeae6ad admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.167660 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d107f84-56cd-4dd2-8ce7-682a8033c2ec None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.167995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d107f84-56cd-4dd2-8ce7-682a8033c2ec None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.168217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d107f84-56cd-4dd2-8ce7-682a8033c2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.169670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f4a67-960d-4884-907a-2bdeefeae6ad admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.183126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154e74c-2cf9-4a40-8dab-b36ef5604e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.184021 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154e74c-2cf9-4a40-8dab-b36ef5604e7a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.184326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154e74c-2cf9-4a40-8dab-b36ef5604e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.184819 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154e74c-2cf9-4a40-8dab-b36ef5604e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.185475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154e74c-2cf9-4a40-8dab-b36ef5604e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.187143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154e74c-2cf9-4a40-8dab-b36ef5604e7a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.207912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 782/1546] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:14.209505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8d107f84-56cd-4dd2-8ce7-682a8033c2ec None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.210727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8d107f84-56cd-4dd2-8ce7-682a8033c2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.211763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded11e8c-b220-45ae-8726-db897141acd2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.212041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded11e8c-b220-45ae-8726-db897141acd2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.212336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded11e8c-b220-45ae-8726-db897141acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.226953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 765/1547] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.228227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da443ed-6f5e-46d0-a06d-ed7700dee7cc None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.228538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da443ed-6f5e-46d0-a06d-ed7700dee7cc None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.228811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da443ed-6f5e-46d0-a06d-ed7700dee7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.250102 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ded11e8c-b220-45ae-8726-db897141acd2 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.251296 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ded11e8c-b220-45ae-8726-db897141acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.268816 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8da443ed-6f5e-46d0-a06d-ed7700dee7cc None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.270027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8da443ed-6f5e-46d0-a06d-ed7700dee7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.272327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 783/1548] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.273052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded11e8c-b220-45ae-8726-db897141acd2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.288081 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 766/1549] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.289412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6f0cd-9975-4727-bc27-3d5c5f5e3434 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.289695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6f0cd-9975-4727-bc27-3d5c5f5e3434 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.289969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6f0cd-9975-4727-bc27-3d5c5f5e3434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.290974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded11e8c-b220-45ae-8726-db897141acd2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.305211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891d444-e233-4bb9-9ade-8b1a59157e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.305900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891d444-e233-4bb9-9ade-8b1a59157e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.306276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891d444-e233-4bb9-9ade-8b1a59157e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.306443 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891d444-e233-4bb9-9ade-8b1a59157e47 admin admin] PATH_INFO: `/v3/projects/9e9709d4bf6c4b99b5a31c7055c950cb/users/7f8c891da32b49d29bf57d116e84debf/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.319928 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-59b6f0cd-9975-4727-bc27-3d5c5f5e3434 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.321168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-59b6f0cd-9975-4727-bc27-3d5c5f5e3434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.322669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891d444-e233-4bb9-9ade-8b1a59157e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9709d4bf6c4b99b5a31c7055c950cb, user_id=7f8c891da32b49d29bf57d116e84debf, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.323967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-d891d444-e233-4bb9-9ade-8b1a59157e47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:12:14.323967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: warnings.warn(msg) Sep 06 01:12:14.323967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: Sep 06 01:12:14.326242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891d444-e233-4bb9-9ade-8b1a59157e47 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.330030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 767/1550] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.333329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf6164-abf9-47c0-8e8f-fc4a7cbb7c50 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.333329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf6164-abf9-47c0-8e8f-fc4a7cbb7c50 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.333329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf6164-abf9-47c0-8e8f-fc4a7cbb7c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.345022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 784/1551] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:14 2022] PUT /identity/v3/projects/9e9709d4bf6c4b99b5a31c7055c950cb/users/7f8c891da32b49d29bf57d116e84debf/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:14.346309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48c2de-8209-4dcf-9357-8420903afc8d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.346594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48c2de-8209-4dcf-9357-8420903afc8d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.346867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48c2de-8209-4dcf-9357-8420903afc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.360505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e3cf6164-abf9-47c0-8e8f-fc4a7cbb7c50 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.361854 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e3cf6164-abf9-47c0-8e8f-fc4a7cbb7c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.366658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6d48c2de-8209-4dcf-9357-8420903afc8d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.367840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6d48c2de-8209-4dcf-9357-8420903afc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.420405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 768/1552] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.421649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe114b-6c7f-4a5d-9400-904d074e2a9c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.421926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe114b-6c7f-4a5d-9400-904d074e2a9c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.422175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe114b-6c7f-4a5d-9400-904d074e2a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.433370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 785/1553] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.434767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d299e37-4d8b-4551-a797-36b80ed3c39b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.435049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d299e37-4d8b-4551-a797-36b80ed3c39b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.435317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d299e37-4d8b-4551-a797-36b80ed3c39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.450198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0ffe114b-6c7f-4a5d-9400-904d074e2a9c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.451452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0ffe114b-6c7f-4a5d-9400-904d074e2a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.454769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0d299e37-4d8b-4551-a797-36b80ed3c39b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.455946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0d299e37-4d8b-4551-a797-36b80ed3c39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.463758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 769/1554] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.463758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252b68f-63ae-452a-91ec-545643493d28 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.463758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252b68f-63ae-452a-91ec-545643493d28 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.463758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252b68f-63ae-452a-91ec-545643493d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.464650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 786/1555] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.465882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809774f-c6a5-4676-a8af-7cf3b16a7e9a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.466152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809774f-c6a5-4676-a8af-7cf3b16a7e9a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.466430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809774f-c6a5-4676-a8af-7cf3b16a7e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.481506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-5252b68f-63ae-452a-91ec-545643493d28 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.482709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5252b68f-63ae-452a-91ec-545643493d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.485223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b809774f-c6a5-4676-a8af-7cf3b16a7e9a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.486573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b809774f-c6a5-4676-a8af-7cf3b16a7e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.491379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 770/1556] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.492205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252b68f-63ae-452a-91ec-545643493d28 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.498418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 787/1557] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.499490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d338e8-7f30-4bc4-b48f-3cd6d2eae91b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.499767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d338e8-7f30-4bc4-b48f-3cd6d2eae91b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.500035 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d338e8-7f30-4bc4-b48f-3cd6d2eae91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.508161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252b68f-63ae-452a-91ec-545643493d28 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.513473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5873e-2c6f-4664-a2dc-9142b971427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.514118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5873e-2c6f-4664-a2dc-9142b971427e admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.514389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5873e-2c6f-4664-a2dc-9142b971427e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.514655 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5873e-2c6f-4664-a2dc-9142b971427e admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.515327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5873e-2c6f-4664-a2dc-9142b971427e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:14.515623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5873e-2c6f-4664-a2dc-9142b971427e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.516769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: WARNING py.warnings [None req-bfc5873e-2c6f-4664-a2dc-9142b971427e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:12:14.516769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: warnings.warn(msg) Sep 06 01:12:14.516769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: Sep 06 01:12:14.517651 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5873e-2c6f-4664-a2dc-9142b971427e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.519686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-71d338e8-7f30-4bc4-b48f-3cd6d2eae91b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.520933 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-71d338e8-7f30-4bc4-b48f-3cd6d2eae91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.529390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 788/1558] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.530742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcc784-0b3c-4ab8-b7c3-58b0a427c504 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.530954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 771/1559] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:12:14.531080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcc784-0b3c-4ab8-b7c3-58b0a427c504 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.531348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcc784-0b3c-4ab8-b7c3-58b0a427c504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.532781 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74a88f-4be9-42ce-a101-7d7fa9c97af9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.533074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74a88f-4be9-42ce-a101-7d7fa9c97af9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.533384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74a88f-4be9-42ce-a101-7d7fa9c97af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.551841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-73fcc784-0b3c-4ab8-b7c3-58b0a427c504 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.553103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-73fcc784-0b3c-4ab8-b7c3-58b0a427c504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.556598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1a74a88f-4be9-42ce-a101-7d7fa9c97af9 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.557782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1a74a88f-4be9-42ce-a101-7d7fa9c97af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.561051 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 789/1560] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.561824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcc784-0b3c-4ab8-b7c3-58b0a427c504 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.566788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:14.569532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 772/1561] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.570567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74a88f-4be9-42ce-a101-7d7fa9c97af9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.572383 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcc784-0b3c-4ab8-b7c3-58b0a427c504 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.578055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d370a19-4ee7-4daf-8f6b-54dabd4b4a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.578857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d370a19-4ee7-4daf-8f6b-54dabd4b4a0e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.579222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d370a19-4ee7-4daf-8f6b-54dabd4b4a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.579516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d370a19-4ee7-4daf-8f6b-54dabd4b4a0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.580473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d370a19-4ee7-4daf-8f6b-54dabd4b4a0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:14.580776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d370a19-4ee7-4daf-8f6b-54dabd4b4a0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.581145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74a88f-4be9-42ce-a101-7d7fa9c97af9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.582427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d370a19-4ee7-4daf-8f6b-54dabd4b4a0e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.585682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c5c53-e3e4-4049-bbcb-7a9242df25df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.586282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c5c53-e3e4-4049-bbcb-7a9242df25df admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.586560 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c5c53-e3e4-4049-bbcb-7a9242df25df admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.586833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c5c53-e3e4-4049-bbcb-7a9242df25df admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.587477 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c5c53-e3e4-4049-bbcb-7a9242df25df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:14.587781 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c5c53-e3e4-4049-bbcb-7a9242df25df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.589441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c5c53-e3e4-4049-bbcb-7a9242df25df admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.601503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 790/1562] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:12:14.601503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542946c5-dc9a-4f4e-a1b4-93fedcb3da0b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.601503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542946c5-dc9a-4f4e-a1b4-93fedcb3da0b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.601503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542946c5-dc9a-4f4e-a1b4-93fedcb3da0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.601976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 773/1563] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:12:14.602587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c1f7b-7da7-435c-a21b-f7b6e5bc1727 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.602832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c1f7b-7da7-435c-a21b-f7b6e5bc1727 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.603112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c1f7b-7da7-435c-a21b-f7b6e5bc1727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.620056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-542946c5-dc9a-4f4e-a1b4-93fedcb3da0b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.621350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-542946c5-dc9a-4f4e-a1b4-93fedcb3da0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.623823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f47c1f7b-7da7-435c-a21b-f7b6e5bc1727 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:14.625072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f47c1f7b-7da7-435c-a21b-f7b6e5bc1727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:14.629499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 791/1564] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.633076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542946c5-dc9a-4f4e-a1b4-93fedcb3da0b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.633571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 774/1565] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:14.634354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c1f7b-7da7-435c-a21b-f7b6e5bc1727 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.643157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542946c5-dc9a-4f4e-a1b4-93fedcb3da0b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.647762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15109444-5144-423e-a83d-a18341a74203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.648388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15109444-5144-423e-a83d-a18341a74203 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.648662 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15109444-5144-423e-a83d-a18341a74203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.648925 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15109444-5144-423e-a83d-a18341a74203 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.649963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15109444-5144-423e-a83d-a18341a74203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.651025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-15109444-5144-423e-a83d-a18341a74203 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:12:14.651025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: warnings.warn(msg) Sep 06 01:12:14.651025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: Sep 06 01:12:14.652239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15109444-5144-423e-a83d-a18341a74203 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.681530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 792/1566] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:14.682010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:14.682363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15109444-5144-423e-a83d-a18341a74203 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.698728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c1f7b-7da7-435c-a21b-f7b6e5bc1727 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.747907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15109444-5144-423e-a83d-a18341a74203 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.750761 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33782e4-fef1-4824-8a8b-9421dbda2a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.751548 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33782e4-fef1-4824-8a8b-9421dbda2a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.752008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33782e4-fef1-4824-8a8b-9421dbda2a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.752282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33782e4-fef1-4824-8a8b-9421dbda2a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.753745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8430c-3af7-4fb0-8de0-4654b6340e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.754353 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8430c-3af7-4fb0-8de0-4654b6340e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.754627 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8430c-3af7-4fb0-8de0-4654b6340e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.754896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8430c-3af7-4fb0-8de0-4654b6340e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.755539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8430c-3af7-4fb0-8de0-4654b6340e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:14.755834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8430c-3af7-4fb0-8de0-4654b6340e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.757520 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8430c-3af7-4fb0-8de0-4654b6340e20 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.761913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33782e4-fef1-4824-8a8b-9421dbda2a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.763329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33782e4-fef1-4824-8a8b-9421dbda2a18 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.769485 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 793/1567] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:12:14.770500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8430c-3af7-4fb0-8de0-4654b6340e20 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.779113 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 775/1568] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:14.779909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33782e4-fef1-4824-8a8b-9421dbda2a18 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.781882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8430c-3af7-4fb0-8de0-4654b6340e20 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.787982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a5984-3c00-49b3-940f-ace7853c7781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.788724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a5984-3c00-49b3-940f-ace7853c7781 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.789289 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33782e4-fef1-4824-8a8b-9421dbda2a18 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.789420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a5984-3c00-49b3-940f-ace7853c7781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.789516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a5984-3c00-49b3-940f-ace7853c7781 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.790251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a5984-3c00-49b3-940f-ace7853c7781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:14.790627 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a5984-3c00-49b3-940f-ace7853c7781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.792516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a5984-3c00-49b3-940f-ace7853c7781 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.794171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1bd3f-fd32-4bd3-990c-fc99b4e73583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.794968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1bd3f-fd32-4bd3-990c-fc99b4e73583 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.795248 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1bd3f-fd32-4bd3-990c-fc99b4e73583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.795520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1bd3f-fd32-4bd3-990c-fc99b4e73583 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.796187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1bd3f-fd32-4bd3-990c-fc99b4e73583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.798376 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1bd3f-fd32-4bd3-990c-fc99b4e73583 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.806399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 794/1569] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:12:14.813861 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a5984-3c00-49b3-940f-ace7853c7781 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.820273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a5984-3c00-49b3-940f-ace7853c7781 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.825791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e0a9a-d320-4d89-a964-e7e852e899ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.826593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e0a9a-d320-4d89-a964-e7e852e899ab admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.826868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e0a9a-d320-4d89-a964-e7e852e899ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.827130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e0a9a-d320-4d89-a964-e7e852e899ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.827771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e0a9a-d320-4d89-a964-e7e852e899ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.829796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e0a9a-d320-4d89-a964-e7e852e899ab admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.835137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 776/1570] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:14.835137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1bd3f-fd32-4bd3-990c-fc99b4e73583 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.865742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 795/1571] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:14.867219 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e0a9a-d320-4d89-a964-e7e852e899ab admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.908206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1bd3f-fd32-4bd3-990c-fc99b4e73583 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.941879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e0a9a-d320-4d89-a964-e7e852e899ab admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.947340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebb39b-ae44-495c-9c04-508d35862e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.948085 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebb39b-ae44-495c-9c04-508d35862e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.948463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebb39b-ae44-495c-9c04-508d35862e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.948805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebb39b-ae44-495c-9c04-508d35862e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.949534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebb39b-ae44-495c-9c04-508d35862e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:14.950202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebb39b-ae44-495c-9c04-508d35862e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.951815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebb39b-ae44-495c-9c04-508d35862e49 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.965926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 796/1572] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:12:14.970107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2d47e-17a9-4a37-9b39-ecfbe8f36310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:14.970789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2d47e-17a9-4a37-9b39-ecfbe8f36310 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:14.971062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2d47e-17a9-4a37-9b39-ecfbe8f36310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:14.971332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2d47e-17a9-4a37-9b39-ecfbe8f36310 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:14.971977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2d47e-17a9-4a37-9b39-ecfbe8f36310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:14.972279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2d47e-17a9-4a37-9b39-ecfbe8f36310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:14.973660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebb39b-ae44-495c-9c04-508d35862e49 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.973949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2d47e-17a9-4a37-9b39-ecfbe8f36310 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:14.986504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebb39b-ae44-495c-9c04-508d35862e49 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:14.986768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 777/1573] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:12:14.987583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2d47e-17a9-4a37-9b39-ecfbe8f36310 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:14.998806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1e27a-a560-4a38-87d6-ad26358047fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.000202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1e27a-a560-4a38-87d6-ad26358047fb admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.000526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1e27a-a560-4a38-87d6-ad26358047fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.000808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1e27a-a560-4a38-87d6-ad26358047fb admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.001673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1e27a-a560-4a38-87d6-ad26358047fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.003469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2d47e-17a9-4a37-9b39-ecfbe8f36310 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.003883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1e27a-a560-4a38-87d6-ad26358047fb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.008147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55617ded-598a-45a1-8b69-4fb848e0f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.008796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55617ded-598a-45a1-8b69-4fb848e0f9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.009069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55617ded-598a-45a1-8b69-4fb848e0f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.009334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55617ded-598a-45a1-8b69-4fb848e0f9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.009972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55617ded-598a-45a1-8b69-4fb848e0f9d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.012132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55617ded-598a-45a1-8b69-4fb848e0f9d5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.020575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:15.032362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:15.040086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 797/1574] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/users => generated 293 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:15.040086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1e27a-a560-4a38-87d6-ad26358047fb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.053041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1e27a-a560-4a38-87d6-ad26358047fb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.053647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 778/1575] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:14 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:15.054544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55617ded-598a-45a1-8b69-4fb848e0f9d5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.127449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6225e5-1e27-4957-bc84-1da805d6419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.128075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6225e5-1e27-4957-bc84-1da805d6419e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.128386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6225e5-1e27-4957-bc84-1da805d6419e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.128660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6225e5-1e27-4957-bc84-1da805d6419e admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.129303 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6225e5-1e27-4957-bc84-1da805d6419e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.131260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6225e5-1e27-4957-bc84-1da805d6419e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.139419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55617ded-598a-45a1-8b69-4fb848e0f9d5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.144489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c40aa-aa07-4a49-8a06-ae63c2abe041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.145181 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c40aa-aa07-4a49-8a06-ae63c2abe041 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.145535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c40aa-aa07-4a49-8a06-ae63c2abe041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.145895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c40aa-aa07-4a49-8a06-ae63c2abe041 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.146601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c40aa-aa07-4a49-8a06-ae63c2abe041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.147742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: WARNING py.warnings [None req-aa9c40aa-aa07-4a49-8a06-ae63c2abe041 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:12:15.147742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: warnings.warn(msg) Sep 06 01:12:15.147742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: Sep 06 01:12:15.149119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c40aa-aa07-4a49-8a06-ae63c2abe041 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.165137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 798/1576] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:15 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:15.166547 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6225e5-1e27-4957-bc84-1da805d6419e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.176938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 779/1577] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:15 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:15.177617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c40aa-aa07-4a49-8a06-ae63c2abe041 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.188393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c40aa-aa07-4a49-8a06-ae63c2abe041 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.249464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6225e5-1e27-4957-bc84-1da805d6419e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.255456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd569a-970b-4a8f-a06c-74f04b5eb9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.256091 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd569a-970b-4a8f-a06c-74f04b5eb9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.256403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd569a-970b-4a8f-a06c-74f04b5eb9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.256679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd569a-970b-4a8f-a06c-74f04b5eb9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.257719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd569a-970b-4a8f-a06c-74f04b5eb9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.259391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd569a-970b-4a8f-a06c-74f04b5eb9f6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.270830 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc6f4c-de71-4a0f-ab47-9ac0799fcb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.272035 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc6f4c-de71-4a0f-ab47-9ac0799fcb6e admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.272472 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc6f4c-de71-4a0f-ab47-9ac0799fcb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.272851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc6f4c-de71-4a0f-ab47-9ac0799fcb6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.273733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc6f4c-de71-4a0f-ab47-9ac0799fcb6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.276918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc6f4c-de71-4a0f-ab47-9ac0799fcb6e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.286890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 799/1578] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:15 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:15.288016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd569a-970b-4a8f-a06c-74f04b5eb9f6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.299261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd569a-970b-4a8f-a06c-74f04b5eb9f6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.304821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48f3db-d3a7-454b-ac75-e58fc74eaae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.305514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48f3db-d3a7-454b-ac75-e58fc74eaae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.305794 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48f3db-d3a7-454b-ac75-e58fc74eaae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.306092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48f3db-d3a7-454b-ac75-e58fc74eaae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.306869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48f3db-d3a7-454b-ac75-e58fc74eaae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.309046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48f3db-d3a7-454b-ac75-e58fc74eaae9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.313942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 780/1579] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:15 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:15.313942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc6f4c-de71-4a0f-ab47-9ac0799fcb6e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.348610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 800/1580] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:15 2022] POST /identity/v3/projects => generated 393 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:15.349718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48f3db-d3a7-454b-ac75-e58fc74eaae9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.387164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc6f4c-de71-4a0f-ab47-9ac0799fcb6e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.403124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:15.405501 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:15.423299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48f3db-d3a7-454b-ac75-e58fc74eaae9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.429575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a979b-0886-4614-9323-81de36a0da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.429749 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a979b-0886-4614-9323-81de36a0da51 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.430029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a979b-0886-4614-9323-81de36a0da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.430315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a979b-0886-4614-9323-81de36a0da51 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.430962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a979b-0886-4614-9323-81de36a0da51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.433056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a979b-0886-4614-9323-81de36a0da51 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.455111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b3b74-d394-47d2-b8bc-10ba3fe8a5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.456212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b3b74-d394-47d2-b8bc-10ba3fe8a5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.456697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b3b74-d394-47d2-b8bc-10ba3fe8a5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.457139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b3b74-d394-47d2-b8bc-10ba3fe8a5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.457281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 801/1581] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:15 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:15.458059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a979b-0886-4614-9323-81de36a0da51 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.458292 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b3b74-d394-47d2-b8bc-10ba3fe8a5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.460518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b3b74-d394-47d2-b8bc-10ba3fe8a5e6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.469318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a979b-0886-4614-9323-81de36a0da51 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.477134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eadf8-0610-42ad-82c8-b1cb397f44ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.477339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 781/1582] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:15.477447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eadf8-0610-42ad-82c8-b1cb397f44ae admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.477447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eadf8-0610-42ad-82c8-b1cb397f44ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.477653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b3b74-d394-47d2-b8bc-10ba3fe8a5e6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.477754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eadf8-0610-42ad-82c8-b1cb397f44ae admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.477754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eadf8-0610-42ad-82c8-b1cb397f44ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.478523 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eadf8-0610-42ad-82c8-b1cb397f44ae admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.486181 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b3b74-d394-47d2-b8bc-10ba3fe8a5e6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.495225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05903604-3799-4b3a-a534-ab6bb19c44b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.496391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05903604-3799-4b3a-a534-ab6bb19c44b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.496841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05903604-3799-4b3a-a534-ab6bb19c44b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.497607 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05903604-3799-4b3a-a534-ab6bb19c44b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.498513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05903604-3799-4b3a-a534-ab6bb19c44b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.500519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05903604-3799-4b3a-a534-ab6bb19c44b1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.506373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 802/1583] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:15 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:15.506373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eadf8-0610-42ad-82c8-b1cb397f44ae admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.515057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eadf8-0610-42ad-82c8-b1cb397f44ae admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.517443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 782/1584] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:15.520460 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565d36d-5b5f-40e5-9d01-d1282a86825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.521135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565d36d-5b5f-40e5-9d01-d1282a86825b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.521359 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565d36d-5b5f-40e5-9d01-d1282a86825b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.521516 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05903604-3799-4b3a-a534-ab6bb19c44b1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.521626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565d36d-5b5f-40e5-9d01-d1282a86825b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.522276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565d36d-5b5f-40e5-9d01-d1282a86825b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.523940 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565d36d-5b5f-40e5-9d01-d1282a86825b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.533063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05903604-3799-4b3a-a534-ab6bb19c44b1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.536536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 803/1585] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:15.537605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565d36d-5b5f-40e5-9d01-d1282a86825b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.541388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bb66f-0b08-4b37-b90a-d8036d6d6f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.542102 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bb66f-0b08-4b37-b90a-d8036d6d6f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.542373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bb66f-0b08-4b37-b90a-d8036d6d6f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.542646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bb66f-0b08-4b37-b90a-d8036d6d6f69 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.543384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bb66f-0b08-4b37-b90a-d8036d6d6f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.545423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bb66f-0b08-4b37-b90a-d8036d6d6f69 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.558034 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565d36d-5b5f-40e5-9d01-d1282a86825b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.564913 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd29b9-c6b3-4c39-b03f-d684287d0a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.565549 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd29b9-c6b3-4c39-b03f-d684287d0a16 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.565831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd29b9-c6b3-4c39-b03f-d684287d0a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.566106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd29b9-c6b3-4c39-b03f-d684287d0a16 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.566769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd29b9-c6b3-4c39-b03f-d684287d0a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.569041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd29b9-c6b3-4c39-b03f-d684287d0a16 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.580435 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 783/1586] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:15 2022] POST /identity/v3/users => generated 295 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:15.582276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bb66f-0b08-4b37-b90a-d8036d6d6f69 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.601825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 804/1587] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:15 2022] POST /identity/v3/users => generated 297 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:15.602512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bb66f-0b08-4b37-b90a-d8036d6d6f69 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.603349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd29b9-c6b3-4c39-b03f-d684287d0a16 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.610059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545f3a6-f9b6-4871-a5cf-bf5106f50c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.611246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545f3a6-f9b6-4871-a5cf-bf5106f50c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.611862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545f3a6-f9b6-4871-a5cf-bf5106f50c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.612143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545f3a6-f9b6-4871-a5cf-bf5106f50c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.613655 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545f3a6-f9b6-4871-a5cf-bf5106f50c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.615717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545f3a6-f9b6-4871-a5cf-bf5106f50c59 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.618993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd29b9-c6b3-4c39-b03f-d684287d0a16 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.624933 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58a984-8c7b-42aa-923e-9a4b3607490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.626629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a984-8c7b-42aa-923e-9a4b3607490e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.627011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a984-8c7b-42aa-923e-9a4b3607490e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.627441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a984-8c7b-42aa-923e-9a4b3607490e admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.628276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58a984-8c7b-42aa-923e-9a4b3607490e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.629789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 784/1588] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:15.630884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545f3a6-f9b6-4871-a5cf-bf5106f50c59 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.634233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58a984-8c7b-42aa-923e-9a4b3607490e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.643409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545f3a6-f9b6-4871-a5cf-bf5106f50c59 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.649060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 805/1589] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:15.650315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58a984-8c7b-42aa-923e-9a4b3607490e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.653112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8a8d8-7752-4ba4-9c34-e04bad6a64e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.653996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8a8d8-7752-4ba4-9c34-e04bad6a64e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.654125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8a8d8-7752-4ba4-9c34-e04bad6a64e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.654342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8a8d8-7752-4ba4-9c34-e04bad6a64e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.655004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8a8d8-7752-4ba4-9c34-e04bad6a64e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.657096 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8a8d8-7752-4ba4-9c34-e04bad6a64e1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.663538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58a984-8c7b-42aa-923e-9a4b3607490e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.674097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 785/1590] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:15.674097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8a8d8-7752-4ba4-9c34-e04bad6a64e1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.677650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d23ca-d467-4fdf-9a04-c723353d56bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.678400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d23ca-d467-4fdf-9a04-c723353d56bf admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.678775 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d23ca-d467-4fdf-9a04-c723353d56bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.679330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d23ca-d467-4fdf-9a04-c723353d56bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.680032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d23ca-d467-4fdf-9a04-c723353d56bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.682023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d23ca-d467-4fdf-9a04-c723353d56bf admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.690463 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8a8d8-7752-4ba4-9c34-e04bad6a64e1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.695692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 806/1591] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:15.696766 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d23ca-d467-4fdf-9a04-c723353d56bf admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.700762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e56931-beab-42b1-b1d9-1798a224cada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.701404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e56931-beab-42b1-b1d9-1798a224cada admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.701956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e56931-beab-42b1-b1d9-1798a224cada admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.701956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e56931-beab-42b1-b1d9-1798a224cada admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.702585 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e56931-beab-42b1-b1d9-1798a224cada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.704728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e56931-beab-42b1-b1d9-1798a224cada admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.708499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d23ca-d467-4fdf-9a04-c723353d56bf admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.713784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d88ebb-3c9f-47d0-88d9-336d5638683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.714906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d88ebb-3c9f-47d0-88d9-336d5638683e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.715341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d88ebb-3c9f-47d0-88d9-336d5638683e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.715705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d88ebb-3c9f-47d0-88d9-336d5638683e admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.716680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d88ebb-3c9f-47d0-88d9-336d5638683e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.718543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d88ebb-3c9f-47d0-88d9-336d5638683e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.719358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 786/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:15.722428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e56931-beab-42b1-b1d9-1798a224cada admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.736680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 807/1593] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:15.736868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e56931-beab-42b1-b1d9-1798a224cada admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.740265 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d88ebb-3c9f-47d0-88d9-336d5638683e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.745831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949134e-4b32-4340-a543-a45bf03c91cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.746569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949134e-4b32-4340-a543-a45bf03c91cd admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.747049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949134e-4b32-4340-a543-a45bf03c91cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.747386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949134e-4b32-4340-a543-a45bf03c91cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.748098 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949134e-4b32-4340-a543-a45bf03c91cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.750384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949134e-4b32-4340-a543-a45bf03c91cd admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.751373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d88ebb-3c9f-47d0-88d9-336d5638683e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.758194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795f3a3-be70-4f9c-8511-4c7a3a59532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.758828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795f3a3-be70-4f9c-8511-4c7a3a59532d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.759106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795f3a3-be70-4f9c-8511-4c7a3a59532d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.759375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795f3a3-be70-4f9c-8511-4c7a3a59532d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.760117 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795f3a3-be70-4f9c-8511-4c7a3a59532d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.762035 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795f3a3-be70-4f9c-8511-4c7a3a59532d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.765642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 787/1594] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:15.766640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949134e-4b32-4340-a543-a45bf03c91cd admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.777049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 808/1595] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:15.777049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795f3a3-be70-4f9c-8511-4c7a3a59532d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.778874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949134e-4b32-4340-a543-a45bf03c91cd admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.786582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795f3a3-be70-4f9c-8511-4c7a3a59532d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.786783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1446f1-6e6b-41b9-b34f-202342f18c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.787318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1446f1-6e6b-41b9-b34f-202342f18c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.787592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1446f1-6e6b-41b9-b34f-202342f18c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.787925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1446f1-6e6b-41b9-b34f-202342f18c96 admin admin] PATH_INFO: `/v3/projects/ad20bf12dbff4381b8df0ea59a705d14/users/cac6f7cd8ce54c10bceff658b962414b/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.792012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75232a82-b0c8-4812-b204-1326b7149ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.792853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75232a82-b0c8-4812-b204-1326b7149ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.793274 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75232a82-b0c8-4812-b204-1326b7149ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.793688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75232a82-b0c8-4812-b204-1326b7149ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.794584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75232a82-b0c8-4812-b204-1326b7149ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.796828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75232a82-b0c8-4812-b204-1326b7149ce9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.809486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1446f1-6e6b-41b9-b34f-202342f18c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad20bf12dbff4381b8df0ea59a705d14, user_id=cac6f7cd8ce54c10bceff658b962414b, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.810170 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 809/1596] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:15.810992 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75232a82-b0c8-4812-b204-1326b7149ce9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.812419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1446f1-6e6b-41b9-b34f-202342f18c96 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.823603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75232a82-b0c8-4812-b204-1326b7149ce9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.836099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 788/1597] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:15 2022] PUT /identity/v3/projects/ad20bf12dbff4381b8df0ea59a705d14/users/cac6f7cd8ce54c10bceff658b962414b/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:15.838237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1446f1-6e6b-41b9-b34f-202342f18c96 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.908658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f60764-fd4c-4898-b7df-02721695e5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.909721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f60764-fd4c-4898-b7df-02721695e5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.909721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f60764-fd4c-4898-b7df-02721695e5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.910611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f60764-fd4c-4898-b7df-02721695e5a2 admin admin] PATH_INFO: `/v3/projects/096851b3d0e74cde98d006318abc4325/users/89f414f0674e4e358217223c95754761/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.929100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f60764-fd4c-4898-b7df-02721695e5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=096851b3d0e74cde98d006318abc4325, user_id=89f414f0674e4e358217223c95754761, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.929427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1446f1-6e6b-41b9-b34f-202342f18c96 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:15.932528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f60764-fd4c-4898-b7df-02721695e5a2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.934468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e265b14-b57d-429e-8e2a-d8882dd160f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:15.935402 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e265b14-b57d-429e-8e2a-d8882dd160f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:15.935692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e265b14-b57d-429e-8e2a-d8882dd160f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:15.935953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e265b14-b57d-429e-8e2a-d8882dd160f1 admin admin] PATH_INFO: `/v3/projects/b7901a82846c495fad13e5cf877bb62b/users/de74c1556bc44b11bc577b2683232bd1/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:15.960346 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 810/1598] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:15 2022] PUT /identity/v3/projects/096851b3d0e74cde98d006318abc4325/users/89f414f0674e4e358217223c95754761/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:15.960346 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f60764-fd4c-4898-b7df-02721695e5a2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:15.961007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e265b14-b57d-429e-8e2a-d8882dd160f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7901a82846c495fad13e5cf877bb62b, user_id=de74c1556bc44b11bc577b2683232bd1, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:15.966393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e265b14-b57d-429e-8e2a-d8882dd160f1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:15.984686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:15.986260 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:15.997136 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 789/1599] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:15 2022] PUT /identity/v3/projects/b7901a82846c495fad13e5cf877bb62b/users/de74c1556bc44b11bc577b2683232bd1/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:15.999207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e265b14-b57d-429e-8e2a-d8882dd160f1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:16.041010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f60764-fd4c-4898-b7df-02721695e5a2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:16.101194 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e265b14-b57d-429e-8e2a-d8882dd160f1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:16.106973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc34d30-c3bf-4c24-8845-c6dc6f234e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:16.107819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc34d30-c3bf-4c24-8845-c6dc6f234e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.108336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc34d30-c3bf-4c24-8845-c6dc6f234e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.108794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc34d30-c3bf-4c24-8845-c6dc6f234e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.109622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc34d30-c3bf-4c24-8845-c6dc6f234e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:16.113509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc34d30-c3bf-4c24-8845-c6dc6f234e16 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:16.125067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 790/1600] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:16.126075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc34d30-c3bf-4c24-8845-c6dc6f234e16 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:16.128409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e339f1b-8134-4036-9700-822eca9a5cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:16.129040 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e339f1b-8134-4036-9700-822eca9a5cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.129314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e339f1b-8134-4036-9700-822eca9a5cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.129585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e339f1b-8134-4036-9700-822eca9a5cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.130285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e339f1b-8134-4036-9700-822eca9a5cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:16.132909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e339f1b-8134-4036-9700-822eca9a5cbc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:16.141049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc34d30-c3bf-4c24-8845-c6dc6f234e16 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:16.150143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 811/1601] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:16.150143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e339f1b-8134-4036-9700-822eca9a5cbc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:16.153375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f0619-2d19-4fe7-bf66-5c65809c3f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:16.153635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f0619-2d19-4fe7-bf66-5c65809c3f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.153969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f0619-2d19-4fe7-bf66-5c65809c3f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.154295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f0619-2d19-4fe7-bf66-5c65809c3f66 admin admin] PATH_INFO: `/v3/projects/a2a900feb65448c49206a2c93f05ec9d/users/98c0fd0ea5864180b2758824270eee3f/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.163375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e339f1b-8134-4036-9700-822eca9a5cbc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:16.168360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b9257-546f-4b7c-987c-718641f8f468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:16.169156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b9257-546f-4b7c-987c-718641f8f468 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.169497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b9257-546f-4b7c-987c-718641f8f468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.169834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b9257-546f-4b7c-987c-718641f8f468 admin admin] PATH_INFO: `/v3/projects/426763228fba40c0aca401f19594bd0d/users/c6c4c633d1bd403f9a7cb0171b69afda/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.171752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f0619-2d19-4fe7-bf66-5c65809c3f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a900feb65448c49206a2c93f05ec9d, user_id=98c0fd0ea5864180b2758824270eee3f, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:16.174933 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f0619-2d19-4fe7-bf66-5c65809c3f66 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:16.192634 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b9257-546f-4b7c-987c-718641f8f468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426763228fba40c0aca401f19594bd0d, user_id=c6c4c633d1bd403f9a7cb0171b69afda, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:16.196834 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 791/1602] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:16 2022] PUT /identity/v3/projects/a2a900feb65448c49206a2c93f05ec9d/users/98c0fd0ea5864180b2758824270eee3f/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:16.196834 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeb961-c754-4783-b1b4-a55cf9b5f48b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.196834 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeb961-c754-4783-b1b4-a55cf9b5f48b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.196834 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeb961-c754-4783-b1b4-a55cf9b5f48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.197263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b9257-546f-4b7c-987c-718641f8f468 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:16.219447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 812/1603] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:16 2022] PUT /identity/v3/projects/426763228fba40c0aca401f19594bd0d/users/c6c4c633d1bd403f9a7cb0171b69afda/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:16.222108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18dd14-13ed-413b-90e6-61e7d35bc95f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.224365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18dd14-13ed-413b-90e6-61e7d35bc95f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.224716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18dd14-13ed-413b-90e6-61e7d35bc95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.231969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d0eeb961-c754-4783-b1b4-a55cf9b5f48b None None] MFA Rules not processed for user `cac6f7cd8ce54c10bceff658b962414b`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:16.233601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d0eeb961-c754-4783-b1b4-a55cf9b5f48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:16.276130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2d18dd14-13ed-413b-90e6-61e7d35bc95f None None] MFA Rules not processed for user `89f414f0674e4e358217223c95754761`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:16.277686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2d18dd14-13ed-413b-90e6-61e7d35bc95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:16.317721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 792/1604] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:16.321663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc2c7c-bdd1-43f1-a5fa-ab93d0cd9b29 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.324703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc2c7c-bdd1-43f1-a5fa-ab93d0cd9b29 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.325061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc2c7c-bdd1-43f1-a5fa-ab93d0cd9b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.362333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2edc2c7c-bdd1-43f1-a5fa-ab93d0cd9b29 None None] MFA Rules not processed for user `de74c1556bc44b11bc577b2683232bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:16.363980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2edc2c7c-bdd1-43f1-a5fa-ab93d0cd9b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:16.410020 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 813/1605] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:16.411634 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18dd14-13ed-413b-90e6-61e7d35bc95f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:16.443141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:16.472627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 793/1606] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:16.473667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc2c7c-bdd1-43f1-a5fa-ab93d0cd9b29 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:16.490732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:16.543271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18dd14-13ed-413b-90e6-61e7d35bc95f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:16.549539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8ca9e-aa32-4df3-85b4-04cf9e40ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:16.550492 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8ca9e-aa32-4df3-85b4-04cf9e40ec0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.551360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8ca9e-aa32-4df3-85b4-04cf9e40ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.551505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8ca9e-aa32-4df3-85b4-04cf9e40ec0e admin admin] PATH_INFO: `/v3/projects/3a7f33f41c194eb187acf8d3657c54c3/users/d1dd5768f5c640ac9302d0250f76f5a4/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.562467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc2c7c-bdd1-43f1-a5fa-ab93d0cd9b29 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:16.567390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2923726-848f-4774-90dd-f9badb96dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:16.568148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2923726-848f-4774-90dd-f9badb96dd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.568525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2923726-848f-4774-90dd-f9badb96dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.568806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2923726-848f-4774-90dd-f9badb96dd60 admin admin] PATH_INFO: `/v3/projects/38e3d31127cf4858a529d8564ecd710a/users/3ea04d2b0055428090fc30d01f7c601e/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.576514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8ca9e-aa32-4df3-85b4-04cf9e40ec0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7f33f41c194eb187acf8d3657c54c3, user_id=d1dd5768f5c640ac9302d0250f76f5a4, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:16.579369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8ca9e-aa32-4df3-85b4-04cf9e40ec0e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:16.589738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2923726-848f-4774-90dd-f9badb96dd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e3d31127cf4858a529d8564ecd710a, user_id=3ea04d2b0055428090fc30d01f7c601e, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:16.592786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2923726-848f-4774-90dd-f9badb96dd60 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:16.596687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 814/1607] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:16 2022] PUT /identity/v3/projects/3a7f33f41c194eb187acf8d3657c54c3/users/d1dd5768f5c640ac9302d0250f76f5a4/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:16.598302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94002d84-0998-4972-95bb-efee5abaf6e7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.598585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94002d84-0998-4972-95bb-efee5abaf6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.598896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94002d84-0998-4972-95bb-efee5abaf6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.614619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 794/1608] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:16 2022] PUT /identity/v3/projects/38e3d31127cf4858a529d8564ecd710a/users/3ea04d2b0055428090fc30d01f7c601e/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:16.616267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17516455-5c69-4fe7-88e2-e7ece1f11a18 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.616717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17516455-5c69-4fe7-88e2-e7ece1f11a18 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.617088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17516455-5c69-4fe7-88e2-e7ece1f11a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.629028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-94002d84-0998-4972-95bb-efee5abaf6e7 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:16.630666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-94002d84-0998-4972-95bb-efee5abaf6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:16.653375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-17516455-5c69-4fe7-88e2-e7ece1f11a18 None None] MFA Rules not processed for user `c6c4c633d1bd403f9a7cb0171b69afda`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:16.654684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-17516455-5c69-4fe7-88e2-e7ece1f11a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:16.763402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 815/1609] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:16.763402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb12b5-b423-46ee-9ee7-c13a0e0fdef0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.763402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb12b5-b423-46ee-9ee7-c13a0e0fdef0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.763402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb12b5-b423-46ee-9ee7-c13a0e0fdef0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.763402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 816/1610] 10.222.0.25 () {54 vars in 962 bytes} [Tue Sep 6 01:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:12:16.763402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e89ad-8980-4247-baab-5e975f824376 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.763402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e89ad-8980-4247-baab-5e975f824376 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.764854 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e89ad-8980-4247-baab-5e975f824376 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.764854 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 817/1611] 10.222.0.25 () {54 vars in 962 bytes} [Tue Sep 6 01:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:12:16.764854 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e89ad-8980-4247-baab-5e975f824376 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:16.810058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 795/1612] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:16.812593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae64ac2-6158-49f5-9352-1abc6dab2168 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.813298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae64ac2-6158-49f5-9352-1abc6dab2168 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.813757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae64ac2-6158-49f5-9352-1abc6dab2168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.835449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e89ad-8980-4247-baab-5e975f824376 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:16.840125 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab122e7-1c11-42c5-b417-92abe92b737e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:16.840940 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab122e7-1c11-42c5-b417-92abe92b737e service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.841315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab122e7-1c11-42c5-b417-92abe92b737e service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.841702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab122e7-1c11-42c5-b417-92abe92b737e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.849310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-5ae64ac2-6158-49f5-9352-1abc6dab2168 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:16.850818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5ae64ac2-6158-49f5-9352-1abc6dab2168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:16.867832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 796/1613] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:16.869312 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed02db-a188-4730-bcd7-38d52b3b7a17 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.869780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed02db-a188-4730-bcd7-38d52b3b7a17 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.869931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed02db-a188-4730-bcd7-38d52b3b7a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.890501 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f6ed02db-a188-4730-bcd7-38d52b3b7a17 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:16.892019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f6ed02db-a188-4730-bcd7-38d52b3b7a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:16.906641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 797/1614] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:16.911126 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c5388-fb4a-42ea-a6c8-afee5b10a499 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:16.911534 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c5388-fb4a-42ea-a6c8-afee5b10a499 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:16.911902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c5388-fb4a-42ea-a6c8-afee5b10a499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:16.934337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab122e7-1c11-42c5-b417-92abe92b737e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:16.936213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab122e7-1c11-42c5-b417-92abe92b737e service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:16.947169 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 818/1615] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:16.947745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab122e7-1c11-42c5-b417-92abe92b737e service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:16.949493 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8ab122e7-1c11-42c5-b417-92abe92b737e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:16.965857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:16.977365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-945c5388-fb4a-42ea-a6c8-afee5b10a499 None None] MFA Rules not processed for user `42b9c25e98fe4b1bbc33a601d4150071`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:16.978644 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-945c5388-fb4a-42ea-a6c8-afee5b10a499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:17.027343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:17.052186 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab122e7-1c11-42c5-b417-92abe92b737e service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:17.058291 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d0656-6496-4592-bda8-238680b2b131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:17.059307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d0656-6496-4592-bda8-238680b2b131 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:17.059599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d0656-6496-4592-bda8-238680b2b131 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:17.059943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d0656-6496-4592-bda8-238680b2b131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:17.070729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d0656-6496-4592-bda8-238680b2b131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:17.072515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d0656-6496-4592-bda8-238680b2b131 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:17.083872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 819/1616] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:17.101143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e3957-c30a-423f-9700-c72ec53cfdd9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:17.102118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 798/1617] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Sep 6 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:17.102753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e3957-c30a-423f-9700-c72ec53cfdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:17.102909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e3957-c30a-423f-9700-c72ec53cfdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:17.104790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c5388-fb4a-42ea-a6c8-afee5b10a499 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:17.118177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c5388-fb4a-42ea-a6c8-afee5b10a499 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:17.135079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64153b31-77a6-4064-afc2-76225a4d9326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:17.137536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64153b31-77a6-4064-afc2-76225a4d9326 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:17.139204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64153b31-77a6-4064-afc2-76225a4d9326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:17.139486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64153b31-77a6-4064-afc2-76225a4d9326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:17.165113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8f5e3957-c30a-423f-9700-c72ec53cfdd9 None None] MFA Rules not processed for user `42b9c25e98fe4b1bbc33a601d4150071`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:17.166361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8f5e3957-c30a-423f-9700-c72ec53cfdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:17.177094 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64153b31-77a6-4064-afc2-76225a4d9326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:17.178752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64153b31-77a6-4064-afc2-76225a4d9326 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:17.189157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 820/1618] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Sep 6 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:17.191141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e3957-c30a-423f-9700-c72ec53cfdd9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:17.203538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e3957-c30a-423f-9700-c72ec53cfdd9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:17.209472 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7b9e-6bd9-4ac7-940a-5377616f3e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:17.210211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7b9e-6bd9-4ac7-940a-5377616f3e65 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:17.210967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7b9e-6bd9-4ac7-940a-5377616f3e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:17.211310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7b9e-6bd9-4ac7-940a-5377616f3e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:17.223322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 799/1619] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:17.224235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64153b31-77a6-4064-afc2-76225a4d9326 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:17.225748 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c7b9e-6bd9-4ac7-940a-5377616f3e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:17.227536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c7b9e-6bd9-4ac7-940a-5377616f3e65 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:17.243629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 821/1620] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:17.245009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7b9e-6bd9-4ac7-940a-5377616f3e65 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:17.250178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64153b31-77a6-4064-afc2-76225a4d9326 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:17.263972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64015d56-cf89-41d3-9e33-d6cb1fcbf354 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:17.264648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015d56-cf89-41d3-9e33-d6cb1fcbf354 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:17.264927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015d56-cf89-41d3-9e33-d6cb1fcbf354 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:17.265854 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015d56-cf89-41d3-9e33-d6cb1fcbf354 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:17.278046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7b9e-6bd9-4ac7-940a-5377616f3e65 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:17.286699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5e235-0a87-4f1c-b78f-dd13e4d8180f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:17.287784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5e235-0a87-4f1c-b78f-dd13e4d8180f service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:17.288146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5e235-0a87-4f1c-b78f-dd13e4d8180f service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:17.288765 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5e235-0a87-4f1c-b78f-dd13e4d8180f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:17.396467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64015d56-cf89-41d3-9e33-d6cb1fcbf354 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:17.399811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64015d56-cf89-41d3-9e33-d6cb1fcbf354 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:17.414401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 800/1621] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:17.442870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5e235-0a87-4f1c-b78f-dd13e4d8180f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:17.444747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5e235-0a87-4f1c-b78f-dd13e4d8180f service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:17.464249 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 822/1622] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:17.859206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18982fb-dc12-4988-ac84-e2467125b7a5 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:17.859778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18982fb-dc12-4988-ac84-e2467125b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:17.859778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18982fb-dc12-4988-ac84-e2467125b7a5 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:17.861836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 801/1623] 10.222.0.25 () {54 vars in 912 bytes} [Tue Sep 6 01:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:12:17.869715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bc64d-eac1-43c3-af26-31e511e72b11 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:17.870504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bc64d-eac1-43c3-af26-31e511e72b11 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:17.870504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bc64d-eac1-43c3-af26-31e511e72b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:17.917740 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18982fb-dc12-4988-ac84-e2467125b7a5 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:17.922087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c90bc64d-eac1-43c3-af26-31e511e72b11 None None] MFA Rules not processed for user `42b9c25e98fe4b1bbc33a601d4150071`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:17.923556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c90bc64d-eac1-43c3-af26-31e511e72b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:17.956980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18982fb-dc12-4988-ac84-e2467125b7a5 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:17.961949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 823/1624] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:17.970484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bc64d-eac1-43c3-af26-31e511e72b11 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:17.983855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bc64d-eac1-43c3-af26-31e511e72b11 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:17.989482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dcb5b-951d-4f64-b51d-3fa67b027acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:17.990599 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dcb5b-951d-4f64-b51d-3fa67b027acf service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:17.991165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dcb5b-951d-4f64-b51d-3fa67b027acf service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:17.991507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dcb5b-951d-4f64-b51d-3fa67b027acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:17.994268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0d390-8b97-44e8-82b5-21e807108eb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:17.995018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0d390-8b97-44e8-82b5-21e807108eb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:17.995232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0d390-8b97-44e8-82b5-21e807108eb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:17.995948 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0d390-8b97-44e8-82b5-21e807108eb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:18.012663 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0d390-8b97-44e8-82b5-21e807108eb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:18.015043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dcb5b-951d-4f64-b51d-3fa67b027acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:18.015316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0d390-8b97-44e8-82b5-21e807108eb5 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:18.019196 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dcb5b-951d-4f64-b51d-3fa67b027acf service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:18.030547 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 824/1625] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:12:18.053461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 802/1626] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:18.100372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bca04-9b19-4751-b7ec-a245f9b708d2 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:18.100668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bca04-9b19-4751-b7ec-a245f9b708d2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:18.100945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bca04-9b19-4751-b7ec-a245f9b708d2 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:18.102552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 825/1627] 10.222.0.25 () {54 vars in 912 bytes} [Tue Sep 6 01:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:12:18.110199 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce383da-db60-4969-b61a-b79e72dc2422 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:18.110790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce383da-db60-4969-b61a-b79e72dc2422 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:18.111071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce383da-db60-4969-b61a-b79e72dc2422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:18.150024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7ce383da-db60-4969-b61a-b79e72dc2422 None None] MFA Rules not processed for user `42b9c25e98fe4b1bbc33a601d4150071`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:18.151850 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7ce383da-db60-4969-b61a-b79e72dc2422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:18.177883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 803/1628] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:12:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:12:18.187738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bca04-9b19-4751-b7ec-a245f9b708d2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:18.202982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bca04-9b19-4751-b7ec-a245f9b708d2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:18.207812 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6e33a-6b59-4832-80ef-75ea758e5576 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:18.216217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6e33a-6b59-4832-80ef-75ea758e5576 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:18.216866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6e33a-6b59-4832-80ef-75ea758e5576 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:18.217417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6e33a-6b59-4832-80ef-75ea758e5576 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:18.242218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6e33a-6b59-4832-80ef-75ea758e5576 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:18.243755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6e33a-6b59-4832-80ef-75ea758e5576 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:18.275566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 826/1629] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:19.582969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce383da-db60-4969-b61a-b79e72dc2422 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:19.597731 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce383da-db60-4969-b61a-b79e72dc2422 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:19.612594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:19.613283 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:19.613799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:19.614264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] PATH_INFO: `/v3/users/89f414f0674e4e358217223c95754761` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:19.615733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f414f0674e4e358217223c95754761)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:19.618163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:19.729655 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f414f0674e4e358217223c95754761'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:19.730353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f414f0674e4e358217223c95754761'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:19.750028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f414f0674e4e358217223c95754761'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:19.751831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f414f0674e4e358217223c95754761'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:19.814569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f414f0674e4e358217223c95754761'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:19.814569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 804/1630] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:12:19 2022] DELETE /identity/v3/users/89f414f0674e4e358217223c95754761 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:19.815239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eb635-0026-427b-8e81-8c9e9fd6c610 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:19.816279 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eb635-0026-427b-8e81-8c9e9fd6c610 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:19.816279 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eb635-0026-427b-8e81-8c9e9fd6c610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:19.863355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-302eb635-0026-427b-8e81-8c9e9fd6c610 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:19.864685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-302eb635-0026-427b-8e81-8c9e9fd6c610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:19.926969 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:19.945556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 827/1631] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:19.979298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:19.980825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:19.994657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:20.077306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab451cb-15d0-40c6-a4fb-9bbea298f9b3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:20.083014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db1cfc-b5d6-490a-a28e-84df79901262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:20.084175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db1cfc-b5d6-490a-a28e-84df79901262 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:20.085135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db1cfc-b5d6-490a-a28e-84df79901262 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:20.085540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db1cfc-b5d6-490a-a28e-84df79901262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:20.101799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db1cfc-b5d6-490a-a28e-84df79901262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:20.104643 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db1cfc-b5d6-490a-a28e-84df79901262 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:20.122075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 805/1632] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:21.475756 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302eb635-0026-427b-8e81-8c9e9fd6c610 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:21.477325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-302eb635-0026-427b-8e81-8c9e9fd6c610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:21.497211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302eb635-0026-427b-8e81-8c9e9fd6c610 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:21.514457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e007b-8c0a-4d42-af35-06c07e5c5f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:21.515397 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e007b-8c0a-4d42-af35-06c07e5c5f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:21.515902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e007b-8c0a-4d42-af35-06c07e5c5f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:21.516699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e007b-8c0a-4d42-af35-06c07e5c5f5e admin admin] PATH_INFO: `/v3/projects/096851b3d0e74cde98d006318abc4325` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:21.518379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e007b-8c0a-4d42-af35-06c07e5c5f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=096851b3d0e74cde98d006318abc4325)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:21.530601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e007b-8c0a-4d42-af35-06c07e5c5f5e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:21.662687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-724e007b-8c0a-4d42-af35-06c07e5c5f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096851b3d0e74cde98d006318abc4325', 'request_id': 'req-724e007b-8c0a-4d42-af35-06c07e5c5f5e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:21.681632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-724e007b-8c0a-4d42-af35-06c07e5c5f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096851b3d0e74cde98d006318abc4325', 'request_id': 'req-724e007b-8c0a-4d42-af35-06c07e5c5f5e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:21.691525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-724e007b-8c0a-4d42-af35-06c07e5c5f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096851b3d0e74cde98d006318abc4325', 'request_id': 'req-724e007b-8c0a-4d42-af35-06c07e5c5f5e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:21.712382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-724e007b-8c0a-4d42-af35-06c07e5c5f5e admin admin] The token cache is being invalidate because project 096851b3d0e74cde98d006318abc4325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:12:21.712605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-724e007b-8c0a-4d42-af35-06c07e5c5f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:21.714670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-724e007b-8c0a-4d42-af35-06c07e5c5f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:21.718611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 828/1633] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:12:21 2022] DELETE /identity/v3/projects/096851b3d0e74cde98d006318abc4325 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:21.723789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027b6b8-3fe2-4eb6-9fe6-9c2ce7dd64a3 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:21.724273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027b6b8-3fe2-4eb6-9fe6-9c2ce7dd64a3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:21.724369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027b6b8-3fe2-4eb6-9fe6-9c2ce7dd64a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:21.784634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3027b6b8-3fe2-4eb6-9fe6-9c2ce7dd64a3 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:21.788082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3027b6b8-3fe2-4eb6-9fe6-9c2ce7dd64a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:21.917192 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 806/1634] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:21.925018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b9253-03cf-4041-bee1-30d9b2b60673 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:21.925774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b9253-03cf-4041-bee1-30d9b2b60673 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:21.926260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b9253-03cf-4041-bee1-30d9b2b60673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:21.950198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-831b9253-03cf-4041-bee1-30d9b2b60673 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:21.951873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-831b9253-03cf-4041-bee1-30d9b2b60673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:21.973307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 829/1635] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:21.973494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027b6b8-3fe2-4eb6-9fe6-9c2ce7dd64a3 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:21.996934 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027b6b8-3fe2-4eb6-9fe6-9c2ce7dd64a3 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:22.013903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9003-1b96-4ad5-a29e-ac16081f099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:22.014612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9003-1b96-4ad5-a29e-ac16081f099b admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:22.014885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9003-1b96-4ad5-a29e-ac16081f099b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:22.018246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9003-1b96-4ad5-a29e-ac16081f099b admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:22.018971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9003-1b96-4ad5-a29e-ac16081f099b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:22.019277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9003-1b96-4ad5-a29e-ac16081f099b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:22.024939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9003-1b96-4ad5-a29e-ac16081f099b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:22.061731 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 807/1636] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:12:22.064045 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b9253-03cf-4041-bee1-30d9b2b60673 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:22.083121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b9253-03cf-4041-bee1-30d9b2b60673 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:22.114172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d3a73-2b98-4d68-8e28-28580cd9c814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:22.122394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d3a73-2b98-4d68-8e28-28580cd9c814 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:22.122930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d3a73-2b98-4d68-8e28-28580cd9c814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:22.123650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d3a73-2b98-4d68-8e28-28580cd9c814 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:22.124690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d3a73-2b98-4d68-8e28-28580cd9c814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:22.127036 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d3a73-2b98-4d68-8e28-28580cd9c814 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:22.246092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 830/1637] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:22 2022] POST /identity/v3/projects => generated 353 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:22.248405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9003-1b96-4ad5-a29e-ac16081f099b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:22.248405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-538f9003-1b96-4ad5-a29e-ac16081f099b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:22.250132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d3a73-2b98-4d68-8e28-28580cd9c814 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:22.264878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9003-1b96-4ad5-a29e-ac16081f099b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:22.414565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d3a73-2b98-4d68-8e28-28580cd9c814 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:22.421120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f686cb5-0348-49b2-9126-37413ead8a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:22.421908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f686cb5-0348-49b2-9126-37413ead8a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:22.422184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f686cb5-0348-49b2-9126-37413ead8a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:22.422500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f686cb5-0348-49b2-9126-37413ead8a67 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:22.424499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f686cb5-0348-49b2-9126-37413ead8a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:22.438069 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f686cb5-0348-49b2-9126-37413ead8a67 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:22.445692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034435f1-0123-4f9b-8b9d-df1fbdaaa0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:22.450534 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034435f1-0123-4f9b-8b9d-df1fbdaaa0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:22.450843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034435f1-0123-4f9b-8b9d-df1fbdaaa0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:22.451120 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034435f1-0123-4f9b-8b9d-df1fbdaaa0e5 admin admin] PATH_INFO: `/v3/users/c6c4c633d1bd403f9a7cb0171b69afda` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:22.455328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034435f1-0123-4f9b-8b9d-df1fbdaaa0e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c4c633d1bd403f9a7cb0171b69afda)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:22.472122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034435f1-0123-4f9b-8b9d-df1fbdaaa0e5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:22.522084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 831/1638] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:22 2022] POST /identity/v3/users => generated 277 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:22.523174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f686cb5-0348-49b2-9126-37413ead8a67 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:22.557080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f686cb5-0348-49b2-9126-37413ead8a67 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:22.569066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8fc86-e259-4d14-9401-fe9c8f372f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:22.570051 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8fc86-e259-4d14-9401-fe9c8f372f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:22.570637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8fc86-e259-4d14-9401-fe9c8f372f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:22.571421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8fc86-e259-4d14-9401-fe9c8f372f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:22.572227 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8fc86-e259-4d14-9401-fe9c8f372f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:22.581102 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8fc86-e259-4d14-9401-fe9c8f372f42 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:22.614057 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:22.622342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 832/1639] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:22.632532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8fc86-e259-4d14-9401-fe9c8f372f42 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:22.636518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-034435f1-0123-4f9b-8b9d-df1fbdaaa0e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c4c633d1bd403f9a7cb0171b69afda'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:22.637699 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-034435f1-0123-4f9b-8b9d-df1fbdaaa0e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c4c633d1bd403f9a7cb0171b69afda'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:22.661102 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8fc86-e259-4d14-9401-fe9c8f372f42 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:22.662592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-034435f1-0123-4f9b-8b9d-df1fbdaaa0e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c4c633d1bd403f9a7cb0171b69afda'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:22.663569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-034435f1-0123-4f9b-8b9d-df1fbdaaa0e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c4c633d1bd403f9a7cb0171b69afda'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:22.679461 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473d245-1bc8-4b1a-b279-3b8f59a14c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:22.680149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d245-1bc8-4b1a-b279-3b8f59a14c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:22.680495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d245-1bc8-4b1a-b279-3b8f59a14c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:22.680799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d245-1bc8-4b1a-b279-3b8f59a14c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:22.682690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473d245-1bc8-4b1a-b279-3b8f59a14c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:22.686202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473d245-1bc8-4b1a-b279-3b8f59a14c7f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:22.698609 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-034435f1-0123-4f9b-8b9d-df1fbdaaa0e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c4c633d1bd403f9a7cb0171b69afda'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:22.712089 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 833/1640] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:22.725295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473d245-1bc8-4b1a-b279-3b8f59a14c7f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:22.727464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 808/1641] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:12:22 2022] DELETE /identity/v3/users/c6c4c633d1bd403f9a7cb0171b69afda => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:22.731917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdb4ce-8e6f-46ef-84b5-e2cc6ab6b745 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:22.732663 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3473d245-1bc8-4b1a-b279-3b8f59a14c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:22.735653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdb4ce-8e6f-46ef-84b5-e2cc6ab6b745 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:22.736985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdb4ce-8e6f-46ef-84b5-e2cc6ab6b745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:22.766537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473d245-1bc8-4b1a-b279-3b8f59a14c7f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:22.785474 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-16bdb4ce-8e6f-46ef-84b5-e2cc6ab6b745 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:22.786752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-16bdb4ce-8e6f-46ef-84b5-e2cc6ab6b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:22.796608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:22.898842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b36c4d-6cb0-4825-8e67-2f053b13dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:22.900263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b36c4d-6cb0-4825-8e67-2f053b13dd49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:22.906189 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b36c4d-6cb0-4825-8e67-2f053b13dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:22.906189 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b36c4d-6cb0-4825-8e67-2f053b13dd49 admin admin] PATH_INFO: `/v3/projects/62456453a2aa4da58e30e6043ad615cf/users/68fb70efda24411a87480fe10dabb6a0/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:22.906446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 809/1642] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:22.927341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b36c4d-6cb0-4825-8e67-2f053b13dd49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62456453a2aa4da58e30e6043ad615cf, user_id=68fb70efda24411a87480fe10dabb6a0, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:22.930763 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdb4ce-8e6f-46ef-84b5-e2cc6ab6b745 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:22.932202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-16bdb4ce-8e6f-46ef-84b5-e2cc6ab6b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:22.943486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b36c4d-6cb0-4825-8e67-2f053b13dd49 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:22.981299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 834/1643] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:22 2022] PUT /identity/v3/projects/62456453a2aa4da58e30e6043ad615cf/users/68fb70efda24411a87480fe10dabb6a0/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:22.995002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcb0b1-5a54-4af3-9018-73fd36fce024 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:22.995289 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcb0b1-5a54-4af3-9018-73fd36fce024 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:22.995563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcb0b1-5a54-4af3-9018-73fd36fce024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:23.069537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-23bcb0b1-5a54-4af3-9018-73fd36fce024 None None] MFA Rules not processed for user `68fb70efda24411a87480fe10dabb6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:23.071017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-23bcb0b1-5a54-4af3-9018-73fd36fce024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:23.086414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdb4ce-8e6f-46ef-84b5-e2cc6ab6b745 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:23.241812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c5248-4d9a-4c69-8076-8a0306382727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:23.243469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c5248-4d9a-4c69-8076-8a0306382727 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:23.244411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c5248-4d9a-4c69-8076-8a0306382727 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:23.245241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c5248-4d9a-4c69-8076-8a0306382727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:23.296769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 835/1644] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:23.297926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcb0b1-5a54-4af3-9018-73fd36fce024 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:23.318693 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:23.397984 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c5248-4d9a-4c69-8076-8a0306382727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:23.400058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c5248-4d9a-4c69-8076-8a0306382727 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:23.436807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 810/1645] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:12:23.471662 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcb0b1-5a54-4af3-9018-73fd36fce024 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:23.490042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a287be-30b3-4ad2-8836-12ed0ad480d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:23.492140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a287be-30b3-4ad2-8836-12ed0ad480d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:23.497723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a287be-30b3-4ad2-8836-12ed0ad480d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:23.498490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a287be-30b3-4ad2-8836-12ed0ad480d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:23.499392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a287be-30b3-4ad2-8836-12ed0ad480d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:23.502538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a287be-30b3-4ad2-8836-12ed0ad480d7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:23.563127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 836/1646] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:23 2022] POST /identity/v3/projects => generated 357 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:23.563928 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c5248-4d9a-4c69-8076-8a0306382727 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:23.579335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c5248-4d9a-4c69-8076-8a0306382727 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:23.775556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0505655-a8c6-4ebb-bbf4-90d5193c8f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:23.777867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0505655-a8c6-4ebb-bbf4-90d5193c8f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:23.778489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0505655-a8c6-4ebb-bbf4-90d5193c8f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:23.780307 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0505655-a8c6-4ebb-bbf4-90d5193c8f1c admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:23.781133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0505655-a8c6-4ebb-bbf4-90d5193c8f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:23.785863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0505655-a8c6-4ebb-bbf4-90d5193c8f1c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:23.842331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 811/1647] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:23 2022] POST /identity/v3/users => generated 285 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:23.849498 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a287be-30b3-4ad2-8836-12ed0ad480d7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:23.860720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a287be-30b3-4ad2-8836-12ed0ad480d7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:23.879171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7a6bd-a634-4341-b1d2-d4625e20c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:23.879839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a6bd-a634-4341-b1d2-d4625e20c48f admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:23.882150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a6bd-a634-4341-b1d2-d4625e20c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:23.884474 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a6bd-a634-4341-b1d2-d4625e20c48f admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:23.886526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7a6bd-a634-4341-b1d2-d4625e20c48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:23.898067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7a6bd-a634-4341-b1d2-d4625e20c48f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:23.950601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 837/1648] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:23.955680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0505655-a8c6-4ebb-bbf4-90d5193c8f1c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:23.972161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0505655-a8c6-4ebb-bbf4-90d5193c8f1c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:23.986801 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b590e-a1c1-4bd1-95d1-7abed698c6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:23.988339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b590e-a1c1-4bd1-95d1-7abed698c6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:23.988756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b590e-a1c1-4bd1-95d1-7abed698c6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:23.989133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b590e-a1c1-4bd1-95d1-7abed698c6c3 admin admin] PATH_INFO: `/v3/projects/f50de156ddd94620bf1724cd3ce2e264/users/df392f18e0a94fc3878ece9a812d63c1/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:24.038776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b590e-a1c1-4bd1-95d1-7abed698c6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50de156ddd94620bf1724cd3ce2e264, user_id=df392f18e0a94fc3878ece9a812d63c1, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:24.042464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b590e-a1c1-4bd1-95d1-7abed698c6c3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:24.085678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 812/1649] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:23 2022] PUT /identity/v3/projects/f50de156ddd94620bf1724cd3ce2e264/users/df392f18e0a94fc3878ece9a812d63c1/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:24.089960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7a6bd-a634-4341-b1d2-d4625e20c48f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:24.118237 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:24.134189 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7a6bd-a634-4341-b1d2-d4625e20c48f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:24.273881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d22a9-3b03-459a-8b38-45fb22b66366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:24.275131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d22a9-3b03-459a-8b38-45fb22b66366 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:24.275870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d22a9-3b03-459a-8b38-45fb22b66366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:24.277101 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d22a9-3b03-459a-8b38-45fb22b66366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:24.277921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d22a9-3b03-459a-8b38-45fb22b66366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:24.280066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d22a9-3b03-459a-8b38-45fb22b66366 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:24.306227 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 838/1650] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:24.310266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b590e-a1c1-4bd1-95d1-7abed698c6c3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:24.328722 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b590e-a1c1-4bd1-95d1-7abed698c6c3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:24.343733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02701e89-bf64-4718-8b00-59ca401a0854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:24.344675 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02701e89-bf64-4718-8b00-59ca401a0854 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:24.345010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02701e89-bf64-4718-8b00-59ca401a0854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:24.345292 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02701e89-bf64-4718-8b00-59ca401a0854 admin admin] PATH_INFO: `/v3/projects/f50de156ddd94620bf1724cd3ce2e264/users/df392f18e0a94fc3878ece9a812d63c1/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:24.353966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02701e89-bf64-4718-8b00-59ca401a0854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50de156ddd94620bf1724cd3ce2e264, user_id=df392f18e0a94fc3878ece9a812d63c1, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:24.359796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02701e89-bf64-4718-8b00-59ca401a0854 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:24.399812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 813/1651] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:24 2022] PUT /identity/v3/projects/f50de156ddd94620bf1724cd3ce2e264/users/df392f18e0a94fc3878ece9a812d63c1/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:24.400951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87bece-5e32-4a37-8684-69b82100d281 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:24.401276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87bece-5e32-4a37-8684-69b82100d281 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:24.401872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87bece-5e32-4a37-8684-69b82100d281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:24.440237 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3e87bece-5e32-4a37-8684-69b82100d281 None None] MFA Rules not processed for user `df392f18e0a94fc3878ece9a812d63c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:24.441605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3e87bece-5e32-4a37-8684-69b82100d281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:24.578345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 839/1652] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:24.616579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02701e89-bf64-4718-8b00-59ca401a0854 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:24.618682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-02701e89-bf64-4718-8b00-59ca401a0854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:24.731972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02701e89-bf64-4718-8b00-59ca401a0854 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:24.737098 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2da232-9ff9-4ea2-bf3d-a5f9a1f54804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:24.737871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2da232-9ff9-4ea2-bf3d-a5f9a1f54804 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:24.738250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2da232-9ff9-4ea2-bf3d-a5f9a1f54804 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:24.738621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2da232-9ff9-4ea2-bf3d-a5f9a1f54804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:24.758007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2da232-9ff9-4ea2-bf3d-a5f9a1f54804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:24.758007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2da232-9ff9-4ea2-bf3d-a5f9a1f54804 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:24.790602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 814/1653] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:24 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:24.982127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87bece-5e32-4a37-8684-69b82100d281 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:25.000409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87bece-5e32-4a37-8684-69b82100d281 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:25.012839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827a5c0-ab8d-4d1b-838d-7e912e41a550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:25.013595 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827a5c0-ab8d-4d1b-838d-7e912e41a550 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:25.013971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827a5c0-ab8d-4d1b-838d-7e912e41a550 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:25.014340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827a5c0-ab8d-4d1b-838d-7e912e41a550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:25.020737 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2da232-9ff9-4ea2-bf3d-a5f9a1f54804 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:25.022252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fd2da232-9ff9-4ea2-bf3d-a5f9a1f54804 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:25.075343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:25.201873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827a5c0-ab8d-4d1b-838d-7e912e41a550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:25.206318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827a5c0-ab8d-4d1b-838d-7e912e41a550 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:25.241371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 840/1654] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:25.255579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2da232-9ff9-4ea2-bf3d-a5f9a1f54804 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:25.264461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:25.265287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:25.265627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:25.266579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] PATH_INFO: `/v3/projects/426763228fba40c0aca401f19594bd0d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:25.269134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426763228fba40c0aca401f19594bd0d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:25.270350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: WARNING py.warnings [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:12:25.270350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: warnings.warn(msg) Sep 06 01:12:25.270350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: Sep 06 01:12:25.271803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:25.432024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426763228fba40c0aca401f19594bd0d', 'request_id': 'req-b9904069-47c8-4152-8312-0953bd385840'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:25.450394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827a5c0-ab8d-4d1b-838d-7e912e41a550 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:25.453114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8827a5c0-ab8d-4d1b-838d-7e912e41a550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:25.486646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426763228fba40c0aca401f19594bd0d', 'request_id': 'req-b9904069-47c8-4152-8312-0953bd385840'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:25.489388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827a5c0-ab8d-4d1b-838d-7e912e41a550 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:25.509092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426763228fba40c0aca401f19594bd0d', 'request_id': 'req-b9904069-47c8-4152-8312-0953bd385840'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:25.547605 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] The token cache is being invalidate because project 426763228fba40c0aca401f19594bd0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:12:25.548188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:25.550949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b9904069-47c8-4152-8312-0953bd385840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:25.557343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 815/1655] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:12:25 2022] DELETE /identity/v3/projects/426763228fba40c0aca401f19594bd0d => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:12:25.562498 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:25.565442 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbba3a-1567-49b2-9df3-7d8025239876 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:25.565442 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbba3a-1567-49b2-9df3-7d8025239876 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:25.565663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbba3a-1567-49b2-9df3-7d8025239876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:25.641483 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-50fbba3a-1567-49b2-9df3-7d8025239876 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:25.642754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-50fbba3a-1567-49b2-9df3-7d8025239876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:25.684389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d43bf-06ac-40d3-ba3c-08fb9f375361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:25.685263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d43bf-06ac-40d3-ba3c-08fb9f375361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:25.685570 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d43bf-06ac-40d3-ba3c-08fb9f375361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:25.685917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d43bf-06ac-40d3-ba3c-08fb9f375361 admin admin] PATH_INFO: `/v3/users/cac6f7cd8ce54c10bceff658b962414b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:25.693586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d43bf-06ac-40d3-ba3c-08fb9f375361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac6f7cd8ce54c10bceff658b962414b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:25.695048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-a67d43bf-06ac-40d3-ba3c-08fb9f375361 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 01:12:25.695048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: warnings.warn(msg) Sep 06 01:12:25.695048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: Sep 06 01:12:25.696670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d43bf-06ac-40d3-ba3c-08fb9f375361 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:25.764235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 816/1656] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:25.773581 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee82d06-521c-42b3-b9e7-e26049dfaefe None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:25.775055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee82d06-521c-42b3-b9e7-e26049dfaefe None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:25.775337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee82d06-521c-42b3-b9e7-e26049dfaefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:25.787365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a67d43bf-06ac-40d3-ba3c-08fb9f375361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac6f7cd8ce54c10bceff658b962414b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:25.788612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a67d43bf-06ac-40d3-ba3c-08fb9f375361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac6f7cd8ce54c10bceff658b962414b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:25.803432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a67d43bf-06ac-40d3-ba3c-08fb9f375361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac6f7cd8ce54c10bceff658b962414b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:25.803916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9ee82d06-521c-42b3-b9e7-e26049dfaefe None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:25.805736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9ee82d06-521c-42b3-b9e7-e26049dfaefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:25.819693 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 817/1657] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:25.820978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee82d06-521c-42b3-b9e7-e26049dfaefe None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:25.826734 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a67d43bf-06ac-40d3-ba3c-08fb9f375361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac6f7cd8ce54c10bceff658b962414b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:25.827689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a67d43bf-06ac-40d3-ba3c-08fb9f375361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac6f7cd8ce54c10bceff658b962414b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:25.834580 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee82d06-521c-42b3-b9e7-e26049dfaefe None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:25.844707 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54339355-f984-4771-aafd-54b6d9d5259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:25.846671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339355-f984-4771-aafd-54b6d9d5259d admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:25.847147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339355-f984-4771-aafd-54b6d9d5259d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:25.847570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339355-f984-4771-aafd-54b6d9d5259d admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:25.848422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54339355-f984-4771-aafd-54b6d9d5259d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:25.848879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54339355-f984-4771-aafd-54b6d9d5259d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:25.852018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54339355-f984-4771-aafd-54b6d9d5259d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:25.867991 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 841/1658] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:12:25 2022] DELETE /identity/v3/users/cac6f7cd8ce54c10bceff658b962414b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:25.878730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 818/1659] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:12:25.880035 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54339355-f984-4771-aafd-54b6d9d5259d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:25.884804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c7dd8-b315-4885-a922-80aaaf0841cc None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:25.885752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c7dd8-b315-4885-a922-80aaaf0841cc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:25.886858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c7dd8-b315-4885-a922-80aaaf0841cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:25.897500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54339355-f984-4771-aafd-54b6d9d5259d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:25.935707 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:25.937667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5f7c7dd8-b315-4885-a922-80aaaf0841cc None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:25.939876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5f7c7dd8-b315-4885-a922-80aaaf0841cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:25.985305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e1499-51c4-4df6-a194-e9e6d52ee4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:25.986190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e1499-51c4-4df6-a194-e9e6d52ee4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:25.986512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e1499-51c4-4df6-a194-e9e6d52ee4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:25.986831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e1499-51c4-4df6-a194-e9e6d52ee4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:25.987527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e1499-51c4-4df6-a194-e9e6d52ee4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:25.989729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e1499-51c4-4df6-a194-e9e6d52ee4b8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:26.030892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 819/1660] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:25 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:26.035415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e1499-51c4-4df6-a194-e9e6d52ee4b8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:26.103812 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 842/1661] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:12:26.133522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c7dd8-b315-4885-a922-80aaaf0841cc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:26.135668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5f7c7dd8-b315-4885-a922-80aaaf0841cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:26.142887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e1499-51c4-4df6-a194-e9e6d52ee4b8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:26.154267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca46fe-ca06-47d1-8914-d4c93cdbc566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:26.154267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca46fe-ca06-47d1-8914-d4c93cdbc566 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:26.154267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca46fe-ca06-47d1-8914-d4c93cdbc566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:26.166297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca46fe-ca06-47d1-8914-d4c93cdbc566 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:26.168483 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca46fe-ca06-47d1-8914-d4c93cdbc566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:26.174715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca46fe-ca06-47d1-8914-d4c93cdbc566 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:26.236969 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:26.260412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c7dd8-b315-4885-a922-80aaaf0841cc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:26.266967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 820/1662] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:26 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:26.275301 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca46fe-ca06-47d1-8914-d4c93cdbc566 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:26.305251 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca46fe-ca06-47d1-8914-d4c93cdbc566 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:26.315179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b92eb-cc9c-4172-9d70-5b8541bc39d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:26.324322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b92eb-cc9c-4172-9d70-5b8541bc39d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:26.324834 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b92eb-cc9c-4172-9d70-5b8541bc39d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:26.325871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b92eb-cc9c-4172-9d70-5b8541bc39d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:26.327156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b92eb-cc9c-4172-9d70-5b8541bc39d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:26.332151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b92eb-cc9c-4172-9d70-5b8541bc39d6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:26.358110 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 821/1663] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:26.365490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b92eb-cc9c-4172-9d70-5b8541bc39d6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:26.381704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301879c2-1773-468a-908a-2e742bac242e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:26.382639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301879c2-1773-468a-908a-2e742bac242e service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:26.382990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301879c2-1773-468a-908a-2e742bac242e service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:26.383296 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301879c2-1773-468a-908a-2e742bac242e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:26.388413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b92eb-cc9c-4172-9d70-5b8541bc39d6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:26.401098 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71737f22-2ad8-4609-91f2-43407f34dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:26.401587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71737f22-2ad8-4609-91f2-43407f34dc95 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:26.401851 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71737f22-2ad8-4609-91f2-43407f34dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:26.402132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71737f22-2ad8-4609-91f2-43407f34dc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:26.402789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71737f22-2ad8-4609-91f2-43407f34dc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:26.404601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71737f22-2ad8-4609-91f2-43407f34dc95 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:26.405598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301879c2-1773-468a-908a-2e742bac242e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:26.407318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301879c2-1773-468a-908a-2e742bac242e service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:26.428792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 822/1664] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:26.430528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71737f22-2ad8-4609-91f2-43407f34dc95 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:26.440784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 843/1665] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:12:26.450142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71737f22-2ad8-4609-91f2-43407f34dc95 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:26.455449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d14b6f-5189-4a31-8941-5720a1646923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:26.456146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d14b6f-5189-4a31-8941-5720a1646923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:26.456471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d14b6f-5189-4a31-8941-5720a1646923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:26.456785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d14b6f-5189-4a31-8941-5720a1646923 admin admin] PATH_INFO: `/v3/projects/cc8347ab95a64016a06ed6300ec35888/users/160ed5c4fd2544109f0b59fc77b9ce46/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:26.473969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d14b6f-5189-4a31-8941-5720a1646923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8347ab95a64016a06ed6300ec35888, user_id=160ed5c4fd2544109f0b59fc77b9ce46, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:26.476896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d14b6f-5189-4a31-8941-5720a1646923 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:26.498854 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 823/1666] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:26 2022] PUT /identity/v3/projects/cc8347ab95a64016a06ed6300ec35888/users/160ed5c4fd2544109f0b59fc77b9ce46/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:26.510112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37d8ff-7a0a-4827-836b-20f2c34c3146 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:26.511008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37d8ff-7a0a-4827-836b-20f2c34c3146 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:26.511129 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37d8ff-7a0a-4827-836b-20f2c34c3146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:26.580560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3c37d8ff-7a0a-4827-836b-20f2c34c3146 None None] MFA Rules not processed for user `160ed5c4fd2544109f0b59fc77b9ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:26.585327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3c37d8ff-7a0a-4827-836b-20f2c34c3146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:26.775831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 844/1667] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:26.781036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d14b6f-5189-4a31-8941-5720a1646923 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:26.841512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98802e40-323f-466e-845a-f4148fa8a7d1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:26.841973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98802e40-323f-466e-845a-f4148fa8a7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:26.842154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98802e40-323f-466e-845a-f4148fa8a7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:26.971980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-98802e40-323f-466e-845a-f4148fa8a7d1 None None] MFA Rules not processed for user `7f8c891da32b49d29bf57d116e84debf`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:26.977897 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-98802e40-323f-466e-845a-f4148fa8a7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:27.059471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:27.073833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d14b6f-5189-4a31-8941-5720a1646923 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:27.083205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5dc0c-b97c-4513-b43f-1a89e46beb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:27.084634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5dc0c-b97c-4513-b43f-1a89e46beb03 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:27.084634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5dc0c-b97c-4513-b43f-1a89e46beb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:27.084634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5dc0c-b97c-4513-b43f-1a89e46beb03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:27.085213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5dc0c-b97c-4513-b43f-1a89e46beb03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:27.087600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5dc0c-b97c-4513-b43f-1a89e46beb03 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:27.160593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 824/1668] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:26 2022] POST /identity/v3/projects => generated 371 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:27.162674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5dc0c-b97c-4513-b43f-1a89e46beb03 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:27.252476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 845/1669] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:27.270757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98802e40-323f-466e-845a-f4148fa8a7d1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:27.272202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-98802e40-323f-466e-845a-f4148fa8a7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:27.349595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5dc0c-b97c-4513-b43f-1a89e46beb03 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:27.352593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:27.358784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2c4c3-bbb4-40f7-b2ae-b707358d398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:27.360330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2c4c3-bbb4-40f7-b2ae-b707358d398a admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:27.361321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2c4c3-bbb4-40f7-b2ae-b707358d398a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:27.363200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2c4c3-bbb4-40f7-b2ae-b707358d398a admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:27.364387 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2c4c3-bbb4-40f7-b2ae-b707358d398a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:27.386714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2c4c3-bbb4-40f7-b2ae-b707358d398a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:27.434870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 825/1670] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:27 2022] POST /identity/v3/users => generated 292 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:27.449502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2c4c3-bbb4-40f7-b2ae-b707358d398a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:27.490248 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2c4c3-bbb4-40f7-b2ae-b707358d398a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:27.516347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74ffb3-b928-42a5-9125-6aec19debea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:27.516978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ffb3-b928-42a5-9125-6aec19debea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:27.517253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ffb3-b928-42a5-9125-6aec19debea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:27.517523 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ffb3-b928-42a5-9125-6aec19debea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:27.518177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74ffb3-b928-42a5-9125-6aec19debea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:27.530914 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74ffb3-b928-42a5-9125-6aec19debea0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:27.560785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98802e40-323f-466e-845a-f4148fa8a7d1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:27.565383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 826/1671] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:27.572151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74ffb3-b928-42a5-9125-6aec19debea0 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:27.597560 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74ffb3-b928-42a5-9125-6aec19debea0 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:27.630236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68477f8d-d36b-428f-bb23-3388600b482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:27.634552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477f8d-d36b-428f-bb23-3388600b482c admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:27.635467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477f8d-d36b-428f-bb23-3388600b482c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:27.635948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477f8d-d36b-428f-bb23-3388600b482c admin admin] PATH_INFO: `/v3/projects/6fffba1def294da8a7e0ec236e91304b/users/2fd3f58b848d4830b5f4507557cfd059/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:27.674237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68477f8d-d36b-428f-bb23-3388600b482c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fffba1def294da8a7e0ec236e91304b, user_id=2fd3f58b848d4830b5f4507557cfd059, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:27.686260 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68477f8d-d36b-428f-bb23-3388600b482c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:27.729921 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 827/1672] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:27 2022] PUT /identity/v3/projects/6fffba1def294da8a7e0ec236e91304b/users/2fd3f58b848d4830b5f4507557cfd059/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:27.731688 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68477f8d-d36b-428f-bb23-3388600b482c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:27.739393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-68477f8d-d36b-428f-bb23-3388600b482c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:27.773874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf42ca-9911-40c4-bad5-8319d99d9d99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:27.777209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf42ca-9911-40c4-bad5-8319d99d9d99 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:27.778406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf42ca-9911-40c4-bad5-8319d99d9d99 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:27.779673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf42ca-9911-40c4-bad5-8319d99d9d99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:27.924250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68477f8d-d36b-428f-bb23-3388600b482c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:27.940862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507f896-c4ac-410e-856d-e0a94d4db1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:27.941546 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507f896-c4ac-410e-856d-e0a94d4db1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:27.941840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507f896-c4ac-410e-856d-e0a94d4db1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:27.942098 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507f896-c4ac-410e-856d-e0a94d4db1b8 admin admin] PATH_INFO: `/v3/projects/ad20bf12dbff4381b8df0ea59a705d14` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:27.943721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507f896-c4ac-410e-856d-e0a94d4db1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad20bf12dbff4381b8df0ea59a705d14)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:27.945339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507f896-c4ac-410e-856d-e0a94d4db1b8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:27.958873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf42ca-9911-40c4-bad5-8319d99d9d99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:27.962269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf42ca-9911-40c4-bad5-8319d99d9d99 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:27.999255 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 846/1673] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:12:27.999977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf42ca-9911-40c4-bad5-8319d99d9d99 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:28.024851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf42ca-9911-40c4-bad5-8319d99d9d99 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:28.039936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f88b3-63f1-47f6-8296-499fb63fb2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:28.040604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f88b3-63f1-47f6-8296-499fb63fb2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:28.040885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f88b3-63f1-47f6-8296-499fb63fb2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:28.041171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f88b3-63f1-47f6-8296-499fb63fb2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:28.041822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f88b3-63f1-47f6-8296-499fb63fb2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:28.043500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f88b3-63f1-47f6-8296-499fb63fb2dd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:28.070631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:28.084656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 847/1674] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:28.085665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f88b3-63f1-47f6-8296-499fb63fb2dd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:28.092260 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f507f896-c4ac-410e-856d-e0a94d4db1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad20bf12dbff4381b8df0ea59a705d14', 'request_id': 'req-f507f896-c4ac-410e-856d-e0a94d4db1b8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:28.110084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f88b3-63f1-47f6-8296-499fb63fb2dd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:28.112445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f507f896-c4ac-410e-856d-e0a94d4db1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad20bf12dbff4381b8df0ea59a705d14', 'request_id': 'req-f507f896-c4ac-410e-856d-e0a94d4db1b8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:28.134780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f507f896-c4ac-410e-856d-e0a94d4db1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad20bf12dbff4381b8df0ea59a705d14', 'request_id': 'req-f507f896-c4ac-410e-856d-e0a94d4db1b8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:28.181941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f507f896-c4ac-410e-856d-e0a94d4db1b8 admin admin] The token cache is being invalidate because project ad20bf12dbff4381b8df0ea59a705d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:12:28.182241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f507f896-c4ac-410e-856d-e0a94d4db1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:28.188895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f507f896-c4ac-410e-856d-e0a94d4db1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:28.198348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 828/1675] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:12:27 2022] DELETE /identity/v3/projects/ad20bf12dbff4381b8df0ea59a705d14 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:28.209592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b71583-8ab2-4a18-b2dd-ed103560feb5 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:28.209972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b71583-8ab2-4a18-b2dd-ed103560feb5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:28.213756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b71583-8ab2-4a18-b2dd-ed103560feb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:28.237843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:28.283129 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d3123-1b36-409f-a4db-ddcf8414b1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:28.283828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d3123-1b36-409f-a4db-ddcf8414b1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:28.284108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d3123-1b36-409f-a4db-ddcf8414b1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:28.284460 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d3123-1b36-409f-a4db-ddcf8414b1cd admin admin] PATH_INFO: `/v3/projects/6fffba1def294da8a7e0ec236e91304b/users/2fd3f58b848d4830b5f4507557cfd059/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:28.288726 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-32b71583-8ab2-4a18-b2dd-ed103560feb5 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:28.289546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d3123-1b36-409f-a4db-ddcf8414b1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fffba1def294da8a7e0ec236e91304b, user_id=2fd3f58b848d4830b5f4507557cfd059, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:28.290069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-32b71583-8ab2-4a18-b2dd-ed103560feb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:28.292633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d3123-1b36-409f-a4db-ddcf8414b1cd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:28.331109 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 848/1676] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:28 2022] PUT /identity/v3/projects/6fffba1def294da8a7e0ec236e91304b/users/2fd3f58b848d4830b5f4507557cfd059/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:28.332873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7fd8-5673-4684-8b72-7eb03cfa716e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:28.333160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7fd8-5673-4684-8b72-7eb03cfa716e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:28.333436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7fd8-5673-4684-8b72-7eb03cfa716e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:28.413143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a7ce7fd8-5673-4684-8b72-7eb03cfa716e None None] MFA Rules not processed for user `2fd3f58b848d4830b5f4507557cfd059`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:28.414406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a7ce7fd8-5673-4684-8b72-7eb03cfa716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:28.504970 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 829/1677] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:28.512550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b389b87-d8ed-4041-b735-5ebaea3ea5cf None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:28.512842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b389b87-d8ed-4041-b735-5ebaea3ea5cf None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:28.513118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b389b87-d8ed-4041-b735-5ebaea3ea5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:28.592579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2b389b87-d8ed-4041-b735-5ebaea3ea5cf None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:28.593846 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2b389b87-d8ed-4041-b735-5ebaea3ea5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:28.636129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 830/1678] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:28.637516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 849/1679] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:28.637659 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b389b87-d8ed-4041-b735-5ebaea3ea5cf None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:28.649597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7fd8-5673-4684-8b72-7eb03cfa716e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:28.653373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a7ce7fd8-5673-4684-8b72-7eb03cfa716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:28.675258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b389b87-d8ed-4041-b735-5ebaea3ea5cf None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:28.695941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ceeac-d23e-4834-b913-9142d3295299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:28.696524 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ceeac-d23e-4834-b913-9142d3295299 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:28.696802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ceeac-d23e-4834-b913-9142d3295299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:28.697225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ceeac-d23e-4834-b913-9142d3295299 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:28.697901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ceeac-d23e-4834-b913-9142d3295299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:28.698205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ceeac-d23e-4834-b913-9142d3295299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:28.700352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ceeac-d23e-4834-b913-9142d3295299 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:28.731855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 831/1680] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:12:28.733505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97912dbf-df6a-424c-b13b-10cccdf758e4 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:28.733799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97912dbf-df6a-424c-b13b-10cccdf758e4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:28.734074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97912dbf-df6a-424c-b13b-10cccdf758e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:28.807151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-97912dbf-df6a-424c-b13b-10cccdf758e4 None None] MFA Rules not processed for user `d1dd5768f5c640ac9302d0250f76f5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:28.808432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-97912dbf-df6a-424c-b13b-10cccdf758e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:28.840048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7fd8-5673-4684-8b72-7eb03cfa716e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:28.849980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b85a4f-9659-41b7-aa02-7a00dad9ca37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:28.849980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b85a4f-9659-41b7-aa02-7a00dad9ca37 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:28.849980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b85a4f-9659-41b7-aa02-7a00dad9ca37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:28.852501 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b85a4f-9659-41b7-aa02-7a00dad9ca37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:28.887341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b85a4f-9659-41b7-aa02-7a00dad9ca37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:28.889875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b85a4f-9659-41b7-aa02-7a00dad9ca37 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:28.923541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 850/1681] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:28.926649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b85a4f-9659-41b7-aa02-7a00dad9ca37 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:28.957099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 832/1682] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:28.958107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97912dbf-df6a-424c-b13b-10cccdf758e4 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:28.963305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-97912dbf-df6a-424c-b13b-10cccdf758e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:28.971574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b85a4f-9659-41b7-aa02-7a00dad9ca37 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:28.991004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401bc39-a42a-46ff-8f4d-2b4125bf3b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:28.992592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401bc39-a42a-46ff-8f4d-2b4125bf3b6e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:28.993330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401bc39-a42a-46ff-8f4d-2b4125bf3b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:28.994490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401bc39-a42a-46ff-8f4d-2b4125bf3b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:28.995458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401bc39-a42a-46ff-8f4d-2b4125bf3b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:29.000785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401bc39-a42a-46ff-8f4d-2b4125bf3b6e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:29.002139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97912dbf-df6a-424c-b13b-10cccdf758e4 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:29.010608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:29.011491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:29.011733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:29.012013 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] PATH_INFO: `/v3/users/de74c1556bc44b11bc577b2683232bd1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:29.014427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de74c1556bc44b11bc577b2683232bd1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:29.016853 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:29.103742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 851/1683] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:28 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:29.104728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545bef5-75f8-4b93-b811-5c7728de4195 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:29.105024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545bef5-75f8-4b93-b811-5c7728de4195 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:29.105300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545bef5-75f8-4b93-b811-5c7728de4195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:29.125582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:29.153527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de74c1556bc44b11bc577b2683232bd1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:29.154230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de74c1556bc44b11bc577b2683232bd1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:29.159195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0545bef5-75f8-4b93-b811-5c7728de4195 None None] MFA Rules not processed for user `d1dd5768f5c640ac9302d0250f76f5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:29.160504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0545bef5-75f8-4b93-b811-5c7728de4195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:29.171044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de74c1556bc44b11bc577b2683232bd1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:29.171784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de74c1556bc44b11bc577b2683232bd1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:29.197486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de74c1556bc44b11bc577b2683232bd1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:29.223543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 833/1684] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:12:28 2022] DELETE /identity/v3/users/de74c1556bc44b11bc577b2683232bd1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:29.226540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:29.227087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:29.255917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:29.293201 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 852/1685] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:29.297564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545bef5-75f8-4b93-b811-5c7728de4195 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:29.297564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0545bef5-75f8-4b93-b811-5c7728de4195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:29.325809 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde9b55-1e27-4898-b414-2b3060267b36 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:29.333552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c16bf-0ef8-4a3e-9e39-253c2aec3ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:29.334793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c16bf-0ef8-4a3e-9e39-253c2aec3ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:29.335407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c16bf-0ef8-4a3e-9e39-253c2aec3ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:29.335875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c16bf-0ef8-4a3e-9e39-253c2aec3ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:29.336773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c16bf-0ef8-4a3e-9e39-253c2aec3ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:29.339169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c16bf-0ef8-4a3e-9e39-253c2aec3ab0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:29.369118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 834/1686] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:29 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:29.370847 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faed197-7d14-416d-a7de-e22a0620efd1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:29.371282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faed197-7d14-416d-a7de-e22a0620efd1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:29.371677 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faed197-7d14-416d-a7de-e22a0620efd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:29.385923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545bef5-75f8-4b93-b811-5c7728de4195 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:29.397257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6faed197-7d14-416d-a7de-e22a0620efd1 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:29.401185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6faed197-7d14-416d-a7de-e22a0620efd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:29.415618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 835/1687] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:29.417063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faed197-7d14-416d-a7de-e22a0620efd1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:29.418611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6faed197-7d14-416d-a7de-e22a0620efd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:29.471934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7fd5-ab29-48ad-95cd-9195a74718ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:29.473269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7fd5-ab29-48ad-95cd-9195a74718ba service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:29.473739 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7fd5-ab29-48ad-95cd-9195a74718ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:29.474207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7fd5-ab29-48ad-95cd-9195a74718ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:29.476646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a8ed7fd5-ab29-48ad-95cd-9195a74718ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:29.527113 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faed197-7d14-416d-a7de-e22a0620efd1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:29.540731 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a8e86-4ab2-4677-b49c-ee4219f126c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:29.541426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a8e86-4ab2-4677-b49c-ee4219f126c3 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:29.541653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a8e86-4ab2-4677-b49c-ee4219f126c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:29.542967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a8e86-4ab2-4677-b49c-ee4219f126c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:29.544550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-194a8e86-4ab2-4677-b49c-ee4219f126c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:29.585172 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:29.606939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed7fd5-ab29-48ad-95cd-9195a74718ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:29.608827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed7fd5-ab29-48ad-95cd-9195a74718ba service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:29.618873 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a8e86-4ab2-4677-b49c-ee4219f126c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:29.621262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a8e86-4ab2-4677-b49c-ee4219f126c3 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:29.627646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 853/1688] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:29.628506 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7fd5-ab29-48ad-95cd-9195a74718ba service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:29.652660 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 836/1689] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:29.653771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a8e86-4ab2-4677-b49c-ee4219f126c3 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:29.659572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-194a8e86-4ab2-4677-b49c-ee4219f126c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:29.665658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7fd5-ab29-48ad-95cd-9195a74718ba service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:29.679178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f744a-83e2-4340-bffb-3656e63fa61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:29.679963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f744a-83e2-4340-bffb-3656e63fa61c admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:29.680254 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f744a-83e2-4340-bffb-3656e63fa61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:29.680566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f744a-83e2-4340-bffb-3656e63fa61c admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:29.681225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f744a-83e2-4340-bffb-3656e63fa61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:29.682910 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f744a-83e2-4340-bffb-3656e63fa61c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:29.720078 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 854/1690] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:29.728785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f744a-83e2-4340-bffb-3656e63fa61c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:29.764809 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f744a-83e2-4340-bffb-3656e63fa61c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:29.789021 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2db1cf-99ff-4363-b52a-57c04508c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:29.789661 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2db1cf-99ff-4363-b52a-57c04508c044 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:29.789942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2db1cf-99ff-4363-b52a-57c04508c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:29.790395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2db1cf-99ff-4363-b52a-57c04508c044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:29.791064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2db1cf-99ff-4363-b52a-57c04508c044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:29.792793 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2db1cf-99ff-4363-b52a-57c04508c044 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:29.825975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a8e86-4ab2-4677-b49c-ee4219f126c3 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:29.839423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfe0b3-aa4d-4b3d-9e0b-141adc098253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:29.840083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfe0b3-aa4d-4b3d-9e0b-141adc098253 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:29.840717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfe0b3-aa4d-4b3d-9e0b-141adc098253 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:29.840717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfe0b3-aa4d-4b3d-9e0b-141adc098253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:29.858333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 855/1691] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:12:29.860036 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2db1cf-99ff-4363-b52a-57c04508c044 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:29.867051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfe0b3-aa4d-4b3d-9e0b-141adc098253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:29.868721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfe0b3-aa4d-4b3d-9e0b-141adc098253 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:29.890741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 837/1692] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:29.906285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2db1cf-99ff-4363-b52a-57c04508c044 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:29.930877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22161cf-e714-407d-b628-c14b25b1df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:29.943175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22161cf-e714-407d-b628-c14b25b1df58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:29.945640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22161cf-e714-407d-b628-c14b25b1df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:29.946133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22161cf-e714-407d-b628-c14b25b1df58 admin admin] PATH_INFO: `/v3/projects/7e160993d12145939940cafa2d811cff/users/616238eccb604a44b047943ef6e2da67/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:29.977718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22161cf-e714-407d-b628-c14b25b1df58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e160993d12145939940cafa2d811cff, user_id=616238eccb604a44b047943ef6e2da67, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:29.982887 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22161cf-e714-407d-b628-c14b25b1df58 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:30.032706 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 856/1693] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:29 2022] PUT /identity/v3/projects/7e160993d12145939940cafa2d811cff/users/616238eccb604a44b047943ef6e2da67/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:30.050392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880782d-dba6-424c-81cf-7694797b6962 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:30.051165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880782d-dba6-424c-81cf-7694797b6962 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:30.051165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880782d-dba6-424c-81cf-7694797b6962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:30.082379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8880782d-dba6-424c-81cf-7694797b6962 None None] MFA Rules not processed for user `616238eccb604a44b047943ef6e2da67`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:30.083623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8880782d-dba6-424c-81cf-7694797b6962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:30.208476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 838/1694] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:30.224262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22161cf-e714-407d-b628-c14b25b1df58 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:30.324260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:30.465083 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22161cf-e714-407d-b628-c14b25b1df58 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:30.484047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b425f-bf9f-44f5-aa22-05a65e2068a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:30.484970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b425f-bf9f-44f5-aa22-05a65e2068a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:30.485405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b425f-bf9f-44f5-aa22-05a65e2068a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:30.486030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b425f-bf9f-44f5-aa22-05a65e2068a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:30.488867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b425f-bf9f-44f5-aa22-05a65e2068a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:30.492666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b425f-bf9f-44f5-aa22-05a65e2068a7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:30.577295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 857/1695] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:30 2022] POST /identity/v3/projects => generated 381 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:30.582094 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880782d-dba6-424c-81cf-7694797b6962 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:30.604516 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880782d-dba6-424c-81cf-7694797b6962 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:30.737051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12866173-f147-4dd5-a581-0d453931d433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:30.738535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12866173-f147-4dd5-a581-0d453931d433 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:30.739185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12866173-f147-4dd5-a581-0d453931d433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:30.739681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12866173-f147-4dd5-a581-0d453931d433 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:30.743858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12866173-f147-4dd5-a581-0d453931d433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:30.758316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12866173-f147-4dd5-a581-0d453931d433 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:30.785229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:30.809022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 839/1696] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:30 2022] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:30.813766 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b425f-bf9f-44f5-aa22-05a65e2068a7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:30.830138 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b425f-bf9f-44f5-aa22-05a65e2068a7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:30.841069 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c151624-2088-4351-9108-50ee5bf9934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:30.841716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c151624-2088-4351-9108-50ee5bf9934f admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:30.841999 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c151624-2088-4351-9108-50ee5bf9934f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:30.842342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c151624-2088-4351-9108-50ee5bf9934f admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:30.842988 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c151624-2088-4351-9108-50ee5bf9934f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:30.844815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c151624-2088-4351-9108-50ee5bf9934f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:30.881099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12866173-f147-4dd5-a581-0d453931d433 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:30.899952 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12866173-f147-4dd5-a581-0d453931d433 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:30.906118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5f664-0d72-4f7f-add1-295d628b8122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:30.907051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5f664-0d72-4f7f-add1-295d628b8122 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:30.907729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5f664-0d72-4f7f-add1-295d628b8122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:30.908227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5f664-0d72-4f7f-add1-295d628b8122 admin admin] PATH_INFO: `/v3/projects/f2718a98efd04663879cff44b1022ed9/users/35b5e697fcde433fb6b7af145e6c2b31/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:30.927424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 858/1697] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:30.955713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5f664-0d72-4f7f-add1-295d628b8122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2718a98efd04663879cff44b1022ed9, user_id=35b5e697fcde433fb6b7af145e6c2b31, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:30.967442 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5f664-0d72-4f7f-add1-295d628b8122 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:31.020244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 840/1698] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:30 2022] PUT /identity/v3/projects/f2718a98efd04663879cff44b1022ed9/users/35b5e697fcde433fb6b7af145e6c2b31/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:12:31.021475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c151624-2088-4351-9108-50ee5bf9934f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:31.041350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c151624-2088-4351-9108-50ee5bf9934f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:31.053579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f9a88-65a7-40bb-8885-315ae7ce0d6c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:31.053859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f9a88-65a7-40bb-8885-315ae7ce0d6c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:31.054133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f9a88-65a7-40bb-8885-315ae7ce0d6c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:31.056027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 841/1699] 10.222.0.25 () {54 vars in 912 bytes} [Tue Sep 6 01:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:12:31.062446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9112d9-9574-4fc3-acc9-daa783617eda None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:31.062733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9112d9-9574-4fc3-acc9-daa783617eda None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:31.063036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9112d9-9574-4fc3-acc9-daa783617eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:31.180141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ca9112d9-9574-4fc3-acc9-daa783617eda None None] MFA Rules not processed for user `2fc30f3a335f428082e9178227dcb4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:31.189709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ca9112d9-9574-4fc3-acc9-daa783617eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:31.249212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dfcd2-0829-4a18-8508-8a6e5244b7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:31.250104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dfcd2-0829-4a18-8508-8a6e5244b7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:31.250682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dfcd2-0829-4a18-8508-8a6e5244b7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:31.251738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dfcd2-0829-4a18-8508-8a6e5244b7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:31.252593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dfcd2-0829-4a18-8508-8a6e5244b7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:31.256445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dfcd2-0829-4a18-8508-8a6e5244b7e2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:31.286813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 859/1700] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:12:31.291253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dfcd2-0829-4a18-8508-8a6e5244b7e2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:31.315292 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dfcd2-0829-4a18-8508-8a6e5244b7e2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:31.327333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24baa58-d515-4c42-8a54-74e9ba47c3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:31.328032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24baa58-d515-4c42-8a54-74e9ba47c3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:31.328333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24baa58-d515-4c42-8a54-74e9ba47c3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:31.328649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24baa58-d515-4c42-8a54-74e9ba47c3c4 admin admin] PATH_INFO: `/v3/projects/f2718a98efd04663879cff44b1022ed9/users/35b5e697fcde433fb6b7af145e6c2b31/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:31.339093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24baa58-d515-4c42-8a54-74e9ba47c3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2718a98efd04663879cff44b1022ed9, user_id=35b5e697fcde433fb6b7af145e6c2b31, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:31.345374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24baa58-d515-4c42-8a54-74e9ba47c3c4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:31.358865 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 842/1701] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:12:31.397163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9112d9-9574-4fc3-acc9-daa783617eda None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:31.407511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 860/1702] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:31 2022] PUT /identity/v3/projects/f2718a98efd04663879cff44b1022ed9/users/35b5e697fcde433fb6b7af145e6c2b31/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:12:31.415781 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9112d9-9574-4fc3-acc9-daa783617eda None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:31.419757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2c281-0123-44ec-9b8b-5b68e3e48fa9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:31.420047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2c281-0123-44ec-9b8b-5b68e3e48fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:31.420473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2c281-0123-44ec-9b8b-5b68e3e48fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:31.487440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a6c2c281-0123-44ec-9b8b-5b68e3e48fa9 None None] MFA Rules not processed for user `35b5e697fcde433fb6b7af145e6c2b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:31.488994 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a6c2c281-0123-44ec-9b8b-5b68e3e48fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:31.523409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33057c41-4052-4f2c-9dbb-a18156750cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:31.525266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33057c41-4052-4f2c-9dbb-a18156750cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:31.525675 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33057c41-4052-4f2c-9dbb-a18156750cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:31.526149 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33057c41-4052-4f2c-9dbb-a18156750cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:31.540415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33057c41-4052-4f2c-9dbb-a18156750cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:31.542517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33057c41-4052-4f2c-9dbb-a18156750cd3 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:31.568659 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 843/1703] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:12:31.707758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:31.758853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 861/1704] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:12:31.772143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33057c41-4052-4f2c-9dbb-a18156750cd3 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:31.779920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-33057c41-4052-4f2c-9dbb-a18156750cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:31.936908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33057c41-4052-4f2c-9dbb-a18156750cd3 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:31.942179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927be38e-b962-4f0a-a508-1fc747a0acac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:31.943092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927be38e-b962-4f0a-a508-1fc747a0acac service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:31.943452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927be38e-b962-4f0a-a508-1fc747a0acac service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:31.943773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927be38e-b962-4f0a-a508-1fc747a0acac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:31.968439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927be38e-b962-4f0a-a508-1fc747a0acac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:31.970329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927be38e-b962-4f0a-a508-1fc747a0acac service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:32.003197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 844/1705] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:32.103238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2c281-0123-44ec-9b8b-5b68e3e48fa9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:32.119633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2c281-0123-44ec-9b8b-5b68e3e48fa9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:32.132926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38149-b95e-4586-a129-5107fe69b294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:32.133847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38149-b95e-4586-a129-5107fe69b294 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:32.136372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38149-b95e-4586-a129-5107fe69b294 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:32.136809 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38149-b95e-4586-a129-5107fe69b294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:32.297422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d38149-b95e-4586-a129-5107fe69b294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:32.298711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d38149-b95e-4586-a129-5107fe69b294 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:32.316258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 862/1706] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:32.447753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927be38e-b962-4f0a-a508-1fc747a0acac service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:32.450189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-927be38e-b962-4f0a-a508-1fc747a0acac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:32.469726 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:32.660175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927be38e-b962-4f0a-a508-1fc747a0acac service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:32.690532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:32.691207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:32.691510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:32.691760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08 admin admin] PATH_INFO: `/v3/projects/b7901a82846c495fad13e5cf877bb62b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:32.695477 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7901a82846c495fad13e5cf877bb62b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:32.698602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:32.794769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38149-b95e-4586-a129-5107fe69b294 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:32.799426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-65d38149-b95e-4586-a129-5107fe69b294 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:32.829194 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7901a82846c495fad13e5cf877bb62b', 'request_id': 'req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:32.839583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7901a82846c495fad13e5cf877bb62b', 'request_id': 'req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:32.856520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7901a82846c495fad13e5cf877bb62b', 'request_id': 'req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:32.897479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08 admin admin] The token cache is being invalidate because project b7901a82846c495fad13e5cf877bb62b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:12:32.897926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:32.902617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-83c9e46a-7416-4d52-a7c3-afdc3b2e7d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:32.904960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 845/1707] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:12:32 2022] DELETE /identity/v3/projects/b7901a82846c495fad13e5cf877bb62b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:32.910529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b88d3-1a3f-46e4-9865-0c55dd114870 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:32.910956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b88d3-1a3f-46e4-9865-0c55dd114870 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:32.911591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b88d3-1a3f-46e4-9865-0c55dd114870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:32.978026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38149-b95e-4586-a129-5107fe69b294 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:32.982297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1e2b88d3-1a3f-46e4-9865-0c55dd114870 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:32.989337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1e2b88d3-1a3f-46e4-9865-0c55dd114870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:33.122887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 846/1708] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:12:33.131308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a89daa-e549-4dfd-9270-e358d50a0469 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:33.131600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a89daa-e549-4dfd-9270-e358d50a0469 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:33.132138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a89daa-e549-4dfd-9270-e358d50a0469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:33.168069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-15a89daa-e549-4dfd-9270-e358d50a0469 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:33.170008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-15a89daa-e549-4dfd-9270-e358d50a0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:33.182969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 847/1709] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:33.187384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a89daa-e549-4dfd-9270-e358d50a0469 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:33.193462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482c863-9529-45eb-a18a-5d57570ea908 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:33.194179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482c863-9529-45eb-a18a-5d57570ea908 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:33.194368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482c863-9529-45eb-a18a-5d57570ea908 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:33.194809 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482c863-9529-45eb-a18a-5d57570ea908 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:33.196876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5482c863-9529-45eb-a18a-5d57570ea908 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:33.227208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a89daa-e549-4dfd-9270-e358d50a0469 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:33.232187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534051b0-49a6-42bb-bfdd-fe6a9c8c0ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:33.232959 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534051b0-49a6-42bb-bfdd-fe6a9c8c0ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:33.233183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534051b0-49a6-42bb-bfdd-fe6a9c8c0ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:33.233462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534051b0-49a6-42bb-bfdd-fe6a9c8c0ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:33.234112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534051b0-49a6-42bb-bfdd-fe6a9c8c0ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:33.234411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534051b0-49a6-42bb-bfdd-fe6a9c8c0ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:33.234565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482c863-9529-45eb-a18a-5d57570ea908 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:33.236479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534051b0-49a6-42bb-bfdd-fe6a9c8c0ffe admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:33.244533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482c863-9529-45eb-a18a-5d57570ea908 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:33.260569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 848/1710] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:12:33.280340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534051b0-49a6-42bb-bfdd-fe6a9c8c0ffe admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:33.312153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 863/1711] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:33.315550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe3e9e-72df-4210-bd9d-26af432f58ab None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:33.315852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe3e9e-72df-4210-bd9d-26af432f58ab None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:33.318635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe3e9e-72df-4210-bd9d-26af432f58ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:33.325629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534051b0-49a6-42bb-bfdd-fe6a9c8c0ffe admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:33.354389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43741528-7a99-47e8-9f79-87e237aa1059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:33.355769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43741528-7a99-47e8-9f79-87e237aa1059 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:33.357030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43741528-7a99-47e8-9f79-87e237aa1059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:33.357530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43741528-7a99-47e8-9f79-87e237aa1059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:33.359320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43741528-7a99-47e8-9f79-87e237aa1059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:33.363946 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43741528-7a99-47e8-9f79-87e237aa1059 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:33.368018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-effe3e9e-72df-4210-bd9d-26af432f58ab None None] MFA Rules not processed for user `d1dd5768f5c640ac9302d0250f76f5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:33.369340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-effe3e9e-72df-4210-bd9d-26af432f58ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:33.418374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:33.441925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 849/1712] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:33 2022] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:33.443790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43741528-7a99-47e8-9f79-87e237aa1059 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:33.445858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:33.538880 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 864/1713] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:33.681095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43741528-7a99-47e8-9f79-87e237aa1059 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:33.693388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2d449-ae34-4f17-acaf-a36b04b44bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:33.694968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d449-ae34-4f17-acaf-a36b04b44bad admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:33.695252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d449-ae34-4f17-acaf-a36b04b44bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:33.695530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d449-ae34-4f17-acaf-a36b04b44bad admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:33.696186 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2d449-ae34-4f17-acaf-a36b04b44bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:33.698292 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2d449-ae34-4f17-acaf-a36b04b44bad admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:33.753061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 850/1714] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:33 2022] POST /identity/v3/users => generated 303 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:33.754209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe3e9e-72df-4210-bd9d-26af432f58ab None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:33.780447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe3e9e-72df-4210-bd9d-26af432f58ab None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:33.793730 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f7f43-335e-4928-9132-693e56341b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:33.794570 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f7f43-335e-4928-9132-693e56341b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:33.794947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f7f43-335e-4928-9132-693e56341b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:33.795357 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f7f43-335e-4928-9132-693e56341b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:33.797409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f7f43-335e-4928-9132-693e56341b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:33.803849 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f7f43-335e-4928-9132-693e56341b43 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:33.831163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 865/1715] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:12:33.832494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2d449-ae34-4f17-acaf-a36b04b44bad admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:33.851285 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2d449-ae34-4f17-acaf-a36b04b44bad admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:33.858862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e86f0-c340-4cd6-8cd1-ba02421fb33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:33.859584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e86f0-c340-4cd6-8cd1-ba02421fb33b admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:33.859896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e86f0-c340-4cd6-8cd1-ba02421fb33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:33.860219 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e86f0-c340-4cd6-8cd1-ba02421fb33b admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:33.861129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e86f0-c340-4cd6-8cd1-ba02421fb33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:33.863027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e86f0-c340-4cd6-8cd1-ba02421fb33b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:33.890654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 851/1716] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:33.892050 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f7f43-335e-4928-9132-693e56341b43 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:33.906868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f7f43-335e-4928-9132-693e56341b43 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:33.926596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75ac28-5314-4f32-ad0d-0b9b01ff44fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:33.927540 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75ac28-5314-4f32-ad0d-0b9b01ff44fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:33.929893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75ac28-5314-4f32-ad0d-0b9b01ff44fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:33.930238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75ac28-5314-4f32-ad0d-0b9b01ff44fa admin admin] PATH_INFO: `/v3/projects/fdc9a6f1074e40aea8fa6df3c494c813/users/b085e89a1fae4d67aac6fd3b5e8398cf/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:33.990635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75ac28-5314-4f32-ad0d-0b9b01ff44fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc9a6f1074e40aea8fa6df3c494c813, user_id=b085e89a1fae4d67aac6fd3b5e8398cf, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:33.999018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75ac28-5314-4f32-ad0d-0b9b01ff44fa admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:34.040148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 866/1717] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:33 2022] PUT /identity/v3/projects/fdc9a6f1074e40aea8fa6df3c494c813/users/b085e89a1fae4d67aac6fd3b5e8398cf/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:34.045584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47110d-1fdd-49d7-9d08-f6e646e5957d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:34.046348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47110d-1fdd-49d7-9d08-f6e646e5957d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:34.047610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47110d-1fdd-49d7-9d08-f6e646e5957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:34.122556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4c47110d-1fdd-49d7-9d08-f6e646e5957d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:34.123831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4c47110d-1fdd-49d7-9d08-f6e646e5957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:34.311800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 852/1718] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:34.352773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75ac28-5314-4f32-ad0d-0b9b01ff44fa admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:34.355076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5b75ac28-5314-4f32-ad0d-0b9b01ff44fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:34.613968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75ac28-5314-4f32-ad0d-0b9b01ff44fa admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:34.616699 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16e562-f249-4b97-8f5f-b833910f5e13 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:34.617095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16e562-f249-4b97-8f5f-b833910f5e13 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:34.617473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16e562-f249-4b97-8f5f-b833910f5e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:34.647644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957236e2-9ebd-475b-89a2-35fab85a25b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:34.648227 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957236e2-9ebd-475b-89a2-35fab85a25b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:34.652458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957236e2-9ebd-475b-89a2-35fab85a25b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:34.653854 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957236e2-9ebd-475b-89a2-35fab85a25b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:34.704853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957236e2-9ebd-475b-89a2-35fab85a25b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:34.710285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957236e2-9ebd-475b-89a2-35fab85a25b1 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:34.752063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-fb16e562-f249-4b97-8f5f-b833910f5e13 None None] MFA Rules not processed for user `98c0fd0ea5864180b2758824270eee3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:34.761316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fb16e562-f249-4b97-8f5f-b833910f5e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:34.786580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 867/1719] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:35.031616 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6c98f-634e-48c3-8a6a-23e439203e19 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:35.031993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 853/1720] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:12:35.035909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6c98f-634e-48c3-8a6a-23e439203e19 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:35.036251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6c98f-634e-48c3-8a6a-23e439203e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:35.107970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-09a6c98f-634e-48c3-8a6a-23e439203e19 None None] MFA Rules not processed for user `98c0fd0ea5864180b2758824270eee3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:35.118719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-09a6c98f-634e-48c3-8a6a-23e439203e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:35.156121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 868/1721] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:35.164504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16e562-f249-4b97-8f5f-b833910f5e13 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:35.166947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fb16e562-f249-4b97-8f5f-b833910f5e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:35.193704 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:35.431724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16e562-f249-4b97-8f5f-b833910f5e13 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:35.456215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d73c9e-ffb7-48fe-87c9-e38984b40621 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:35.459681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d73c9e-ffb7-48fe-87c9-e38984b40621 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:35.460166 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d73c9e-ffb7-48fe-87c9-e38984b40621 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:35.460602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d73c9e-ffb7-48fe-87c9-e38984b40621 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:35.496821 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d73c9e-ffb7-48fe-87c9-e38984b40621 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:35.507337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d73c9e-ffb7-48fe-87c9-e38984b40621 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:35.549827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 854/1722] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:36.149806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c13c4-7282-4799-9dc1-d3f8029feb1b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:36.150347 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c13c4-7282-4799-9dc1-d3f8029feb1b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:36.150347 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c13c4-7282-4799-9dc1-d3f8029feb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:36.222351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a45c13c4-7282-4799-9dc1-d3f8029feb1b None None] MFA Rules not processed for user `7f8c891da32b49d29bf57d116e84debf`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:36.224171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a45c13c4-7282-4799-9dc1-d3f8029feb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:36.418371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 869/1723] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:37.430957 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f6e85-32c1-4cd9-974f-2a2892fdf1c6 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:37.431485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f6e85-32c1-4cd9-974f-2a2892fdf1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:37.431485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f6e85-32c1-4cd9-974f-2a2892fdf1c6 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:37.433214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 855/1724] 10.222.0.25 () {54 vars in 912 bytes} [Tue Sep 6 01:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:12:37.450447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d3b8-7520-4e97-8985-3851ffe09a86 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:37.451008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d3b8-7520-4e97-8985-3851ffe09a86 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:37.451008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d3b8-7520-4e97-8985-3851ffe09a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:37.517833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84e0e2-44fc-4452-9b0d-4fbcc308cf46 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:37.518315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84e0e2-44fc-4452-9b0d-4fbcc308cf46 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:37.518601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84e0e2-44fc-4452-9b0d-4fbcc308cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:37.567203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3c72d3b8-7520-4e97-8985-3851ffe09a86 None None] MFA Rules not processed for user `2fc30f3a335f428082e9178227dcb4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:37.576462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3c72d3b8-7520-4e97-8985-3851ffe09a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:37.579761 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-dd84e0e2-44fc-4452-9b0d-4fbcc308cf46 None None] MFA Rules not processed for user `3ea04d2b0055428090fc30d01f7c601e`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:37.581183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-dd84e0e2-44fc-4452-9b0d-4fbcc308cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:37.594733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 870/1725] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:37.604076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4af800-e322-4849-b878-402a579be0b1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:37.608005 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4af800-e322-4849-b878-402a579be0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:37.608422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4af800-e322-4849-b878-402a579be0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:37.841040 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 856/1726] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:37.844662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84e0e2-44fc-4452-9b0d-4fbcc308cf46 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:37.847304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-df4af800-e322-4849-b878-402a579be0b1 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:37.848820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-df4af800-e322-4849-b878-402a579be0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:37.863525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:37.894516 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84e0e2-44fc-4452-9b0d-4fbcc308cf46 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:37.910482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47254fa-9b5c-4dab-9704-15e713772fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:37.911978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47254fa-9b5c-4dab-9704-15e713772fce service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:37.912453 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47254fa-9b5c-4dab-9704-15e713772fce service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:37.914180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47254fa-9b5c-4dab-9704-15e713772fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:37.943229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47254fa-9b5c-4dab-9704-15e713772fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:37.945921 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47254fa-9b5c-4dab-9704-15e713772fce service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:37.972588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 857/1727] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:38.127768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 871/1728] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:38.448599 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47254fa-9b5c-4dab-9704-15e713772fce service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:38.450262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f47254fa-9b5c-4dab-9704-15e713772fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:38.731861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:38.840935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47254fa-9b5c-4dab-9704-15e713772fce service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:38.854547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89694c-ce70-4674-97c3-430d9011732d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:38.855237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89694c-ce70-4674-97c3-430d9011732d service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:38.855516 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89694c-ce70-4674-97c3-430d9011732d service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:38.855979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89694c-ce70-4674-97c3-430d9011732d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:38.900345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89694c-ce70-4674-97c3-430d9011732d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:38.907389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89694c-ce70-4674-97c3-430d9011732d service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:38.923431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 858/1729] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:12:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:12:39.262769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d945cb-85af-4e43-8e64-0d3d8f1ccf2a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:39.263726 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d945cb-85af-4e43-8e64-0d3d8f1ccf2a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:39.264143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d945cb-85af-4e43-8e64-0d3d8f1ccf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:39.337009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-04d945cb-85af-4e43-8e64-0d3d8f1ccf2a None None] MFA Rules not processed for user `b085e89a1fae4d67aac6fd3b5e8398cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:39.343959 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-04d945cb-85af-4e43-8e64-0d3d8f1ccf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:39.664237 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 872/1730] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:39.667185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89694c-ce70-4674-97c3-430d9011732d service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:39.687179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89694c-ce70-4674-97c3-430d9011732d service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:39.708403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe08be5-e50a-441c-9cf4-6c5f15869020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:39.709233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe08be5-e50a-441c-9cf4-6c5f15869020 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:39.709514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe08be5-e50a-441c-9cf4-6c5f15869020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:39.709786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe08be5-e50a-441c-9cf4-6c5f15869020 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:39.711059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe08be5-e50a-441c-9cf4-6c5f15869020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:39.713298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe08be5-e50a-441c-9cf4-6c5f15869020 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:39.792884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 859/1731] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:39 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:39.794233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d945cb-85af-4e43-8e64-0d3d8f1ccf2a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:39.821045 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d945cb-85af-4e43-8e64-0d3d8f1ccf2a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:40.019857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94601d-3880-4ee3-8789-ee7172aa779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:40.020762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94601d-3880-4ee3-8789-ee7172aa779d admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:40.021058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94601d-3880-4ee3-8789-ee7172aa779d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:40.021478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94601d-3880-4ee3-8789-ee7172aa779d admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:40.022221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94601d-3880-4ee3-8789-ee7172aa779d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:40.028250 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94601d-3880-4ee3-8789-ee7172aa779d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:40.116875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 873/1732] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:39 2022] POST /identity/v3/users => generated 308 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:40.118222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe08be5-e50a-441c-9cf4-6c5f15869020 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:40.153293 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe08be5-e50a-441c-9cf4-6c5f15869020 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:40.172616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1d656-2e63-427c-b7b4-c0cf8b5101aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:40.174146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1d656-2e63-427c-b7b4-c0cf8b5101aa admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:40.174568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1d656-2e63-427c-b7b4-c0cf8b5101aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:40.174980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1d656-2e63-427c-b7b4-c0cf8b5101aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:40.175774 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1d656-2e63-427c-b7b4-c0cf8b5101aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:40.179894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1d656-2e63-427c-b7b4-c0cf8b5101aa admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:40.216481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 860/1733] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:12:40.220707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94601d-3880-4ee3-8789-ee7172aa779d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:40.242237 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94601d-3880-4ee3-8789-ee7172aa779d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:40.277366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d02b7-53a0-4d5a-8c61-1991f08b6202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:40.282871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d02b7-53a0-4d5a-8c61-1991f08b6202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:40.283501 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d02b7-53a0-4d5a-8c61-1991f08b6202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:40.288528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d02b7-53a0-4d5a-8c61-1991f08b6202 admin admin] PATH_INFO: `/v3/projects/a8c2ffef96974b5996a8720c573001f8/users/338aa8c1790f4f7f9bb2228f26176fc3/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:40.366199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d02b7-53a0-4d5a-8c61-1991f08b6202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c2ffef96974b5996a8720c573001f8, user_id=338aa8c1790f4f7f9bb2228f26176fc3, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:40.383443 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d02b7-53a0-4d5a-8c61-1991f08b6202 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:40.413255 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:40.429603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 874/1734] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:40 2022] PUT /identity/v3/projects/a8c2ffef96974b5996a8720c573001f8/users/338aa8c1790f4f7f9bb2228f26176fc3/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:40.430180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1d656-2e63-427c-b7b4-c0cf8b5101aa admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:40.447492 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1d656-2e63-427c-b7b4-c0cf8b5101aa admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:40.723499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9d2e-b9b5-4c67-9288-bc42f469bd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:40.725455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9d2e-b9b5-4c67-9288-bc42f469bd5f admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:40.726268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9d2e-b9b5-4c67-9288-bc42f469bd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:40.726908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9d2e-b9b5-4c67-9288-bc42f469bd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:40.739660 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a9d2e-b9b5-4c67-9288-bc42f469bd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:40.745295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a9d2e-b9b5-4c67-9288-bc42f469bd5f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:40.793297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d02b7-53a0-4d5a-8c61-1991f08b6202 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:40.849750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 861/1735] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:12:40.865791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d02b7-53a0-4d5a-8c61-1991f08b6202 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:40.898559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442840a-165c-4c3d-a53a-4fb25ea6d501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:40.902367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442840a-165c-4c3d-a53a-4fb25ea6d501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:40.902884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442840a-165c-4c3d-a53a-4fb25ea6d501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:40.904398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442840a-165c-4c3d-a53a-4fb25ea6d501 admin admin] PATH_INFO: `/v3/projects/a8c2ffef96974b5996a8720c573001f8/users/338aa8c1790f4f7f9bb2228f26176fc3/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:40.921496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442840a-165c-4c3d-a53a-4fb25ea6d501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c2ffef96974b5996a8720c573001f8, user_id=338aa8c1790f4f7f9bb2228f26176fc3, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:40.945039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442840a-165c-4c3d-a53a-4fb25ea6d501 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:40.993008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 875/1736] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:40 2022] PUT /identity/v3/projects/a8c2ffef96974b5996a8720c573001f8/users/338aa8c1790f4f7f9bb2228f26176fc3/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:41.632553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9d2e-b9b5-4c67-9288-bc42f469bd5f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:41.762591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b34672-64a3-4683-ad5f-e01485dbec44 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:41.763188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b34672-64a3-4683-ad5f-e01485dbec44 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:41.763188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b34672-64a3-4683-ad5f-e01485dbec44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:41.843864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-59b34672-64a3-4683-ad5f-e01485dbec44 None None] MFA Rules not processed for user `2fc30f3a335f428082e9178227dcb4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:41.848215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-59b34672-64a3-4683-ad5f-e01485dbec44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:42.019275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9d2e-b9b5-4c67-9288-bc42f469bd5f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:42.020725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 876/1737] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Sep 6 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:42.186045 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b34672-64a3-4683-ad5f-e01485dbec44 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:42.198453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b34672-64a3-4683-ad5f-e01485dbec44 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:42.215445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217005a9-0895-41bb-892b-865dd71e5eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:42.216850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217005a9-0895-41bb-892b-865dd71e5eec service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:42.217517 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217005a9-0895-41bb-892b-865dd71e5eec service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:42.218683 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217005a9-0895-41bb-892b-865dd71e5eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:42.227026 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:42.253421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217005a9-0895-41bb-892b-865dd71e5eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:42.259404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217005a9-0895-41bb-892b-865dd71e5eec service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:42.320536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 877/1738] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:42.333012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584d04f-b49c-4811-9588-d45ca9fbf297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:42.334035 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d04f-b49c-4811-9588-d45ca9fbf297 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:42.335570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d04f-b49c-4811-9588-d45ca9fbf297 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:42.336263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d04f-b49c-4811-9588-d45ca9fbf297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:42.566795 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584d04f-b49c-4811-9588-d45ca9fbf297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:42.571044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584d04f-b49c-4811-9588-d45ca9fbf297 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:42.623713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 862/1739] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 992 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:43.223962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217005a9-0895-41bb-892b-865dd71e5eec service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:43.225698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-217005a9-0895-41bb-892b-865dd71e5eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:43.480838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217005a9-0895-41bb-892b-865dd71e5eec service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:43.534697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:43.535405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:43.535683 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:43.535958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] PATH_INFO: `/v3/users/616238eccb604a44b047943ef6e2da67` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:43.543240 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=616238eccb604a44b047943ef6e2da67)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:43.549922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:43.707881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616238eccb604a44b047943ef6e2da67'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:43.708602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616238eccb604a44b047943ef6e2da67'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:43.723858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616238eccb604a44b047943ef6e2da67'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:43.740030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616238eccb604a44b047943ef6e2da67'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:43.741344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616238eccb604a44b047943ef6e2da67'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:43.815136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 878/1740] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:12:43 2022] DELETE /identity/v3/users/616238eccb604a44b047943ef6e2da67 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:43.816913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b8e21-050d-4cfe-9df1-99ee48503721 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:43.819562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b8e21-050d-4cfe-9df1-99ee48503721 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:43.819997 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b8e21-050d-4cfe-9df1-99ee48503721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:43.855728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f04b8e21-050d-4cfe-9df1-99ee48503721 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:43.857009 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f04b8e21-050d-4cfe-9df1-99ee48503721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:44.047001 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 863/1741] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:44.057926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:44.059515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:44.067037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:44.368214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa50fb4-3c8e-427d-9910-68de8f87e462 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:44.377469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d85593-8ba8-40cd-8138-33daa070bec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:44.378118 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d85593-8ba8-40cd-8138-33daa070bec9 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:44.378396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d85593-8ba8-40cd-8138-33daa070bec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:44.378665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d85593-8ba8-40cd-8138-33daa070bec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:44.400137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d85593-8ba8-40cd-8138-33daa070bec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:44.401625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d85593-8ba8-40cd-8138-33daa070bec9 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:44.439748 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 879/1742] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:47.590073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce53b-8a8e-4e38-8c0d-722812dd170d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:47.595935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce53b-8a8e-4e38-8c0d-722812dd170d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:47.599025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce53b-8a8e-4e38-8c0d-722812dd170d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:47.775683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f09ce53b-8a8e-4e38-8c0d-722812dd170d None None] MFA Rules not processed for user `338aa8c1790f4f7f9bb2228f26176fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:47.817544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f09ce53b-8a8e-4e38-8c0d-722812dd170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:48.176885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d85593-8ba8-40cd-8138-33daa070bec9 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:48.178459 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-70d85593-8ba8-40cd-8138-33daa070bec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:48.250620 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d85593-8ba8-40cd-8138-33daa070bec9 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:48.251455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 864/1743] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 664 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:48.301114 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ce53b-8a8e-4e38-8c0d-722812dd170d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:48.303595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f09ce53b-8a8e-4e38-8c0d-722812dd170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:48.329869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:48.331030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:48.331547 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:48.332041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] PATH_INFO: `/v3/projects/7e160993d12145939940cafa2d811cff` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:48.334487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e160993d12145939940cafa2d811cff)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:48.371798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:48.383177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:48.416349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ce53b-8a8e-4e38-8c0d-722812dd170d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:48.436163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9b041-9e11-4b4b-89ac-aed43348cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:48.437630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9b041-9e11-4b4b-89ac-aed43348cd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:48.439256 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9b041-9e11-4b4b-89ac-aed43348cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:48.439909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9b041-9e11-4b4b-89ac-aed43348cd36 admin admin] PATH_INFO: `/v3/users/68fb70efda24411a87480fe10dabb6a0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:48.443692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9b041-9e11-4b4b-89ac-aed43348cd36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fb70efda24411a87480fe10dabb6a0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:48.447485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9b041-9e11-4b4b-89ac-aed43348cd36 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:48.552263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e160993d12145939940cafa2d811cff', 'request_id': 'req-08601456-78a1-47d5-bbd5-ae3db6baa723'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:48.574621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e160993d12145939940cafa2d811cff', 'request_id': 'req-08601456-78a1-47d5-bbd5-ae3db6baa723'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:48.601488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e160993d12145939940cafa2d811cff', 'request_id': 'req-08601456-78a1-47d5-bbd5-ae3db6baa723'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:48.639266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5ba9b041-9e11-4b4b-89ac-aed43348cd36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fb70efda24411a87480fe10dabb6a0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:48.643503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5ba9b041-9e11-4b4b-89ac-aed43348cd36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fb70efda24411a87480fe10dabb6a0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:48.643823 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] The token cache is being invalidate because project 7e160993d12145939940cafa2d811cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:12:48.644561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:48.646583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:48.654377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 880/1744] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:12:48 2022] DELETE /identity/v3/projects/7e160993d12145939940cafa2d811cff => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:48.658738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:48.665066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:48.683836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5ba9b041-9e11-4b4b-89ac-aed43348cd36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fb70efda24411a87480fe10dabb6a0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:48.685101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5ba9b041-9e11-4b4b-89ac-aed43348cd36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fb70efda24411a87480fe10dabb6a0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:48.736001 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5ba9b041-9e11-4b4b-89ac-aed43348cd36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fb70efda24411a87480fe10dabb6a0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:48.773641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 865/1745] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:12:48 2022] DELETE /identity/v3/users/68fb70efda24411a87480fe10dabb6a0 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:48.790646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7085835-521c-473f-bb40-4aeb089c90cc None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:48.791256 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7085835-521c-473f-bb40-4aeb089c90cc None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:48.792433 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7085835-521c-473f-bb40-4aeb089c90cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:48.856079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c7085835-521c-473f-bb40-4aeb089c90cc None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:48.858423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c7085835-521c-473f-bb40-4aeb089c90cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:48.958706 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08601456-78a1-47d5-bbd5-ae3db6baa723 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:49.088724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 866/1746] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:49.123140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:49.188971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072045d-0e28-481f-84ec-3051ed7e90bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:49.189679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072045d-0e28-481f-84ec-3051ed7e90bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:49.190759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072045d-0e28-481f-84ec-3051ed7e90bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:49.191917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072045d-0e28-481f-84ec-3051ed7e90bc admin admin] PATH_INFO: `/v3/users/35b5e697fcde433fb6b7af145e6c2b31` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:49.198631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072045d-0e28-481f-84ec-3051ed7e90bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b5e697fcde433fb6b7af145e6c2b31)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:49.203405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072045d-0e28-481f-84ec-3051ed7e90bc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:49.288502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7085835-521c-473f-bb40-4aeb089c90cc None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:49.290746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c7085835-521c-473f-bb40-4aeb089c90cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:49.371743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6072045d-0e28-481f-84ec-3051ed7e90bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b5e697fcde433fb6b7af145e6c2b31'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:49.372880 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6072045d-0e28-481f-84ec-3051ed7e90bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b5e697fcde433fb6b7af145e6c2b31'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:49.434567 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6072045d-0e28-481f-84ec-3051ed7e90bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b5e697fcde433fb6b7af145e6c2b31'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:49.481163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6072045d-0e28-481f-84ec-3051ed7e90bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b5e697fcde433fb6b7af145e6c2b31'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:49.486101 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6072045d-0e28-481f-84ec-3051ed7e90bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b5e697fcde433fb6b7af145e6c2b31'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:49.574525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7085835-521c-473f-bb40-4aeb089c90cc None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:49.591395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 881/1747] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:12:48 2022] DELETE /identity/v3/users/35b5e697fcde433fb6b7af145e6c2b31 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:49.619975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d4a44-5651-483d-90db-08480f870bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:49.622500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4a44-5651-483d-90db-08480f870bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:49.623870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4a44-5651-483d-90db-08480f870bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:49.624903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4a44-5651-483d-90db-08480f870bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:49.629724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-832d4a44-5651-483d-90db-08480f870bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:49.645707 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d4a44-5651-483d-90db-08480f870bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:49.649407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d4a44-5651-483d-90db-08480f870bc9 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:49.678976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 867/1748] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:51.612892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851622ef-a36b-4dab-a177-ac48f7a84c58 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:51.613527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851622ef-a36b-4dab-a177-ac48f7a84c58 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:51.613527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851622ef-a36b-4dab-a177-ac48f7a84c58 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:51.615080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 882/1749] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 6 01:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:12:51.644869 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930c15-4d3f-45a2-8270-d2fb57121dd2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:51.645476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930c15-4d3f-45a2-8270-d2fb57121dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:51.645476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930c15-4d3f-45a2-8270-d2fb57121dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:51.705043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-93930c15-4d3f-45a2-8270-d2fb57121dd2 None None] MFA Rules not processed for user `42b9c25e98fe4b1bbc33a601d4150071`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:51.706247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-93930c15-4d3f-45a2-8270-d2fb57121dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:51.736125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:51.923212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 868/1750] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 6 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:52.653349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851622ef-a36b-4dab-a177-ac48f7a84c58 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:52.659518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-851622ef-a36b-4dab-a177-ac48f7a84c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:52.924984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851622ef-a36b-4dab-a177-ac48f7a84c58 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:52.934519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad205910-83ef-4c8b-aa59-a2e6d95ca180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:52.935198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad205910-83ef-4c8b-aa59-a2e6d95ca180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:52.935479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad205910-83ef-4c8b-aa59-a2e6d95ca180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:52.935748 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad205910-83ef-4c8b-aa59-a2e6d95ca180 admin admin] PATH_INFO: `/v3/projects/f2718a98efd04663879cff44b1022ed9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:52.943188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad205910-83ef-4c8b-aa59-a2e6d95ca180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2718a98efd04663879cff44b1022ed9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:52.951881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad205910-83ef-4c8b-aa59-a2e6d95ca180 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:53.074168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93930c15-4d3f-45a2-8270-d2fb57121dd2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:53.076158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-93930c15-4d3f-45a2-8270-d2fb57121dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:53.116121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93930c15-4d3f-45a2-8270-d2fb57121dd2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:53.120041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ad205910-83ef-4c8b-aa59-a2e6d95ca180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2718a98efd04663879cff44b1022ed9', 'request_id': 'req-ad205910-83ef-4c8b-aa59-a2e6d95ca180'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.126185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:53.130035 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ad205910-83ef-4c8b-aa59-a2e6d95ca180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2718a98efd04663879cff44b1022ed9', 'request_id': 'req-ad205910-83ef-4c8b-aa59-a2e6d95ca180'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.149399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ad205910-83ef-4c8b-aa59-a2e6d95ca180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2718a98efd04663879cff44b1022ed9', 'request_id': 'req-ad205910-83ef-4c8b-aa59-a2e6d95ca180'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.173532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ad205910-83ef-4c8b-aa59-a2e6d95ca180 admin admin] The token cache is being invalidate because project f2718a98efd04663879cff44b1022ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:12:53.173874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ad205910-83ef-4c8b-aa59-a2e6d95ca180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.174566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ad205910-83ef-4c8b-aa59-a2e6d95ca180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.179579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 883/1751] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:12:52 2022] DELETE /identity/v3/projects/f2718a98efd04663879cff44b1022ed9 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:53.182180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82a6eb-c563-439e-ab7a-2ff3be7a384a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:53.182621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82a6eb-c563-439e-ab7a-2ff3be7a384a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:53.182950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82a6eb-c563-439e-ab7a-2ff3be7a384a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:53.236082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5a82a6eb-c563-439e-ab7a-2ff3be7a384a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:53.238451 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5a82a6eb-c563-439e-ab7a-2ff3be7a384a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:53.258503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda463c-56e7-43ff-8a6e-48073d284d82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:53.259543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda463c-56e7-43ff-8a6e-48073d284d82 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:53.259967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda463c-56e7-43ff-8a6e-48073d284d82 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:53.260494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda463c-56e7-43ff-8a6e-48073d284d82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:53.263551 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ecda463c-56e7-43ff-8a6e-48073d284d82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:53.301509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda463c-56e7-43ff-8a6e-48073d284d82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:53.304146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda463c-56e7-43ff-8a6e-48073d284d82 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:53.330639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 884/1752] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:53.330639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82a6eb-c563-439e-ab7a-2ff3be7a384a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:53.330889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 869/1753] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:12:53.332921 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e668fee-166b-4a0c-8630-3c033670c06b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:53.333269 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e668fee-166b-4a0c-8630-3c033670c06b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:53.333646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e668fee-166b-4a0c-8630-3c033670c06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:53.339131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5a82a6eb-c563-439e-ab7a-2ff3be7a384a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:53.357030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6e668fee-166b-4a0c-8630-3c033670c06b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:53.358518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6e668fee-166b-4a0c-8630-3c033670c06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:53.366220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82a6eb-c563-439e-ab7a-2ff3be7a384a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:53.370570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 870/1754] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:53.375523 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e668fee-166b-4a0c-8630-3c033670c06b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:53.379219 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:53.379900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:53.380228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:53.381846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] PATH_INFO: `/v3/projects/62456453a2aa4da58e30e6043ad615cf` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:53.385319 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=62456453a2aa4da58e30e6043ad615cf)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:53.387326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:53.391202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e668fee-166b-4a0c-8630-3c033670c06b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:53.399690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c593db3-4449-470c-8c11-603e29fc38ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:53.401649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c593db3-4449-470c-8c11-603e29fc38ef admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:53.407514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c593db3-4449-470c-8c11-603e29fc38ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:53.408204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c593db3-4449-470c-8c11-603e29fc38ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:53.409272 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c593db3-4449-470c-8c11-603e29fc38ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:53.409678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c593db3-4449-470c-8c11-603e29fc38ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:53.411673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c593db3-4449-470c-8c11-603e29fc38ef admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:53.453889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 871/1755] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:12:53.456478 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c593db3-4449-470c-8c11-603e29fc38ef admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:53.474286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62456453a2aa4da58e30e6043ad615cf', 'request_id': 'req-4c34d8ac-41ed-4840-811f-091493c458ed'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.478750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c593db3-4449-470c-8c11-603e29fc38ef admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:53.481641 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62456453a2aa4da58e30e6043ad615cf', 'request_id': 'req-4c34d8ac-41ed-4840-811f-091493c458ed'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.489253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62456453a2aa4da58e30e6043ad615cf', 'request_id': 'req-4c34d8ac-41ed-4840-811f-091493c458ed'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.509931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] The token cache is being invalidate because project 62456453a2aa4da58e30e6043ad615cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:12:53.510210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.511135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.513078 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 885/1756] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:12:53 2022] DELETE /identity/v3/projects/62456453a2aa4da58e30e6043ad615cf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:53.516889 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:53.518311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:53.545184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aa51-16c2-4730-b105-dedb5bc0711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:53.545889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aa51-16c2-4730-b105-dedb5bc0711a admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:53.546235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aa51-16c2-4730-b105-dedb5bc0711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:53.546993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aa51-16c2-4730-b105-dedb5bc0711a admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:53.547382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332aa51-16c2-4730-b105-dedb5bc0711a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:53.549886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332aa51-16c2-4730-b105-dedb5bc0711a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:53.579576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:53.593489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 872/1757] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:53 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:53.597048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aa51-16c2-4730-b105-dedb5bc0711a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:53.598293 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34d8ac-41ed-4840-811f-091493c458ed admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:53.602028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f332aa51-16c2-4730-b105-dedb5bc0711a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:53.613726 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:53.673386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:53.674107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:53.674783 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:53.674783 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] PATH_INFO: `/v3/users/df392f18e0a94fc3878ece9a812d63c1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:53.675887 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=df392f18e0a94fc3878ece9a812d63c1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:53.678025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:53.729798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aa51-16c2-4730-b105-dedb5bc0711a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:53.737208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd0f08-ec1c-42e1-b3fd-007715bca792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:53.737945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd0f08-ec1c-42e1-b3fd-007715bca792 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:53.738316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd0f08-ec1c-42e1-b3fd-007715bca792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:53.738740 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd0f08-ec1c-42e1-b3fd-007715bca792 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:53.739633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd0f08-ec1c-42e1-b3fd-007715bca792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:53.749281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd0f08-ec1c-42e1-b3fd-007715bca792 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:53.790131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 873/1758] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:53 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:53.800127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd0f08-ec1c-42e1-b3fd-007715bca792 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:53.801228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df392f18e0a94fc3878ece9a812d63c1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.802013 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df392f18e0a94fc3878ece9a812d63c1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.805380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-43bd0f08-ec1c-42e1-b3fd-007715bca792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:53.826585 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd0f08-ec1c-42e1-b3fd-007715bca792 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:53.829665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df392f18e0a94fc3878ece9a812d63c1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.844622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6ac5b-c3ec-4b8c-84d8-f81faac34c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:53.845281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6ac5b-c3ec-4b8c-84d8-f81faac34c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:53.845555 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6ac5b-c3ec-4b8c-84d8-f81faac34c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:53.845824 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6ac5b-c3ec-4b8c-84d8-f81faac34c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:53.846468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6ac5b-c3ec-4b8c-84d8-f81faac34c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:53.853818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df392f18e0a94fc3878ece9a812d63c1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.854939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df392f18e0a94fc3878ece9a812d63c1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:53.855873 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6ac5b-c3ec-4b8c-84d8-f81faac34c09 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:53.877134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 874/1759] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:53.883409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6ac5b-c3ec-4b8c-84d8-f81faac34c09 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:53.884394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 886/1760] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:12:53 2022] DELETE /identity/v3/users/df392f18e0a94fc3878ece9a812d63c1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:12:53.915473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6ac5b-c3ec-4b8c-84d8-f81faac34c09 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:54.021006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f2189-0af8-49e9-92f9-e3018a456956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:54.021898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f2189-0af8-49e9-92f9-e3018a456956 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.022392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f2189-0af8-49e9-92f9-e3018a456956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.022850 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f2189-0af8-49e9-92f9-e3018a456956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.023625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f2189-0af8-49e9-92f9-e3018a456956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:54.026804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f2189-0af8-49e9-92f9-e3018a456956 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:54.040437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 875/1761] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:54.044802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:54.058459 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0493d20-3d9d-4abf-b63b-f0d64207ca2e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:54.071843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9828a-3744-4f4f-ae08-727addf4e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:54.073011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9828a-3744-4f4f-ae08-727addf4e531 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.073722 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9828a-3744-4f4f-ae08-727addf4e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.074528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9828a-3744-4f4f-ae08-727addf4e531 admin admin] PATH_INFO: `/v3/projects/38de9039de8e42139661cf50e41c83c1/users/cefb40f62d4542e59faa820008faeb3e/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.125657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9828a-3744-4f4f-ae08-727addf4e531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38de9039de8e42139661cf50e41c83c1, user_id=cefb40f62d4542e59faa820008faeb3e, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:54.126496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e86950-fa22-4853-b945-30668c324549 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.127039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e86950-fa22-4853-b945-30668c324549 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.127268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e86950-fa22-4853-b945-30668c324549 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.129825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 876/1762] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 6 01:12:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:12:54.130622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9828a-3744-4f4f-ae08-727addf4e531 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:54.178643 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 887/1763] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:54 2022] PUT /identity/v3/projects/38de9039de8e42139661cf50e41c83c1/users/cefb40f62d4542e59faa820008faeb3e/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:54.180320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07f46b-391e-4bff-bdfd-d31885e4d509 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.181205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07f46b-391e-4bff-bdfd-d31885e4d509 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.181488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07f46b-391e-4bff-bdfd-d31885e4d509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.191769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b8329-7878-433e-a1e6-cc508c10cbcd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.192750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b8329-7878-433e-a1e6-cc508c10cbcd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.194185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b8329-7878-433e-a1e6-cc508c10cbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.227354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-713b8329-7878-433e-a1e6-cc508c10cbcd None None] MFA Rules not processed for user `1823402195ab4e89aa865967afc62b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:54.229664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-713b8329-7878-433e-a1e6-cc508c10cbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:54.231831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7d07f46b-391e-4bff-bdfd-d31885e4d509 None None] MFA Rules not processed for user `cefb40f62d4542e59faa820008faeb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:54.233921 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7d07f46b-391e-4bff-bdfd-d31885e4d509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:54.350152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 888/1764] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 6 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:54.350844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6993b2e-c665-4f35-8156-a3227f557374 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.351363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6993b2e-c665-4f35-8156-a3227f557374 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.351526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 877/1765] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:12:54.351747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6993b2e-c665-4f35-8156-a3227f557374 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.352856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07f46b-391e-4bff-bdfd-d31885e4d509 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:54.354447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 889/1766] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 6 01:12:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:12:54.370216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:54.374767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b1829-cf16-479c-8ea3-b39fb0ebd7e1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.375951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b1829-cf16-479c-8ea3-b39fb0ebd7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.377345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b1829-cf16-479c-8ea3-b39fb0ebd7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.398507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:54.407534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-142b1829-cf16-479c-8ea3-b39fb0ebd7e1 None None] MFA Rules not processed for user `42b9c25e98fe4b1bbc33a601d4150071`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:54.409681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-142b1829-cf16-479c-8ea3-b39fb0ebd7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:54.480617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07f46b-391e-4bff-bdfd-d31885e4d509 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:54.494367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d531a37-29d1-4927-875d-3e2fbb752f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:54.496431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d531a37-29d1-4927-875d-3e2fbb752f78 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.496989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d531a37-29d1-4927-875d-3e2fbb752f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.497462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d531a37-29d1-4927-875d-3e2fbb752f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.499064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d531a37-29d1-4927-875d-3e2fbb752f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:54.501862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d531a37-29d1-4927-875d-3e2fbb752f78 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:54.553603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 878/1767] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:54 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:54.558815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fb7ff-a59f-4f8c-b1c7-f74df07898a9 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.559416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fb7ff-a59f-4f8c-b1c7-f74df07898a9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.559815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fb7ff-a59f-4f8c-b1c7-f74df07898a9 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.571340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 879/1768] 10.222.0.25 () {54 vars in 961 bytes} [Tue Sep 6 01:12:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:12:54.572975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e25de-6f00-4881-a2b5-dc9e3634921b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.573430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e25de-6f00-4881-a2b5-dc9e3634921b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.573799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e25de-6f00-4881-a2b5-dc9e3634921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.576662 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 890/1769] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 6 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:54.577846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b1829-cf16-479c-8ea3-b39fb0ebd7e1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:54.595140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b1829-cf16-479c-8ea3-b39fb0ebd7e1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:54.600772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-134e25de-6f00-4881-a2b5-dc9e3634921b None None] MFA Rules not processed for user `3ea04d2b0055428090fc30d01f7c601e`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:54.603161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-134e25de-6f00-4881-a2b5-dc9e3634921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:54.704239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 880/1770] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:54.706992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec472b-7eed-46a0-994b-18e53066c46b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.707287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec472b-7eed-46a0-994b-18e53066c46b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.707558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec472b-7eed-46a0-994b-18e53066c46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.715171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eef70-e827-4c91-8772-3a4930a51b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:54.715874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eef70-e827-4c91-8772-3a4930a51b3f admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.716075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eef70-e827-4c91-8772-3a4930a51b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.716379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eef70-e827-4c91-8772-3a4930a51b3f admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.717023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54eef70-e827-4c91-8772-3a4930a51b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:54.719309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54eef70-e827-4c91-8772-3a4930a51b3f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:54.740947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-40ec472b-7eed-46a0-994b-18e53066c46b None None] MFA Rules not processed for user `1823402195ab4e89aa865967afc62b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:54.742663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-40ec472b-7eed-46a0-994b-18e53066c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:54.766632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 891/1771] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:54 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:54.767718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eef70-e827-4c91-8772-3a4930a51b3f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:54.770194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c54eef70-e827-4c91-8772-3a4930a51b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:54.822346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 881/1772] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Sep 6 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:54.838858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec472b-7eed-46a0-994b-18e53066c46b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:54.840736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-40ec472b-7eed-46a0-994b-18e53066c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:54.864337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eef70-e827-4c91-8772-3a4930a51b3f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:54.869380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec472b-7eed-46a0-994b-18e53066c46b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:54.875492 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e80f4-7c45-4fdf-82f8-f0fd6309fe5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:54.878001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e80f4-7c45-4fdf-82f8-f0fd6309fe5c service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.878292 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e80f4-7c45-4fdf-82f8-f0fd6309fe5c service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.878569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e80f4-7c45-4fdf-82f8-f0fd6309fe5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.881786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:54.882719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.883232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.883693 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] PATH_INFO: `/v3/projects/f50de156ddd94620bf1724cd3ce2e264` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.885167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f50de156ddd94620bf1724cd3ce2e264)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:54.889964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:54.894428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e80f4-7c45-4fdf-82f8-f0fd6309fe5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:54.898446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e80f4-7c45-4fdf-82f8-f0fd6309fe5c service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:54.915024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 892/1773] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:54.915907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e80f4-7c45-4fdf-82f8-f0fd6309fe5c service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:54.931515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e80f4-7c45-4fdf-82f8-f0fd6309fe5c service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:54.933922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:54.937453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa672f-8273-4f37-a661-db9caaba3e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:54.938786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa672f-8273-4f37-a661-db9caaba3e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:54.939119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa672f-8273-4f37-a661-db9caaba3e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:54.939404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa672f-8273-4f37-a661-db9caaba3e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:54.940230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa672f-8273-4f37-a661-db9caaba3e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:54.943078 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa672f-8273-4f37-a661-db9caaba3e74 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:54.960563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f50de156ddd94620bf1724cd3ce2e264', 'request_id': 'req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:54.961318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 893/1774] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:54.961318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa672f-8273-4f37-a661-db9caaba3e74 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:54.973150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:54.979850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa672f-8273-4f37-a661-db9caaba3e74 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:54.982064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f50de156ddd94620bf1724cd3ce2e264', 'request_id': 'req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:55.007504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f50de156ddd94620bf1724cd3ce2e264', 'request_id': 'req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:55.063049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] The token cache is being invalidate because project f50de156ddd94620bf1724cd3ce2e264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:12:55.063569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:55.066808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:55.069797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 882/1775] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:12:54 2022] DELETE /identity/v3/projects/f50de156ddd94620bf1724cd3ce2e264 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:55.073696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:55.080606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:55.114569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115e206-764e-4d58-9063-509362be2ebf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:55.114569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115e206-764e-4d58-9063-509362be2ebf service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.114569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115e206-764e-4d58-9063-509362be2ebf service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.114569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115e206-764e-4d58-9063-509362be2ebf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.115169 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2115e206-764e-4d58-9063-509362be2ebf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:55.123799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115e206-764e-4d58-9063-509362be2ebf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:55.126029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115e206-764e-4d58-9063-509362be2ebf service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:55.137829 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 894/1776] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:55.139094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25776559-c8d8-4c25-8f2e-176ab968d755 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.139247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25776559-c8d8-4c25-8f2e-176ab968d755 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.139510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25776559-c8d8-4c25-8f2e-176ab968d755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.167706 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-25776559-c8d8-4c25-8f2e-176ab968d755 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:55.169006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-25776559-c8d8-4c25-8f2e-176ab968d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:55.214906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87230258-b7f0-45fa-bb07-84c5ca3d3b6e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:55.228961 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d3827-3666-41cf-9dc5-e3dbd6659460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:55.230691 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d3827-3666-41cf-9dc5-e3dbd6659460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.231253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d3827-3666-41cf-9dc5-e3dbd6659460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.231679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d3827-3666-41cf-9dc5-e3dbd6659460 admin admin] PATH_INFO: `/v3/projects/f98b9bf55226479c8519b6723757ce5c/users/bc0a8939b64e42ec93bc0a3f1e20ed94/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.267463 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d3827-3666-41cf-9dc5-e3dbd6659460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98b9bf55226479c8519b6723757ce5c, user_id=bc0a8939b64e42ec93bc0a3f1e20ed94, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:55.273542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d3827-3666-41cf-9dc5-e3dbd6659460 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:55.284372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 895/1777] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:55.293753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd71960-7d94-4316-9280-03513367c270 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.294122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd71960-7d94-4316-9280-03513367c270 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.294340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd71960-7d94-4316-9280-03513367c270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.303217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 883/1778] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:55 2022] PUT /identity/v3/projects/f98b9bf55226479c8519b6723757ce5c/users/bc0a8939b64e42ec93bc0a3f1e20ed94/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:55.307744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d3827-3666-41cf-9dc5-e3dbd6659460 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:55.318234 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7dd71960-7d94-4316-9280-03513367c270 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:55.319930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7dd71960-7d94-4316-9280-03513367c270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:55.393642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d3827-3666-41cf-9dc5-e3dbd6659460 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:55.395754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 896/1779] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:12:55.396828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd71960-7d94-4316-9280-03513367c270 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:55.401482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a193a-7246-475e-a667-d0c428674559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:55.402759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a193a-7246-475e-a667-d0c428674559 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.403229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a193a-7246-475e-a667-d0c428674559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.404280 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a193a-7246-475e-a667-d0c428674559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.405415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a193a-7246-475e-a667-d0c428674559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:55.408072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a193a-7246-475e-a667-d0c428674559 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:55.414253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd71960-7d94-4316-9280-03513367c270 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:55.422597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b722f69-a370-4e29-b29a-fb1fcdab2f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:55.423240 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b722f69-a370-4e29-b29a-fb1fcdab2f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.423517 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b722f69-a370-4e29-b29a-fb1fcdab2f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.423785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b722f69-a370-4e29-b29a-fb1fcdab2f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.424579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b722f69-a370-4e29-b29a-fb1fcdab2f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:55.424897 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b722f69-a370-4e29-b29a-fb1fcdab2f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:55.426788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b722f69-a370-4e29-b29a-fb1fcdab2f98 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:55.427286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 884/1780] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:55.431096 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a193a-7246-475e-a667-d0c428674559 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:55.441952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 897/1781] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:12:55.446362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b722f69-a370-4e29-b29a-fb1fcdab2f98 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:55.447892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a193a-7246-475e-a667-d0c428674559 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:55.454188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b16b92-558b-4cee-98d8-458e2b975f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:55.455226 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b16b92-558b-4cee-98d8-458e2b975f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.455747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b16b92-558b-4cee-98d8-458e2b975f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.456230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b16b92-558b-4cee-98d8-458e2b975f27 admin admin] PATH_INFO: `/v3/projects/f98b9bf55226479c8519b6723757ce5c/users/bc0a8939b64e42ec93bc0a3f1e20ed94/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.457818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b722f69-a370-4e29-b29a-fb1fcdab2f98 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:55.458765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b16b92-558b-4cee-98d8-458e2b975f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98b9bf55226479c8519b6723757ce5c, user_id=bc0a8939b64e42ec93bc0a3f1e20ed94, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:55.461797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b16b92-558b-4cee-98d8-458e2b975f27 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:55.464638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081e1de-b7e5-4d34-9911-cfbba8895286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:55.465301 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081e1de-b7e5-4d34-9911-cfbba8895286 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.465581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081e1de-b7e5-4d34-9911-cfbba8895286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.465850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081e1de-b7e5-4d34-9911-cfbba8895286 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.466505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081e1de-b7e5-4d34-9911-cfbba8895286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:55.471484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081e1de-b7e5-4d34-9911-cfbba8895286 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:55.489276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 885/1782] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:55 2022] PUT /identity/v3/projects/f98b9bf55226479c8519b6723757ce5c/users/bc0a8939b64e42ec93bc0a3f1e20ed94/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:55.491126 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c79f2-5efb-4b35-9995-52aee0d05031 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.491756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c79f2-5efb-4b35-9995-52aee0d05031 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.492392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c79f2-5efb-4b35-9995-52aee0d05031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.501804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:55.514894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 898/1783] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:55 2022] POST /identity/v3/projects => generated 401 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:55.515831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081e1de-b7e5-4d34-9911-cfbba8895286 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:55.543786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-459c79f2-5efb-4b35-9995-52aee0d05031 None None] MFA Rules not processed for user `bc0a8939b64e42ec93bc0a3f1e20ed94`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:55.545684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-459c79f2-5efb-4b35-9995-52aee0d05031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:55.562858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:55.652026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081e1de-b7e5-4d34-9911-cfbba8895286 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:55.661726 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa881f67-d00d-4bde-a552-a11e65f2327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:55.662379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa881f67-d00d-4bde-a552-a11e65f2327e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.662660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa881f67-d00d-4bde-a552-a11e65f2327e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.663665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa881f67-d00d-4bde-a552-a11e65f2327e admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.664350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa881f67-d00d-4bde-a552-a11e65f2327e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:55.666780 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa881f67-d00d-4bde-a552-a11e65f2327e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:55.695517 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 899/1784] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:55 2022] POST /identity/v3/users => generated 301 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:55.699455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa881f67-d00d-4bde-a552-a11e65f2327e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:55.711815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 886/1785] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:55.713009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa881f67-d00d-4bde-a552-a11e65f2327e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:55.718577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbece5e-3ee2-425a-9d0f-f719a470384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:55.720241 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbece5e-3ee2-425a-9d0f-f719a470384a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.720752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbece5e-3ee2-425a-9d0f-f719a470384a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.721267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbece5e-3ee2-425a-9d0f-f719a470384a admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.722164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbece5e-3ee2-425a-9d0f-f719a470384a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:55.723630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c79f2-5efb-4b35-9995-52aee0d05031 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:55.724407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbece5e-3ee2-425a-9d0f-f719a470384a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:55.725088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-459c79f2-5efb-4b35-9995-52aee0d05031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:55.739363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 900/1786] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:12:55.745169 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbece5e-3ee2-425a-9d0f-f719a470384a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:55.748110 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-edbece5e-3ee2-425a-9d0f-f719a470384a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:55.763589 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbece5e-3ee2-425a-9d0f-f719a470384a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:55.770721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:55.771557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.771831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.772108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] PATH_INFO: `/v3/users/b085e89a1fae4d67aac6fd3b5e8398cf` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.773416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b085e89a1fae4d67aac6fd3b5e8398cf)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:55.776783 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:55.820499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c79f2-5efb-4b35-9995-52aee0d05031 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:55.826096 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef184988-a04d-4f86-a472-e9f0340e1046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:55.826902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef184988-a04d-4f86-a472-e9f0340e1046 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.827226 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef184988-a04d-4f86-a472-e9f0340e1046 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.827427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef184988-a04d-4f86-a472-e9f0340e1046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.840426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef184988-a04d-4f86-a472-e9f0340e1046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:55.841987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef184988-a04d-4f86-a472-e9f0340e1046 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:55.853321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 887/1787] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:55.854245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef184988-a04d-4f86-a472-e9f0340e1046 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:55.859692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b085e89a1fae4d67aac6fd3b5e8398cf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:55.860730 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b085e89a1fae4d67aac6fd3b5e8398cf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:55.867662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef184988-a04d-4f86-a472-e9f0340e1046 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:55.873579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e6ad4-b06e-460c-8147-d6deb0dc7fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:55.874658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e6ad4-b06e-460c-8147-d6deb0dc7fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.875754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e6ad4-b06e-460c-8147-d6deb0dc7fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.876331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e6ad4-b06e-460c-8147-d6deb0dc7fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.877452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e6ad4-b06e-460c-8147-d6deb0dc7fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:55.879404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e6ad4-b06e-460c-8147-d6deb0dc7fbe admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:55.910344 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 888/1788] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:55.913466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b085e89a1fae4d67aac6fd3b5e8398cf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:55.916052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e6ad4-b06e-460c-8147-d6deb0dc7fbe admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:55.920987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-507e6ad4-b06e-460c-8147-d6deb0dc7fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:55.937120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b085e89a1fae4d67aac6fd3b5e8398cf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:55.938510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b085e89a1fae4d67aac6fd3b5e8398cf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:55.942878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e6ad4-b06e-460c-8147-d6deb0dc7fbe admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:55.951318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827ce40-d7e6-435f-8027-0bb9a35c3b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:55.951819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827ce40-d7e6-435f-8027-0bb9a35c3b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:55.952109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827ce40-d7e6-435f-8027-0bb9a35c3b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:55.952398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827ce40-d7e6-435f-8027-0bb9a35c3b10 admin admin] PATH_INFO: `/v3/projects/3fd1fef507ba4ea099da5a8999ac51fc/users/26142ec4f45a4c13bd22d424b9a4361b/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:55.980859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 901/1789] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:12:55 2022] DELETE /identity/v3/users/b085e89a1fae4d67aac6fd3b5e8398cf => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:55.981708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:55.985185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:55.988913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827ce40-d7e6-435f-8027-0bb9a35c3b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd1fef507ba4ea099da5a8999ac51fc, user_id=26142ec4f45a4c13bd22d424b9a4361b, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:55.998499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827ce40-d7e6-435f-8027-0bb9a35c3b10 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:56.030409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 889/1790] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:55 2022] PUT /identity/v3/projects/3fd1fef507ba4ea099da5a8999ac51fc/users/26142ec4f45a4c13bd22d424b9a4361b/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:56.043980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c93da8-e789-4b83-ab0f-4d0ab9b4f3fe None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:56.043980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c93da8-e789-4b83-ab0f-4d0ab9b4f3fe None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:56.043980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c93da8-e789-4b83-ab0f-4d0ab9b4f3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:56.079333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:56.086455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-72c93da8-e789-4b83-ab0f-4d0ab9b4f3fe None None] MFA Rules not processed for user `26142ec4f45a4c13bd22d424b9a4361b`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:56.087729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-72c93da8-e789-4b83-ab0f-4d0ab9b4f3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:56.105890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b67e6b-dbb4-4b00-bc30-17a8045d8b6b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:56.187222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c543507-313d-4d20-b45f-787d2675d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:56.187995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c543507-313d-4d20-b45f-787d2675d943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:56.188411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c543507-313d-4d20-b45f-787d2675d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:56.188756 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c543507-313d-4d20-b45f-787d2675d943 admin admin] PATH_INFO: `/v3/users/cefb40f62d4542e59faa820008faeb3e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:56.190039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c543507-313d-4d20-b45f-787d2675d943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefb40f62d4542e59faa820008faeb3e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:56.192367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c543507-313d-4d20-b45f-787d2675d943 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:56.216778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 890/1791] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:12:56.226072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c93da8-e789-4b83-ab0f-4d0ab9b4f3fe None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:56.233051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:56.243646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c93da8-e789-4b83-ab0f-4d0ab9b4f3fe None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:56.266859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5c543507-313d-4d20-b45f-787d2675d943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefb40f62d4542e59faa820008faeb3e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:56.267787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5c543507-313d-4d20-b45f-787d2675d943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefb40f62d4542e59faa820008faeb3e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:56.281601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5c543507-313d-4d20-b45f-787d2675d943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefb40f62d4542e59faa820008faeb3e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:56.283445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6b256-d363-4da5-a5b8-ab4611843473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:56.286533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6b256-d363-4da5-a5b8-ab4611843473 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:56.287290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6b256-d363-4da5-a5b8-ab4611843473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:56.288890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6b256-d363-4da5-a5b8-ab4611843473 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:56.293178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6b256-d363-4da5-a5b8-ab4611843473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:56.294872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5c543507-313d-4d20-b45f-787d2675d943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefb40f62d4542e59faa820008faeb3e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:56.295779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5c543507-313d-4d20-b45f-787d2675d943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefb40f62d4542e59faa820008faeb3e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:56.300115 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6b256-d363-4da5-a5b8-ab4611843473 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:56.317510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 902/1792] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:12:55 2022] DELETE /identity/v3/users/cefb40f62d4542e59faa820008faeb3e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:56.334552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c871600-d3d6-4200-b5c8-31f5c2b88726 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:56.337662 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c871600-d3d6-4200-b5c8-31f5c2b88726 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:56.338021 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c871600-d3d6-4200-b5c8-31f5c2b88726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:56.389483 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 891/1793] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:56 2022] POST /identity/v3/projects => generated 399 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:56.391138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6b256-d363-4da5-a5b8-ab4611843473 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:56.391727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9c871600-d3d6-4200-b5c8-31f5c2b88726 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:56.393018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9c871600-d3d6-4200-b5c8-31f5c2b88726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:56.397910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-41e6b256-d363-4da5-a5b8-ab4611843473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:56.461460 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 903/1794] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:56.531026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c871600-d3d6-4200-b5c8-31f5c2b88726 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:56.533064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9c871600-d3d6-4200-b5c8-31f5c2b88726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:56.560669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:56.586528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6b256-d363-4da5-a5b8-ab4611843473 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:56.590466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69603e-1a89-4cbb-ab5f-b6c5155cda1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:56.591147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69603e-1a89-4cbb-ab5f-b6c5155cda1c admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:56.591424 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69603e-1a89-4cbb-ab5f-b6c5155cda1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:56.591693 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69603e-1a89-4cbb-ab5f-b6c5155cda1c admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:56.592353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69603e-1a89-4cbb-ab5f-b6c5155cda1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:56.595353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69603e-1a89-4cbb-ab5f-b6c5155cda1c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:56.647146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c871600-d3d6-4200-b5c8-31f5c2b88726 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:56.654690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 892/1795] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:56 2022] POST /identity/v3/users => generated 306 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:56.655079 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf99e0-5217-4fba-b5b5-5c44f1079382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:56.656255 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf99e0-5217-4fba-b5b5-5c44f1079382 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:56.656781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf99e0-5217-4fba-b5b5-5c44f1079382 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:56.657205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf99e0-5217-4fba-b5b5-5c44f1079382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:56.658903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69603e-1a89-4cbb-ab5f-b6c5155cda1c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:56.669995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf99e0-5217-4fba-b5b5-5c44f1079382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:56.672482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf99e0-5217-4fba-b5b5-5c44f1079382 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:56.685402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 904/1796] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:12:56.694721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69603e-1a89-4cbb-ab5f-b6c5155cda1c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:56.700348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65851e5b-b14e-41b4-b911-cfc8135d8300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:56.700977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65851e5b-b14e-41b4-b911-cfc8135d8300 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:56.701254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65851e5b-b14e-41b4-b911-cfc8135d8300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:56.701523 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65851e5b-b14e-41b4-b911-cfc8135d8300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:56.712332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65851e5b-b14e-41b4-b911-cfc8135d8300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:56.712332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65851e5b-b14e-41b4-b911-cfc8135d8300 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:56.725360 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 893/1797] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:56.733144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf99e0-5217-4fba-b5b5-5c44f1079382 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:56.746851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf99e0-5217-4fba-b5b5-5c44f1079382 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:56.753788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e2920-cb9d-49bc-8a88-e4b6ede6e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:56.755002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e2920-cb9d-49bc-8a88-e4b6ede6e5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:56.755421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e2920-cb9d-49bc-8a88-e4b6ede6e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:56.755852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e2920-cb9d-49bc-8a88-e4b6ede6e5e5 admin admin] PATH_INFO: `/v3/projects/aacb5b3973c64ad6a7013b8a695cade2/users/1972390f54a047bea7e0ccd35afa182e/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:56.778422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e2920-cb9d-49bc-8a88-e4b6ede6e5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aacb5b3973c64ad6a7013b8a695cade2, user_id=1972390f54a047bea7e0ccd35afa182e, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:56.783026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e2920-cb9d-49bc-8a88-e4b6ede6e5e5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:56.821932 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 905/1798] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:56 2022] PUT /identity/v3/projects/aacb5b3973c64ad6a7013b8a695cade2/users/1972390f54a047bea7e0ccd35afa182e/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:56.822253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65851e5b-b14e-41b4-b911-cfc8135d8300 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:56.834254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65851e5b-b14e-41b4-b911-cfc8135d8300 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:56.954146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db6341-1d38-4629-8939-3b354d27d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:56.954877 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db6341-1d38-4629-8939-3b354d27d3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:56.955201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db6341-1d38-4629-8939-3b354d27d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:56.955518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db6341-1d38-4629-8939-3b354d27d3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:56.956671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db6341-1d38-4629-8939-3b354d27d3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:56.959361 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db6341-1d38-4629-8939-3b354d27d3c7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:56.981971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 894/1799] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:56.986529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e2920-cb9d-49bc-8a88-e4b6ede6e5e5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:57.014358 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e2920-cb9d-49bc-8a88-e4b6ede6e5e5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:57.020647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95903cc9-d9eb-4007-aebc-173c47a243a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:57.022304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95903cc9-d9eb-4007-aebc-173c47a243a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:57.022888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95903cc9-d9eb-4007-aebc-173c47a243a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:57.023406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95903cc9-d9eb-4007-aebc-173c47a243a3 admin admin] PATH_INFO: `/v3/projects/aacb5b3973c64ad6a7013b8a695cade2/users/1972390f54a047bea7e0ccd35afa182e/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:57.026336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95903cc9-d9eb-4007-aebc-173c47a243a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aacb5b3973c64ad6a7013b8a695cade2, user_id=1972390f54a047bea7e0ccd35afa182e, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:57.029941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95903cc9-d9eb-4007-aebc-173c47a243a3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:57.044513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 906/1800] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:56 2022] PUT /identity/v3/projects/aacb5b3973c64ad6a7013b8a695cade2/users/1972390f54a047bea7e0ccd35afa182e/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:12:57.057478 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db6341-1d38-4629-8939-3b354d27d3c7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:57.060245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1532b03-d59f-4e3d-90bb-462892d18ed5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:57.061141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-12db6341-1d38-4629-8939-3b354d27d3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:57.063300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1532b03-d59f-4e3d-90bb-462892d18ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:57.064312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1532b03-d59f-4e3d-90bb-462892d18ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:57.098369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db6341-1d38-4629-8939-3b354d27d3c7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:57.125733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c1532b03-d59f-4e3d-90bb-462892d18ed5 None None] MFA Rules not processed for user `1972390f54a047bea7e0ccd35afa182e`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:57.127299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c1532b03-d59f-4e3d-90bb-462892d18ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:57.226630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:57.241423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:57.242398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:57.243102 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:57.244183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] PATH_INFO: `/v3/projects/fdc9a6f1074e40aea8fa6df3c494c813` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:57.246621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc9a6f1074e40aea8fa6df3c494c813)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:57.251971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:57.275059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 907/1801] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:57 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:57.287214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1532b03-d59f-4e3d-90bb-462892d18ed5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:57.289719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c1532b03-d59f-4e3d-90bb-462892d18ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:57.321536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc9a6f1074e40aea8fa6df3c494c813', 'request_id': 'req-cb63b835-6ddf-449f-9125-de33510ad324'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.330367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc9a6f1074e40aea8fa6df3c494c813', 'request_id': 'req-cb63b835-6ddf-449f-9125-de33510ad324'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.345323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc9a6f1074e40aea8fa6df3c494c813', 'request_id': 'req-cb63b835-6ddf-449f-9125-de33510ad324'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.361794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] The token cache is being invalidate because project fdc9a6f1074e40aea8fa6df3c494c813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:12:57.362068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.363001 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.368480 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 895/1802] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:12:57 2022] DELETE /identity/v3/projects/fdc9a6f1074e40aea8fa6df3c494c813 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:57.369552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:57.371199 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:57.421172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1532b03-d59f-4e3d-90bb-462892d18ed5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:57.451318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:57.474460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63b835-6ddf-449f-9125-de33510ad324 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:57.479873 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:57.480751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:57.481175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:57.481595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] PATH_INFO: `/v3/users/338aa8c1790f4f7f9bb2228f26176fc3` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:57.483088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=338aa8c1790f4f7f9bb2228f26176fc3)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:57.485355 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:57.495513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dcd69-8609-45ed-a722-3d68c46dc993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:57.496160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dcd69-8609-45ed-a722-3d68c46dc993 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:57.496470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dcd69-8609-45ed-a722-3d68c46dc993 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:57.496748 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dcd69-8609-45ed-a722-3d68c46dc993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:57.498896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-443dcd69-8609-45ed-a722-3d68c46dc993 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:57.545295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '338aa8c1790f4f7f9bb2228f26176fc3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.546372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '338aa8c1790f4f7f9bb2228f26176fc3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.555533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '338aa8c1790f4f7f9bb2228f26176fc3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.556813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '338aa8c1790f4f7f9bb2228f26176fc3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.570279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '338aa8c1790f4f7f9bb2228f26176fc3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.571717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443dcd69-8609-45ed-a722-3d68c46dc993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:57.573374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443dcd69-8609-45ed-a722-3d68c46dc993 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:57.584561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 908/1803] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:57 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:12:57.585397 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dcd69-8609-45ed-a722-3d68c46dc993 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:57.586715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-443dcd69-8609-45ed-a722-3d68c46dc993 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:57.601083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 896/1804] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:12:57 2022] DELETE /identity/v3/users/338aa8c1790f4f7f9bb2228f26176fc3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:57.604807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dcd69-8609-45ed-a722-3d68c46dc993 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:57.680488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:57.681159 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:57.681441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:57.681718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] PATH_INFO: `/v3/projects/38de9039de8e42139661cf50e41c83c1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:57.683382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38de9039de8e42139661cf50e41c83c1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:57.685780 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:57.687901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:57.689908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:57.698738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:57.755334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38de9039de8e42139661cf50e41c83c1', 'request_id': 'req-c46f8422-913c-49e1-824c-67bd5d099b57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.762773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38de9039de8e42139661cf50e41c83c1', 'request_id': 'req-c46f8422-913c-49e1-824c-67bd5d099b57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.771408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38de9039de8e42139661cf50e41c83c1', 'request_id': 'req-c46f8422-913c-49e1-824c-67bd5d099b57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.793096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] The token cache is being invalidate because project 38de9039de8e42139661cf50e41c83c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:12:57.793390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.794083 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.795876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 909/1805] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:12:57 2022] DELETE /identity/v3/projects/38de9039de8e42139661cf50e41c83c1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:57.800416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:57.802169 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:57.807811 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:57.822658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b84f02-2a72-4ea7-8163-ed1905b6a5de admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:57.924409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f8422-913c-49e1-824c-67bd5d099b57 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:57.929197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269ae96-6b00-4f90-ad9b-27e546e99fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:57.929870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269ae96-6b00-4f90-ad9b-27e546e99fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:57.930148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269ae96-6b00-4f90-ad9b-27e546e99fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:57.930424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269ae96-6b00-4f90-ad9b-27e546e99fad admin admin] PATH_INFO: `/v3/users/bc0a8939b64e42ec93bc0a3f1e20ed94` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:57.931572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269ae96-6b00-4f90-ad9b-27e546e99fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0a8939b64e42ec93bc0a3f1e20ed94)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:57.933611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269ae96-6b00-4f90-ad9b-27e546e99fad admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:57.934118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ef58b-b008-4603-82dc-57c1130f05c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:57.934773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ef58b-b008-4603-82dc-57c1130f05c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:57.935054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ef58b-b008-4603-82dc-57c1130f05c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:57.935329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ef58b-b008-4603-82dc-57c1130f05c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:57.937306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-206ef58b-b008-4603-82dc-57c1130f05c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:57.984878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a269ae96-6b00-4f90-ad9b-27e546e99fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0a8939b64e42ec93bc0a3f1e20ed94'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.985496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a269ae96-6b00-4f90-ad9b-27e546e99fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0a8939b64e42ec93bc0a3f1e20ed94'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.995326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a269ae96-6b00-4f90-ad9b-27e546e99fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0a8939b64e42ec93bc0a3f1e20ed94'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:57.997742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ef58b-b008-4603-82dc-57c1130f05c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:57.999557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ef58b-b008-4603-82dc-57c1130f05c3 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:58.004162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a269ae96-6b00-4f90-ad9b-27e546e99fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0a8939b64e42ec93bc0a3f1e20ed94'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:58.004883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a269ae96-6b00-4f90-ad9b-27e546e99fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0a8939b64e42ec93bc0a3f1e20ed94'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:58.014502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 897/1806] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:57 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:12:58.015572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ef58b-b008-4603-82dc-57c1130f05c3 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:58.017231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-206ef58b-b008-4603-82dc-57c1130f05c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:58.031479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ef58b-b008-4603-82dc-57c1130f05c3 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:58.035733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 910/1807] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:12:57 2022] DELETE /identity/v3/users/bc0a8939b64e42ec93bc0a3f1e20ed94 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:12:58.036442 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:58.037409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.037777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.038145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae admin admin] PATH_INFO: `/v3/projects/a8c2ffef96974b5996a8720c573001f8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.049308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c2ffef96974b5996a8720c573001f8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:58.052862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:58.124871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c2ffef96974b5996a8720c573001f8', 'request_id': 'req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:58.133522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c2ffef96974b5996a8720c573001f8', 'request_id': 'req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:58.145774 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c2ffef96974b5996a8720c573001f8', 'request_id': 'req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:58.154172 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:58.161180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae admin admin] The token cache is being invalidate because project a8c2ffef96974b5996a8720c573001f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:12:58.161730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:58.172311 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8b5081d4-0b0b-4916-b231-09c7b3fdd3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:58.177218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 898/1808] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:12:58 2022] DELETE /identity/v3/projects/a8c2ffef96974b5996a8720c573001f8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:58.182381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4817deb-74b5-4cd0-9afd-620e9585428a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.182677 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4817deb-74b5-4cd0-9afd-620e9585428a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.183624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4817deb-74b5-4cd0-9afd-620e9585428a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.213514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c4817deb-74b5-4cd0-9afd-620e9585428a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:58.215475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c4817deb-74b5-4cd0-9afd-620e9585428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:58.339341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 911/1809] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:58.348694 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0473c90-030f-44b5-809e-d33c741590fc None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.349332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0473c90-030f-44b5-809e-d33c741590fc None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.349568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0473c90-030f-44b5-809e-d33c741590fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.395967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b0473c90-030f-44b5-809e-d33c741590fc None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:58.398425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b0473c90-030f-44b5-809e-d33c741590fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:58.409947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 899/1810] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:12:58.414483 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4817deb-74b5-4cd0-9afd-620e9585428a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:58.428809 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4817deb-74b5-4cd0-9afd-620e9585428a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:58.435334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214755b-20b8-4cab-b67b-ee7eb93ba7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:58.436982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214755b-20b8-4cab-b67b-ee7eb93ba7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.437524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214755b-20b8-4cab-b67b-ee7eb93ba7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.437967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214755b-20b8-4cab-b67b-ee7eb93ba7e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.439052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214755b-20b8-4cab-b67b-ee7eb93ba7e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:58.439771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214755b-20b8-4cab-b67b-ee7eb93ba7e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:58.443175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214755b-20b8-4cab-b67b-ee7eb93ba7e9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:58.460152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 912/1811] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:12:58.464475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0473c90-030f-44b5-809e-d33c741590fc None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:58.482735 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0473c90-030f-44b5-809e-d33c741590fc None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:58.500678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cf235-5ca7-4b9f-8759-606a35896102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:58.501386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cf235-5ca7-4b9f-8759-606a35896102 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.501913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cf235-5ca7-4b9f-8759-606a35896102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.502019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cf235-5ca7-4b9f-8759-606a35896102 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.502715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cf235-5ca7-4b9f-8759-606a35896102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:58.504859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cf235-5ca7-4b9f-8759-606a35896102 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:58.529863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214755b-20b8-4cab-b67b-ee7eb93ba7e9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:58.531677 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0214755b-20b8-4cab-b67b-ee7eb93ba7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:58.556586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214755b-20b8-4cab-b67b-ee7eb93ba7e9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:58.560016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 900/1812] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:58 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:12:58.565915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5005e81-5733-43aa-af83-0468963e5407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:58.566112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cf235-5ca7-4b9f-8759-606a35896102 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:58.566797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5005e81-5733-43aa-af83-0468963e5407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.567173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5005e81-5733-43aa-af83-0468963e5407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.567588 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5005e81-5733-43aa-af83-0468963e5407 admin admin] PATH_INFO: `/v3/projects/f98b9bf55226479c8519b6723757ce5c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.568968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5005e81-5733-43aa-af83-0468963e5407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98b9bf55226479c8519b6723757ce5c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:58.578102 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5005e81-5733-43aa-af83-0468963e5407 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:58.578102 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:58.656768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e5005e81-5733-43aa-af83-0468963e5407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98b9bf55226479c8519b6723757ce5c', 'request_id': 'req-e5005e81-5733-43aa-af83-0468963e5407'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:58.666403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e5005e81-5733-43aa-af83-0468963e5407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98b9bf55226479c8519b6723757ce5c', 'request_id': 'req-e5005e81-5733-43aa-af83-0468963e5407'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:58.674346 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e5005e81-5733-43aa-af83-0468963e5407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98b9bf55226479c8519b6723757ce5c', 'request_id': 'req-e5005e81-5733-43aa-af83-0468963e5407'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:58.678315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cf235-5ca7-4b9f-8759-606a35896102 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:58.696449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e5005e81-5733-43aa-af83-0468963e5407 admin admin] The token cache is being invalidate because project f98b9bf55226479c8519b6723757ce5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:12:58.696736 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e5005e81-5733-43aa-af83-0468963e5407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:58.697574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e5005e81-5733-43aa-af83-0468963e5407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:12:58.699372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 913/1813] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:12:58 2022] DELETE /identity/v3/projects/f98b9bf55226479c8519b6723757ce5c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:58.704647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebd477-1476-475e-b48b-84d5ea70ef0b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.704981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebd477-1476-475e-b48b-84d5ea70ef0b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.705402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebd477-1476-475e-b48b-84d5ea70ef0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.733022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-17ebd477-1476-475e-b48b-84d5ea70ef0b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:58.734781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-17ebd477-1476-475e-b48b-84d5ea70ef0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:58.805537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ca4be-8e24-4289-ab68-7d13123c1724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:58.805537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca4be-8e24-4289-ab68-7d13123c1724 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.805859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca4be-8e24-4289-ab68-7d13123c1724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.805944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca4be-8e24-4289-ab68-7d13123c1724 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.806545 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ca4be-8e24-4289-ab68-7d13123c1724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:58.808541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ca4be-8e24-4289-ab68-7d13123c1724 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:58.816452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 914/1814] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:58.822001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96198013-55b5-410f-9fdc-19c0553c0a2b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.822363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96198013-55b5-410f-9fdc-19c0553c0a2b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.822644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96198013-55b5-410f-9fdc-19c0553c0a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.847149 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 901/1815] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:58 2022] POST /identity/v3/users => generated 286 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:58.850610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ca4be-8e24-4289-ab68-7d13123c1724 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:58.852563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-795ca4be-8e24-4289-ab68-7d13123c1724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:58.854724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-96198013-55b5-410f-9fdc-19c0553c0a2b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:58.856342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-96198013-55b5-410f-9fdc-19c0553c0a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:58.865321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 915/1816] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:58.866311 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ca4be-8e24-4289-ab68-7d13123c1724 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:58.869881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96198013-55b5-410f-9fdc-19c0553c0a2b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:58.871436 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc13115-53f2-4806-a1ad-108966d05ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:58.872224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc13115-53f2-4806-a1ad-108966d05ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.872608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc13115-53f2-4806-a1ad-108966d05ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.872948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc13115-53f2-4806-a1ad-108966d05ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.873666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc13115-53f2-4806-a1ad-108966d05ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:58.875463 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc13115-53f2-4806-a1ad-108966d05ddb admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:58.881558 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96198013-55b5-410f-9fdc-19c0553c0a2b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:58.891239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 902/1817] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:58.891438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd83434-9d3d-4396-a66b-2fcf98b2569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:58.891438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd83434-9d3d-4396-a66b-2fcf98b2569a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.891438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd83434-9d3d-4396-a66b-2fcf98b2569a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.891438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd83434-9d3d-4396-a66b-2fcf98b2569a admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.891793 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd83434-9d3d-4396-a66b-2fcf98b2569a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:12:58.892095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd83434-9d3d-4396-a66b-2fcf98b2569a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:58.893638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd83434-9d3d-4396-a66b-2fcf98b2569a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:58.904250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc13115-53f2-4806-a1ad-108966d05ddb admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:58.908321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 916/1818] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:12:58.913646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd83434-9d3d-4396-a66b-2fcf98b2569a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:58.925642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc13115-53f2-4806-a1ad-108966d05ddb admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:58.931808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4483b4-2240-410a-b98d-c5d9012af308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:58.932254 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd83434-9d3d-4396-a66b-2fcf98b2569a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:58.932479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4483b4-2240-410a-b98d-c5d9012af308 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.932749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4483b4-2240-410a-b98d-c5d9012af308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.933135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4483b4-2240-410a-b98d-c5d9012af308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.933923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4483b4-2240-410a-b98d-c5d9012af308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:58.936145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4483b4-2240-410a-b98d-c5d9012af308 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:58.937163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de8d18-8280-454d-a4a3-0596723d143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:58.937778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de8d18-8280-454d-a4a3-0596723d143d admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.938061 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de8d18-8280-454d-a4a3-0596723d143d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.938336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de8d18-8280-454d-a4a3-0596723d143d admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.938983 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de8d18-8280-454d-a4a3-0596723d143d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:58.940984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de8d18-8280-454d-a4a3-0596723d143d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:58.950648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 903/1819] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:12:58.954642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4483b4-2240-410a-b98d-c5d9012af308 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:58.965507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4483b4-2240-410a-b98d-c5d9012af308 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:58.971271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eec7eb-5f95-483d-b99a-db0e0f9267cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:58.971962 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eec7eb-5f95-483d-b99a-db0e0f9267cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:58.972244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eec7eb-5f95-483d-b99a-db0e0f9267cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:58.972558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eec7eb-5f95-483d-b99a-db0e0f9267cc admin admin] PATH_INFO: `/v3/projects/fb6ca2291151475787ee60755d16ab76/users/a40ce507602d4f83a1c469e4fb7e7cd0/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:58.984471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 917/1820] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:58 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:58.990516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de8d18-8280-454d-a4a3-0596723d143d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:58.999675 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eec7eb-5f95-483d-b99a-db0e0f9267cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6ca2291151475787ee60755d16ab76, user_id=a40ce507602d4f83a1c469e4fb7e7cd0, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.004875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eec7eb-5f95-483d-b99a-db0e0f9267cc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.034219 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 904/1821] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:58 2022] PUT /identity/v3/projects/fb6ca2291151475787ee60755d16ab76/users/a40ce507602d4f83a1c469e4fb7e7cd0/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:12:59.045636 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004f189-5630-4546-a9a7-fe1142871ec3 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.045915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004f189-5630-4546-a9a7-fe1142871ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.046351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004f189-5630-4546-a9a7-fe1142871ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.070981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:59.084550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6004f189-5630-4546-a9a7-fe1142871ec3 None None] MFA Rules not processed for user `a40ce507602d4f83a1c469e4fb7e7cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:59.085690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de8d18-8280-454d-a4a3-0596723d143d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.086030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6004f189-5630-4546-a9a7-fe1142871ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:59.094912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:59.148974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0bcf0-2141-44db-b6e2-f196f541381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.149594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0bcf0-2141-44db-b6e2-f196f541381a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.149874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0bcf0-2141-44db-b6e2-f196f541381a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.150147 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0bcf0-2141-44db-b6e2-f196f541381a admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.150786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0bcf0-2141-44db-b6e2-f196f541381a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.152789 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0bcf0-2141-44db-b6e2-f196f541381a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.155969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 905/1822] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:59.160418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004f189-5630-4546-a9a7-fe1142871ec3 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.170783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004f189-5630-4546-a9a7-fe1142871ec3 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.175216 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 918/1823] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:58 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:59.175859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37980c-127f-4c57-a107-739db4d33f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.176503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37980c-127f-4c57-a107-739db4d33f21 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.176777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37980c-127f-4c57-a107-739db4d33f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.177043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37980c-127f-4c57-a107-739db4d33f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.177666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37980c-127f-4c57-a107-739db4d33f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.179238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0bcf0-2141-44db-b6e2-f196f541381a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.179894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37980c-127f-4c57-a107-739db4d33f21 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.189386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0bcf0-2141-44db-b6e2-f196f541381a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.194243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0692-5abd-4733-b171-b71d1db5dc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.194820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0692-5abd-4733-b171-b71d1db5dc63 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.195096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0692-5abd-4733-b171-b71d1db5dc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.195364 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0692-5abd-4733-b171-b71d1db5dc63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.196005 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b0692-5abd-4733-b171-b71d1db5dc63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.197675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b0692-5abd-4733-b171-b71d1db5dc63 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.210884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 919/1824] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:12:59.211045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 906/1825] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:59 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:12:59.213169 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0692-5abd-4733-b171-b71d1db5dc63 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.213295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37980c-127f-4c57-a107-739db4d33f21 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.223349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0692-5abd-4733-b171-b71d1db5dc63 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.279042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37980c-127f-4c57-a107-739db4d33f21 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.286251 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ddcb9-2bf4-426f-ac50-3cd75e4276c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.286803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ddcb9-2bf4-426f-ac50-3cd75e4276c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.287082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ddcb9-2bf4-426f-ac50-3cd75e4276c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.287354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ddcb9-2bf4-426f-ac50-3cd75e4276c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.287998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ddcb9-2bf4-426f-ac50-3cd75e4276c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.290047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ddcb9-2bf4-426f-ac50-3cd75e4276c6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.298892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f17274-7348-4a62-840d-753085e27e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.299523 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f17274-7348-4a62-840d-753085e27e95 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.299804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f17274-7348-4a62-840d-753085e27e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.300095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f17274-7348-4a62-840d-753085e27e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.300797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f17274-7348-4a62-840d-753085e27e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.302453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f17274-7348-4a62-840d-753085e27e95 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.313410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 920/1826] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:12:59.316941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 907/1827] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:59 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:59.317735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f17274-7348-4a62-840d-753085e27e95 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.320807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ddcb9-2bf4-426f-ac50-3cd75e4276c6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.329713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f17274-7348-4a62-840d-753085e27e95 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.331120 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ddcb9-2bf4-426f-ac50-3cd75e4276c6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.336249 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77528224-27f3-430c-a3a6-80240f3089cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.337153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77528224-27f3-430c-a3a6-80240f3089cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.337440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77528224-27f3-430c-a3a6-80240f3089cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.337716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77528224-27f3-430c-a3a6-80240f3089cb admin admin] PATH_INFO: `/v3/projects/eccb22d7bf31460ea5a67a6e020a11b8/users/9fa28f78278a441d853378461b03fbf9/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.340141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b459c9-e17d-423d-9f5d-dbffa0e5753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.342125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b459c9-e17d-423d-9f5d-dbffa0e5753f admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.342423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b459c9-e17d-423d-9f5d-dbffa0e5753f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.342702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b459c9-e17d-423d-9f5d-dbffa0e5753f admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.343467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b459c9-e17d-423d-9f5d-dbffa0e5753f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.345413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b459c9-e17d-423d-9f5d-dbffa0e5753f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.356244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77528224-27f3-430c-a3a6-80240f3089cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccb22d7bf31460ea5a67a6e020a11b8, user_id=9fa28f78278a441d853378461b03fbf9, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.357852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 908/1828] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:59.359338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77528224-27f3-430c-a3a6-80240f3089cb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.361919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b459c9-e17d-423d-9f5d-dbffa0e5753f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.372438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b459c9-e17d-423d-9f5d-dbffa0e5753f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.377796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 921/1829] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:59 2022] PUT /identity/v3/projects/eccb22d7bf31460ea5a67a6e020a11b8/users/9fa28f78278a441d853378461b03fbf9/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:12:59.388251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf7d2d-9bd1-408c-9e64-3f6bb9b8d8b1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.388573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf7d2d-9bd1-408c-9e64-3f6bb9b8d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.388832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf7d2d-9bd1-408c-9e64-3f6bb9b8d8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.419504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a6cf7d2d-9bd1-408c-9e64-3f6bb9b8d8b1 None None] MFA Rules not processed for user `9fa28f78278a441d853378461b03fbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:59.420758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a6cf7d2d-9bd1-408c-9e64-3f6bb9b8d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:59.447963 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e830b06-77b2-4c8a-a374-f44cdd03596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.448684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e830b06-77b2-4c8a-a374-f44cdd03596c admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.448968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e830b06-77b2-4c8a-a374-f44cdd03596c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.449247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e830b06-77b2-4c8a-a374-f44cdd03596c admin admin] PATH_INFO: `/v3/projects/fe9c40aa0c534e648f58e5c38a4699c7/users/17a3953855754b7cbeb59df51471c864/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.461623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:59.464378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:59.466030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e830b06-77b2-4c8a-a374-f44cdd03596c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9c40aa0c534e648f58e5c38a4699c7, user_id=17a3953855754b7cbeb59df51471c864, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.470872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e830b06-77b2-4c8a-a374-f44cdd03596c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.486970 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 909/1830] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:59 2022] PUT /identity/v3/projects/fe9c40aa0c534e648f58e5c38a4699c7/users/17a3953855754b7cbeb59df51471c864/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:12:59.490810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e830b06-77b2-4c8a-a374-f44cdd03596c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.499079 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 922/1831] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:12:59.503648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf7d2d-9bd1-408c-9e64-3f6bb9b8d8b1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.518948 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf7d2d-9bd1-408c-9e64-3f6bb9b8d8b1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.573172 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e830b06-77b2-4c8a-a374-f44cdd03596c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.579875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f970848-eebc-4bf3-aefe-d813a8bbb918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.580529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f970848-eebc-4bf3-aefe-d813a8bbb918 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.580812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f970848-eebc-4bf3-aefe-d813a8bbb918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.581068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f970848-eebc-4bf3-aefe-d813a8bbb918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.581712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f970848-eebc-4bf3-aefe-d813a8bbb918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.583426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f970848-eebc-4bf3-aefe-d813a8bbb918 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.591217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaec317-4aa6-4344-bedf-8e1d2ebbba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.591845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaec317-4aa6-4344-bedf-8e1d2ebbba33 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.592125 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaec317-4aa6-4344-bedf-8e1d2ebbba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.592446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaec317-4aa6-4344-bedf-8e1d2ebbba33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.593492 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaec317-4aa6-4344-bedf-8e1d2ebbba33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.595302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaec317-4aa6-4344-bedf-8e1d2ebbba33 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.598738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 910/1832] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:59.611993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f970848-eebc-4bf3-aefe-d813a8bbb918 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.624279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f970848-eebc-4bf3-aefe-d813a8bbb918 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.631296 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec13e8-601e-41ac-b448-d5fe104263fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.632644 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec13e8-601e-41ac-b448-d5fe104263fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.633093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec13e8-601e-41ac-b448-d5fe104263fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.633495 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec13e8-601e-41ac-b448-d5fe104263fa admin admin] PATH_INFO: `/v3/projects/fe9c40aa0c534e648f58e5c38a4699c7/users/17a3953855754b7cbeb59df51471c864/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.635991 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec13e8-601e-41ac-b448-d5fe104263fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9c40aa0c534e648f58e5c38a4699c7, user_id=17a3953855754b7cbeb59df51471c864, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.642015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 923/1833] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:12:59 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:59.642219 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec13e8-601e-41ac-b448-d5fe104263fa admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.644275 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaec317-4aa6-4344-bedf-8e1d2ebbba33 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.658394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 911/1834] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:59 2022] PUT /identity/v3/projects/fe9c40aa0c534e648f58e5c38a4699c7/users/17a3953855754b7cbeb59df51471c864/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:12:59.668903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af12447-b62e-43e0-9b56-8238fe1d2229 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.669300 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af12447-b62e-43e0-9b56-8238fe1d2229 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.669997 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af12447-b62e-43e0-9b56-8238fe1d2229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.706333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-5af12447-b62e-43e0-9b56-8238fe1d2229 None None] MFA Rules not processed for user `17a3953855754b7cbeb59df51471c864`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:12:59.707611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5af12447-b62e-43e0-9b56-8238fe1d2229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:59.734627 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaec317-4aa6-4344-bedf-8e1d2ebbba33 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.804038 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792aa71-015c-4fb9-b0b0-4be7202cc15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.804691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792aa71-015c-4fb9-b0b0-4be7202cc15f admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.804972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792aa71-015c-4fb9-b0b0-4be7202cc15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.805287 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792aa71-015c-4fb9-b0b0-4be7202cc15f admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.805399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 912/1835] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:12:59.805943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792aa71-015c-4fb9-b0b0-4be7202cc15f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.807985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792aa71-015c-4fb9-b0b0-4be7202cc15f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.827840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:59.834121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 924/1836] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:12:59 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:12:59.838642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af12447-b62e-43e0-9b56-8238fe1d2229 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.850484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af12447-b62e-43e0-9b56-8238fe1d2229 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.855401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65ce07-9bbb-4786-baf4-870fe530e228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.856017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65ce07-9bbb-4786-baf4-870fe530e228 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.856332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65ce07-9bbb-4786-baf4-870fe530e228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.856608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65ce07-9bbb-4786-baf4-870fe530e228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.857252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65ce07-9bbb-4786-baf4-870fe530e228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.859866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65ce07-9bbb-4786-baf4-870fe530e228 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.873760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 913/1837] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:12:59.875667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792aa71-015c-4fb9-b0b0-4be7202cc15f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.889372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65ce07-9bbb-4786-baf4-870fe530e228 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.892141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1a65ce07-9bbb-4786-baf4-870fe530e228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:12:59.898290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792aa71-015c-4fb9-b0b0-4be7202cc15f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:12:59.904485 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ead58-d6ac-4074-8fd4-e1007803365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:12:59.905162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ead58-d6ac-4074-8fd4-e1007803365a admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:12:59.905609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ead58-d6ac-4074-8fd4-e1007803365a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:12:59.905771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ead58-d6ac-4074-8fd4-e1007803365a admin admin] PATH_INFO: `/v3/projects/31307ed224304806a1154cc0ccdc87c1/users/8a37cc222e954a4eb9fd3745f203f082/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:12:59.929490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ead58-d6ac-4074-8fd4-e1007803365a admin admin] RBAC: Authorizing `identity:create_grant(project_id=31307ed224304806a1154cc0ccdc87c1, user_id=8a37cc222e954a4eb9fd3745f203f082, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:12:59.934390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ead58-d6ac-4074-8fd4-e1007803365a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:12:59.959435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 925/1838] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:12:59 2022] PUT /identity/v3/projects/31307ed224304806a1154cc0ccdc87c1/users/8a37cc222e954a4eb9fd3745f203f082/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:12:59.963058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:59.965919 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ead58-d6ac-4074-8fd4-e1007803365a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:12:59.972433 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65ce07-9bbb-4786-baf4-870fe530e228 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:00.060562 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ead58-d6ac-4074-8fd4-e1007803365a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:00.066007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002452b-5170-400d-b9ac-106858533df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:00.066792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002452b-5170-400d-b9ac-106858533df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:00.067082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002452b-5170-400d-b9ac-106858533df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:00.067366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002452b-5170-400d-b9ac-106858533df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:00.068027 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002452b-5170-400d-b9ac-106858533df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:00.070052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002452b-5170-400d-b9ac-106858533df0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:00.080134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d198-4bc9-4794-993f-2878a10c2931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:00.080810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d198-4bc9-4794-993f-2878a10c2931 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:00.081087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d198-4bc9-4794-993f-2878a10c2931 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:00.081373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d198-4bc9-4794-993f-2878a10c2931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:00.086517 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 926/1839] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:00.090813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002452b-5170-400d-b9ac-106858533df0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:00.104780 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002452b-5170-400d-b9ac-106858533df0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:00.112123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d9f8b-337c-47b0-95d7-84324eb67da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:00.113024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d9f8b-337c-47b0-95d7-84324eb67da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:00.113314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d9f8b-337c-47b0-95d7-84324eb67da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:00.113646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d9f8b-337c-47b0-95d7-84324eb67da2 admin admin] PATH_INFO: `/v3/projects/31307ed224304806a1154cc0ccdc87c1/users/8a37cc222e954a4eb9fd3745f203f082/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:00.130140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d9f8b-337c-47b0-95d7-84324eb67da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31307ed224304806a1154cc0ccdc87c1, user_id=8a37cc222e954a4eb9fd3745f203f082, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:00.133411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d9f8b-337c-47b0-95d7-84324eb67da2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:00.155748 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 927/1840] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:00 2022] PUT /identity/v3/projects/31307ed224304806a1154cc0ccdc87c1/users/8a37cc222e954a4eb9fd3745f203f082/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:00.160485 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dbf40-fd35-4b38-92fa-ee34c58268ed None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:00.160771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dbf40-fd35-4b38-92fa-ee34c58268ed None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:00.161046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dbf40-fd35-4b38-92fa-ee34c58268ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:00.216558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556d198-4bc9-4794-993f-2878a10c2931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:00.217753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c03dbf40-fd35-4b38-92fa-ee34c58268ed None None] MFA Rules not processed for user `8a37cc222e954a4eb9fd3745f203f082`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:00.218113 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556d198-4bc9-4794-993f-2878a10c2931 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:00.219933 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c03dbf40-fd35-4b38-92fa-ee34c58268ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:00.239690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 914/1841] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:12:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:00.354224 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 928/1842] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:00.366052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d198-4bc9-4794-993f-2878a10c2931 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:00.367747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a556d198-4bc9-4794-993f-2878a10c2931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:00.380847 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d198-4bc9-4794-993f-2878a10c2931 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:00.448613 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e02d2-81ee-4709-b2bb-d3cf3ba0638c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:00.449761 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e02d2-81ee-4709-b2bb-d3cf3ba0638c service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:00.450181 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e02d2-81ee-4709-b2bb-d3cf3ba0638c service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:00.450459 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e02d2-81ee-4709-b2bb-d3cf3ba0638c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:00.461671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e02d2-81ee-4709-b2bb-d3cf3ba0638c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:00.463416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e02d2-81ee-4709-b2bb-d3cf3ba0638c service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:00.483327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 915/1843] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:00.605894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dbf40-fd35-4b38-92fa-ee34c58268ed None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:00.618068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dbf40-fd35-4b38-92fa-ee34c58268ed None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:00.622697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddfe46-1044-4e69-8bf8-1ec84a297022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:00.623376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddfe46-1044-4e69-8bf8-1ec84a297022 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:00.623659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddfe46-1044-4e69-8bf8-1ec84a297022 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:00.623981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddfe46-1044-4e69-8bf8-1ec84a297022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:00.695036 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:00.728408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddfe46-1044-4e69-8bf8-1ec84a297022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:00.730058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddfe46-1044-4e69-8bf8-1ec84a297022 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:00.741495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 929/1844] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:00.848180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e02d2-81ee-4709-b2bb-d3cf3ba0638c service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:00.926190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:00.932788 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e02d2-81ee-4709-b2bb-d3cf3ba0638c service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:00.939082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:00.939778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:00.940059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:00.940363 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] PATH_INFO: `/v3/users/a40ce507602d4f83a1c469e4fb7e7cd0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:00.941685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40ce507602d4f83a1c469e4fb7e7cd0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:00.943772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:00.999994 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40ce507602d4f83a1c469e4fb7e7cd0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:01.000858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40ce507602d4f83a1c469e4fb7e7cd0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:01.011520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40ce507602d4f83a1c469e4fb7e7cd0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:01.012722 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40ce507602d4f83a1c469e4fb7e7cd0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:01.028154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40ce507602d4f83a1c469e4fb7e7cd0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:01.044079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 916/1845] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:00 2022] DELETE /identity/v3/users/a40ce507602d4f83a1c469e4fb7e7cd0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:01.048867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830efcb-78fa-4161-a61e-f16199a299d8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:01.049370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830efcb-78fa-4161-a61e-f16199a299d8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:01.049996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830efcb-78fa-4161-a61e-f16199a299d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:01.071674 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2830efcb-78fa-4161-a61e-f16199a299d8 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:01.072964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2830efcb-78fa-4161-a61e-f16199a299d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:01.155356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 930/1846] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:01.206681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:01.208212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:01.370630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b6923-a98e-4f60-b6a8-2756849e58ed admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:01.375776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1af71-7038-4380-b760-96345d4d48fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:01.376438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1af71-7038-4380-b760-96345d4d48fd service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:01.376716 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1af71-7038-4380-b760-96345d4d48fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:01.376983 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1af71-7038-4380-b760-96345d4d48fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:01.387890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1af71-7038-4380-b760-96345d4d48fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:01.389668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1af71-7038-4380-b760-96345d4d48fd service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:01.440086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 917/1847] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:01.800860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830efcb-78fa-4161-a61e-f16199a299d8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:01.803564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2830efcb-78fa-4161-a61e-f16199a299d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:01.822918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830efcb-78fa-4161-a61e-f16199a299d8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:01.832713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:01.833541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:01.833883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:01.834121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] PATH_INFO: `/v3/users/26142ec4f45a4c13bd22d424b9a4361b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:01.835376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26142ec4f45a4c13bd22d424b9a4361b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:01.837946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:01.915744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26142ec4f45a4c13bd22d424b9a4361b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:01.916870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26142ec4f45a4c13bd22d424b9a4361b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:01.930979 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26142ec4f45a4c13bd22d424b9a4361b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:01.940596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26142ec4f45a4c13bd22d424b9a4361b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:01.941324 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26142ec4f45a4c13bd22d424b9a4361b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:01.961270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 931/1848] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:01 2022] DELETE /identity/v3/users/26142ec4f45a4c13bd22d424b9a4361b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:01.966570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff804a6-8bee-4f48-bc1b-bdb08788b62d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:01.966914 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff804a6-8bee-4f48-bc1b-bdb08788b62d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:01.967389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff804a6-8bee-4f48-bc1b-bdb08788b62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:01.988852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-eff804a6-8bee-4f48-bc1b-bdb08788b62d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:01.990226 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-eff804a6-8bee-4f48-bc1b-bdb08788b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:02.067882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 918/1849] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:02.078589 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:02.080499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:02.153322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30b6ab-abe8-4dcd-8ebf-39f848222a11 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:02.157217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5718d8-7502-4172-b314-479a387ef983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:02.157961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5718d8-7502-4172-b314-479a387ef983 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:02.158243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5718d8-7502-4172-b314-479a387ef983 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:02.158515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5718d8-7502-4172-b314-479a387ef983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:02.170098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5718d8-7502-4172-b314-479a387ef983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:02.171949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5718d8-7502-4172-b314-479a387ef983 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:02.173804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff804a6-8bee-4f48-bc1b-bdb08788b62d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:02.175714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-eff804a6-8bee-4f48-bc1b-bdb08788b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:02.176221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:02.186042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 932/1850] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:02.190420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff804a6-8bee-4f48-bc1b-bdb08788b62d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:02.195853 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:02.196738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:02.197022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:02.197296 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] PATH_INFO: `/v3/projects/fb6ca2291151475787ee60755d16ab76` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:02.198555 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6ca2291151475787ee60755d16ab76)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:02.200582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:02.216159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:02.266041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6ca2291151475787ee60755d16ab76', 'request_id': 'req-4bba3b61-abc9-4173-99dc-ae5598243bf4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.272937 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6ca2291151475787ee60755d16ab76', 'request_id': 'req-4bba3b61-abc9-4173-99dc-ae5598243bf4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.282908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6ca2291151475787ee60755d16ab76', 'request_id': 'req-4bba3b61-abc9-4173-99dc-ae5598243bf4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.295555 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] The token cache is being invalidate because project fb6ca2291151475787ee60755d16ab76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:02.295977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.296776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.299218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 919/1851] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:02 2022] DELETE /identity/v3/projects/fb6ca2291151475787ee60755d16ab76 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:02.303670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5718d8-7502-4172-b314-479a387ef983 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:02.316983 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5718d8-7502-4172-b314-479a387ef983 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:02.399308 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:02.400767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:02.400767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:02.400767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] PATH_INFO: `/v3/users/17a3953855754b7cbeb59df51471c864` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:02.412514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17a3953855754b7cbeb59df51471c864)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:02.416507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:02.479381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a3953855754b7cbeb59df51471c864'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.480058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a3953855754b7cbeb59df51471c864'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.490656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a3953855754b7cbeb59df51471c864'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.501828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a3953855754b7cbeb59df51471c864'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.502617 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a3953855754b7cbeb59df51471c864'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.524894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 933/1852] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:02 2022] DELETE /identity/v3/users/17a3953855754b7cbeb59df51471c864 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:02.531313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:02.532987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:02.555207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba3b61-abc9-4173-99dc-ae5598243bf4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:02.636445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:02.637103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:02.637385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:02.637659 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] PATH_INFO: `/v3/projects/3fd1fef507ba4ea099da5a8999ac51fc` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:02.638798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd1fef507ba4ea099da5a8999ac51fc)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:02.640990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:02.692660 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd1fef507ba4ea099da5a8999ac51fc', 'request_id': 'req-3337db10-3a18-4597-8785-25e3595939fe'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.699090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd1fef507ba4ea099da5a8999ac51fc', 'request_id': 'req-3337db10-3a18-4597-8785-25e3595939fe'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.716403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd1fef507ba4ea099da5a8999ac51fc', 'request_id': 'req-3337db10-3a18-4597-8785-25e3595939fe'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.756856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] The token cache is being invalidate because project 3fd1fef507ba4ea099da5a8999ac51fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:02.757548 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.758611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:02.762225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 920/1853] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:02 2022] DELETE /identity/v3/projects/3fd1fef507ba4ea099da5a8999ac51fc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:02.767059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:02.769115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:02.818243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4f11c-498f-4bb6-bb5b-d40501abeb69 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:02.963244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6846b-5f81-4639-8898-d7b3b8b52639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:02.964715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6846b-5f81-4639-8898-d7b3b8b52639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:02.965053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6846b-5f81-4639-8898-d7b3b8b52639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:02.965411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6846b-5f81-4639-8898-d7b3b8b52639 admin admin] PATH_INFO: `/v3/users/1972390f54a047bea7e0ccd35afa182e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:02.972127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6846b-5f81-4639-8898-d7b3b8b52639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1972390f54a047bea7e0ccd35afa182e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:02.974574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6846b-5f81-4639-8898-d7b3b8b52639 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:03.022405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:03.075242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0de6846b-5f81-4639-8898-d7b3b8b52639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1972390f54a047bea7e0ccd35afa182e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:03.076181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0de6846b-5f81-4639-8898-d7b3b8b52639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1972390f54a047bea7e0ccd35afa182e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:03.091840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0de6846b-5f81-4639-8898-d7b3b8b52639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1972390f54a047bea7e0ccd35afa182e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:03.094473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:03.095924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:03.114056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337db10-3a18-4597-8785-25e3595939fe admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:03.118582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0de6846b-5f81-4639-8898-d7b3b8b52639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1972390f54a047bea7e0ccd35afa182e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:03.119293 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0de6846b-5f81-4639-8898-d7b3b8b52639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1972390f54a047bea7e0ccd35afa182e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:03.125311 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c01e8-70c4-45a2-9f3d-aa8481effe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:03.125963 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c01e8-70c4-45a2-9f3d-aa8481effe1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:03.126285 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c01e8-70c4-45a2-9f3d-aa8481effe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:03.126507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c01e8-70c4-45a2-9f3d-aa8481effe1f admin admin] PATH_INFO: `/v3/projects/fe9c40aa0c534e648f58e5c38a4699c7` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:03.129132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c01e8-70c4-45a2-9f3d-aa8481effe1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9c40aa0c534e648f58e5c38a4699c7)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:03.132014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c01e8-70c4-45a2-9f3d-aa8481effe1f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:03.155967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 934/1854] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:02 2022] DELETE /identity/v3/users/1972390f54a047bea7e0ccd35afa182e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:03.185515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:03.208939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-678c01e8-70c4-45a2-9f3d-aa8481effe1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9c40aa0c534e648f58e5c38a4699c7', 'request_id': 'req-678c01e8-70c4-45a2-9f3d-aa8481effe1f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:03.218215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-678c01e8-70c4-45a2-9f3d-aa8481effe1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9c40aa0c534e648f58e5c38a4699c7', 'request_id': 'req-678c01e8-70c4-45a2-9f3d-aa8481effe1f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:03.238135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-678c01e8-70c4-45a2-9f3d-aa8481effe1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9c40aa0c534e648f58e5c38a4699c7', 'request_id': 'req-678c01e8-70c4-45a2-9f3d-aa8481effe1f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:03.259948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-678c01e8-70c4-45a2-9f3d-aa8481effe1f admin admin] The token cache is being invalidate because project fe9c40aa0c534e648f58e5c38a4699c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:03.260612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-678c01e8-70c4-45a2-9f3d-aa8481effe1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:03.261576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-678c01e8-70c4-45a2-9f3d-aa8481effe1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:03.263854 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 921/1855] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:03 2022] DELETE /identity/v3/projects/fe9c40aa0c534e648f58e5c38a4699c7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:03.269827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3b131-09ef-4765-8c9a-a78a45eff719 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:03.270367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3b131-09ef-4765-8c9a-a78a45eff719 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:03.270854 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3b131-09ef-4765-8c9a-a78a45eff719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:03.365993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7ca3b131-09ef-4765-8c9a-a78a45eff719 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:03.369864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7ca3b131-09ef-4765-8c9a-a78a45eff719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:03.571270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 935/1856] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:03.580452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6294-8ae2-4f7b-bf60-ff671dae6d65 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:03.581507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6294-8ae2-4f7b-bf60-ff671dae6d65 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:03.582043 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6294-8ae2-4f7b-bf60-ff671dae6d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:03.629151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-067f6294-8ae2-4f7b-bf60-ff671dae6d65 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:03.630376 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-067f6294-8ae2-4f7b-bf60-ff671dae6d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:03.681535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 922/1857] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:03.700748 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3b131-09ef-4765-8c9a-a78a45eff719 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:03.716255 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3b131-09ef-4765-8c9a-a78a45eff719 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:03.730816 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed0cb-99e9-4a4b-b3fa-380a3c4b0245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:03.731536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed0cb-99e9-4a4b-b3fa-380a3c4b0245 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:03.731876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed0cb-99e9-4a4b-b3fa-380a3c4b0245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:03.732211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed0cb-99e9-4a4b-b3fa-380a3c4b0245 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:03.732972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ed0cb-99e9-4a4b-b3fa-380a3c4b0245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:03.733337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ed0cb-99e9-4a4b-b3fa-380a3c4b0245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:03.738160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ed0cb-99e9-4a4b-b3fa-380a3c4b0245 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:03.779445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 936/1858] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:13:03.779631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81139bbd-1464-4105-8c30-55df1e7d8cb7 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:03.780135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81139bbd-1464-4105-8c30-55df1e7d8cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:03.781426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81139bbd-1464-4105-8c30-55df1e7d8cb7 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:03.784552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 923/1859] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 6 01:13:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 01:13:03.784702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed0cb-99e9-4a4b-b3fa-380a3c4b0245 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:03.805731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed0cb-99e9-4a4b-b3fa-380a3c4b0245 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:03.837133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6d6e8-b5dd-418a-a80c-e3b0e4ad4569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:03.837772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6d6e8-b5dd-418a-a80c-e3b0e4ad4569 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:03.838055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6d6e8-b5dd-418a-a80c-e3b0e4ad4569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:03.838345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6d6e8-b5dd-418a-a80c-e3b0e4ad4569 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:03.839122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6d6e8-b5dd-418a-a80c-e3b0e4ad4569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:03.843112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6d6e8-b5dd-418a-a80c-e3b0e4ad4569 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:03.885312 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc831b6-83ae-4b63-929b-cebe79befcf4 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:03.886342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc831b6-83ae-4b63-929b-cebe79befcf4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:03.886813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc831b6-83ae-4b63-929b-cebe79befcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:03.926608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 937/1860] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:03 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:03.931881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6d6e8-b5dd-418a-a80c-e3b0e4ad4569 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:03.934717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6bc831b6-83ae-4b63-929b-cebe79befcf4 None None] MFA Rules not processed for user `42b9c25e98fe4b1bbc33a601d4150071`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:03.937225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6bc831b6-83ae-4b63-929b-cebe79befcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:04.079314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 924/1861] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 6 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:04.097890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc831b6-83ae-4b63-929b-cebe79befcf4 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:04.099646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6bc831b6-83ae-4b63-929b-cebe79befcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:04.123468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6d6e8-b5dd-418a-a80c-e3b0e4ad4569 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:04.129909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc831b6-83ae-4b63-929b-cebe79befcf4 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:04.137072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a438d1-b738-4332-a12a-09ccd33d97bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:04.139483 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a438d1-b738-4332-a12a-09ccd33d97bb admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:04.140584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a438d1-b738-4332-a12a-09ccd33d97bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:04.141448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a438d1-b738-4332-a12a-09ccd33d97bb admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:04.142763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a438d1-b738-4332-a12a-09ccd33d97bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:04.145918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebdfc1-6654-4100-914b-df306559c618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:04.146595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebdfc1-6654-4100-914b-df306559c618 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:04.148208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a438d1-b738-4332-a12a-09ccd33d97bb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:04.148432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebdfc1-6654-4100-914b-df306559c618 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:04.148432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebdfc1-6654-4100-914b-df306559c618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:04.175101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebdfc1-6654-4100-914b-df306559c618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:04.175256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:04.180217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebdfc1-6654-4100-914b-df306559c618 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:04.207975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 938/1862] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:03 2022] POST /identity/v3/users => generated 282 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:04.209631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a438d1-b738-4332-a12a-09ccd33d97bb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:04.219943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 925/1863] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:13:04.229429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a438d1-b738-4332-a12a-09ccd33d97bb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:04.241672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c203d7-bf2e-4205-9ebb-d5c7efebd7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:04.242369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c203d7-bf2e-4205-9ebb-d5c7efebd7ee admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:04.242651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c203d7-bf2e-4205-9ebb-d5c7efebd7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:04.244073 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c203d7-bf2e-4205-9ebb-d5c7efebd7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:04.244786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c203d7-bf2e-4205-9ebb-d5c7efebd7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:04.248091 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c203d7-bf2e-4205-9ebb-d5c7efebd7ee admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:04.270745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 939/1864] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:04.275408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebdfc1-6654-4100-914b-df306559c618 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:04.298408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebdfc1-6654-4100-914b-df306559c618 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:04.318071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c203d7-bf2e-4205-9ebb-d5c7efebd7ee admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:04.322251 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea44c6-8c3b-44c0-9c8e-29f27c5d35d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:04.323866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea44c6-8c3b-44c0-9c8e-29f27c5d35d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:04.326611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-62c203d7-bf2e-4205-9ebb-d5c7efebd7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:04.329101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea44c6-8c3b-44c0-9c8e-29f27c5d35d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:04.331198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea44c6-8c3b-44c0-9c8e-29f27c5d35d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:04.332223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea44c6-8c3b-44c0-9c8e-29f27c5d35d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:04.338896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea44c6-8c3b-44c0-9c8e-29f27c5d35d7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:04.405764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 926/1865] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:04.411436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c203d7-bf2e-4205-9ebb-d5c7efebd7ee admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:04.422011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea44c6-8c3b-44c0-9c8e-29f27c5d35d7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:04.431815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f4a3-5452-4360-a75f-620341ea3b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:04.437356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f4a3-5452-4360-a75f-620341ea3b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:04.437646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f4a3-5452-4360-a75f-620341ea3b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:04.437926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f4a3-5452-4360-a75f-620341ea3b87 admin admin] PATH_INFO: `/v3/projects/aacb5b3973c64ad6a7013b8a695cade2` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:04.440711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918f4a3-5452-4360-a75f-620341ea3b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aacb5b3973c64ad6a7013b8a695cade2)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:04.442692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918f4a3-5452-4360-a75f-620341ea3b87 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:04.446599 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea44c6-8c3b-44c0-9c8e-29f27c5d35d7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:04.467979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b8a30-2d82-45b8-a8bf-091f23fa7d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:04.468621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b8a30-2d82-45b8-a8bf-091f23fa7d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:04.468905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b8a30-2d82-45b8-a8bf-091f23fa7d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:04.469182 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b8a30-2d82-45b8-a8bf-091f23fa7d31 admin admin] PATH_INFO: `/v3/projects/45a3d1d7164344ccb1cbd3645b198281/users/660f213763404787a6200ff242739163/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:04.503123 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b8a30-2d82-45b8-a8bf-091f23fa7d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a3d1d7164344ccb1cbd3645b198281, user_id=660f213763404787a6200ff242739163, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:04.509933 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b8a30-2d82-45b8-a8bf-091f23fa7d31 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:04.548610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 927/1866] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:04 2022] PUT /identity/v3/projects/45a3d1d7164344ccb1cbd3645b198281/users/660f213763404787a6200ff242739163/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:04.551203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54c9d8-d708-4cc7-90a3-a83f9a535e39 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:04.551497 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54c9d8-d708-4cc7-90a3-a83f9a535e39 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:04.551777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54c9d8-d708-4cc7-90a3-a83f9a535e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:04.583374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c918f4a3-5452-4360-a75f-620341ea3b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aacb5b3973c64ad6a7013b8a695cade2', 'request_id': 'req-c918f4a3-5452-4360-a75f-620341ea3b87'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:04.599767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c918f4a3-5452-4360-a75f-620341ea3b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aacb5b3973c64ad6a7013b8a695cade2', 'request_id': 'req-c918f4a3-5452-4360-a75f-620341ea3b87'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:04.617615 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c918f4a3-5452-4360-a75f-620341ea3b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aacb5b3973c64ad6a7013b8a695cade2', 'request_id': 'req-c918f4a3-5452-4360-a75f-620341ea3b87'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:04.646993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6c54c9d8-d708-4cc7-90a3-a83f9a535e39 None None] MFA Rules not processed for user `660f213763404787a6200ff242739163`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:04.649024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6c54c9d8-d708-4cc7-90a3-a83f9a535e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:04.649327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c918f4a3-5452-4360-a75f-620341ea3b87 admin admin] The token cache is being invalidate because project aacb5b3973c64ad6a7013b8a695cade2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:04.649638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c918f4a3-5452-4360-a75f-620341ea3b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:04.652897 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c918f4a3-5452-4360-a75f-620341ea3b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:04.655194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 940/1867] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:04 2022] DELETE /identity/v3/projects/aacb5b3973c64ad6a7013b8a695cade2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:04.661316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba438e-2ddf-46ed-ba12-aeb15ce69fb7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:04.661640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba438e-2ddf-46ed-ba12-aeb15ce69fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:04.661930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba438e-2ddf-46ed-ba12-aeb15ce69fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:04.758665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-48ba438e-2ddf-46ed-ba12-aeb15ce69fb7 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:04.759953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-48ba438e-2ddf-46ed-ba12-aeb15ce69fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:04.763779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:04.845687 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 928/1868] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:04.847660 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54c9d8-d708-4cc7-90a3-a83f9a535e39 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:04.856842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6c54c9d8-d708-4cc7-90a3-a83f9a535e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:04.934991 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 941/1869] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:04.944448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8f8f5-ef62-4d16-8942-f3beedb09eb5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:04.944814 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8f8f5-ef62-4d16-8942-f3beedb09eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:04.945002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8f8f5-ef62-4d16-8942-f3beedb09eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:04.992399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-21c8f8f5-ef62-4d16-8942-f3beedb09eb5 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:04.993595 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-21c8f8f5-ef62-4d16-8942-f3beedb09eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:05.013370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 942/1870] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:05.028336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8f8f5-ef62-4d16-8942-f3beedb09eb5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:05.035483 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54c9d8-d708-4cc7-90a3-a83f9a535e39 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:05.054181 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a905f-3e90-4e8c-890d-38ab91c8f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:05.055070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a905f-3e90-4e8c-890d-38ab91c8f4ff admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:05.056384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a905f-3e90-4e8c-890d-38ab91c8f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:05.056886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a905f-3e90-4e8c-890d-38ab91c8f4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:05.058371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a905f-3e90-4e8c-890d-38ab91c8f4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:05.060084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8f8f5-ef62-4d16-8942-f3beedb09eb5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:05.062027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a905f-3e90-4e8c-890d-38ab91c8f4ff admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:05.072212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b68d4d-15bc-4089-9652-6b25d2a0715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:05.072885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b68d4d-15bc-4089-9652-6b25d2a0715b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:05.073168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b68d4d-15bc-4089-9652-6b25d2a0715b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:05.073488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b68d4d-15bc-4089-9652-6b25d2a0715b admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:05.074124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b68d4d-15bc-4089-9652-6b25d2a0715b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:05.074796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b68d4d-15bc-4089-9652-6b25d2a0715b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:05.076115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b68d4d-15bc-4089-9652-6b25d2a0715b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:05.113514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 929/1871] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:04 2022] POST /identity/v3/projects => generated 363 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:05.117329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a905f-3e90-4e8c-890d-38ab91c8f4ff admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:05.133333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 943/1872] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:05.133333 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b68d4d-15bc-4089-9652-6b25d2a0715b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:05.151495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b68d4d-15bc-4089-9652-6b25d2a0715b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:05.250737 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a905f-3e90-4e8c-890d-38ab91c8f4ff admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:05.260245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29352e2-638e-4632-89f9-f200de718c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:05.261590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29352e2-638e-4632-89f9-f200de718c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:05.261960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29352e2-638e-4632-89f9-f200de718c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:05.262593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29352e2-638e-4632-89f9-f200de718c0d admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:05.265904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29352e2-638e-4632-89f9-f200de718c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:05.271092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29352e2-638e-4632-89f9-f200de718c0d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:05.286010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:05.315752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99fe8b-a35a-4285-b5e2-b9a5c159d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:05.316427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99fe8b-a35a-4285-b5e2-b9a5c159d439 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:05.316707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99fe8b-a35a-4285-b5e2-b9a5c159d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:05.318282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99fe8b-a35a-4285-b5e2-b9a5c159d439 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:05.318949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99fe8b-a35a-4285-b5e2-b9a5c159d439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:05.325246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99fe8b-a35a-4285-b5e2-b9a5c159d439 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:05.354669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 930/1873] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:05 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:05.360984 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29352e2-638e-4632-89f9-f200de718c0d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:05.382013 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 944/1874] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:05 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:05.386266 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99fe8b-a35a-4285-b5e2-b9a5c159d439 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:05.388616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29352e2-638e-4632-89f9-f200de718c0d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:05.500818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:05.509002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99fe8b-a35a-4285-b5e2-b9a5c159d439 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:05.514467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc622704-f676-46d5-86a9-66afb3191a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:05.515562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc622704-f676-46d5-86a9-66afb3191a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:05.516061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc622704-f676-46d5-86a9-66afb3191a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:05.519525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc622704-f676-46d5-86a9-66afb3191a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:05.520484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc622704-f676-46d5-86a9-66afb3191a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:05.522803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc622704-f676-46d5-86a9-66afb3191a00 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:05.532609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42483d-3125-43eb-8055-59bfe4e8182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:05.533623 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42483d-3125-43eb-8055-59bfe4e8182a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:05.534167 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42483d-3125-43eb-8055-59bfe4e8182a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:05.534655 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42483d-3125-43eb-8055-59bfe4e8182a admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:05.535535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42483d-3125-43eb-8055-59bfe4e8182a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:05.537912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42483d-3125-43eb-8055-59bfe4e8182a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:05.552181 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 931/1875] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:05.556387 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc622704-f676-46d5-86a9-66afb3191a00 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:05.570807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc622704-f676-46d5-86a9-66afb3191a00 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:05.577131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5f522-75b2-481e-a4f3-fdb73348bd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:05.578155 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5f522-75b2-481e-a4f3-fdb73348bd5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:05.578836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5f522-75b2-481e-a4f3-fdb73348bd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:05.579454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5f522-75b2-481e-a4f3-fdb73348bd5e admin admin] PATH_INFO: `/v3/projects/4fe6dc854fa7475a85e08951ac817bda/users/5c512d90c07b4122840db70ec82a4a1b/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:05.611194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 945/1876] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:05 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:05.614716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42483d-3125-43eb-8055-59bfe4e8182a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:05.641340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5f522-75b2-481e-a4f3-fdb73348bd5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe6dc854fa7475a85e08951ac817bda, user_id=5c512d90c07b4122840db70ec82a4a1b, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:05.650724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5f522-75b2-481e-a4f3-fdb73348bd5e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:05.653210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42483d-3125-43eb-8055-59bfe4e8182a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:05.668875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41126de-8760-4ed3-92fb-4b647aadc100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:05.669840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41126de-8760-4ed3-92fb-4b647aadc100 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:05.670127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41126de-8760-4ed3-92fb-4b647aadc100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:05.670406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41126de-8760-4ed3-92fb-4b647aadc100 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:05.676538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41126de-8760-4ed3-92fb-4b647aadc100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:05.685173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41126de-8760-4ed3-92fb-4b647aadc100 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:05.688390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 932/1877] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:05 2022] PUT /identity/v3/projects/4fe6dc854fa7475a85e08951ac817bda/users/5c512d90c07b4122840db70ec82a4a1b/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:05.692508 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5f522-75b2-481e-a4f3-fdb73348bd5e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:05.721261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 946/1878] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:05.726615 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41126de-8760-4ed3-92fb-4b647aadc100 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:05.753515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41126de-8760-4ed3-92fb-4b647aadc100 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:05.841884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5f522-75b2-481e-a4f3-fdb73348bd5e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:05.858669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c6e53-af1f-469e-92aa-e4b47617cbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:05.859320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c6e53-af1f-469e-92aa-e4b47617cbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:05.859660 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c6e53-af1f-469e-92aa-e4b47617cbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:05.859939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c6e53-af1f-469e-92aa-e4b47617cbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:05.860644 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c6e53-af1f-469e-92aa-e4b47617cbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:05.862373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c6e53-af1f-469e-92aa-e4b47617cbf2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:05.888942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d151e6-02a2-4e6f-9da8-21e06105e57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:05.889999 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d151e6-02a2-4e6f-9da8-21e06105e57d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:05.890720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d151e6-02a2-4e6f-9da8-21e06105e57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:05.891592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d151e6-02a2-4e6f-9da8-21e06105e57d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:05.894285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d151e6-02a2-4e6f-9da8-21e06105e57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:05.894450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 933/1879] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:05.895379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c6e53-af1f-469e-92aa-e4b47617cbf2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:05.900377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d151e6-02a2-4e6f-9da8-21e06105e57d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:05.919406 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c6e53-af1f-469e-92aa-e4b47617cbf2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:05.941539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd0626-b418-4c70-9b07-cba1b50ceddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:05.942245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd0626-b418-4c70-9b07-cba1b50ceddc admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:05.942534 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd0626-b418-4c70-9b07-cba1b50ceddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:05.942808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd0626-b418-4c70-9b07-cba1b50ceddc admin admin] PATH_INFO: `/v3/projects/4fe6dc854fa7475a85e08951ac817bda/users/5c512d90c07b4122840db70ec82a4a1b/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:05.946998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd0626-b418-4c70-9b07-cba1b50ceddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe6dc854fa7475a85e08951ac817bda, user_id=5c512d90c07b4122840db70ec82a4a1b, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:05.952149 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd0626-b418-4c70-9b07-cba1b50ceddc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:05.953254 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 947/1880] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:05.957537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d151e6-02a2-4e6f-9da8-21e06105e57d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:05.981973 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d151e6-02a2-4e6f-9da8-21e06105e57d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:05.983633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 934/1881] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:05 2022] PUT /identity/v3/projects/4fe6dc854fa7475a85e08951ac817bda/users/5c512d90c07b4122840db70ec82a4a1b/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:05.985760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30fcaf-c4e8-4350-be80-af8ae9cfa2f1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:05.986581 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30fcaf-c4e8-4350-be80-af8ae9cfa2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:05.987128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30fcaf-c4e8-4350-be80-af8ae9cfa2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:06.037697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1b30fcaf-c4e8-4350-be80-af8ae9cfa2f1 None None] MFA Rules not processed for user `5c512d90c07b4122840db70ec82a4a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:06.039703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1b30fcaf-c4e8-4350-be80-af8ae9cfa2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:06.086964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:06.119690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc0cc1-8d78-4fa2-a1b7-2f8418f3146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:06.123852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc0cc1-8d78-4fa2-a1b7-2f8418f3146f admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:06.124954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc0cc1-8d78-4fa2-a1b7-2f8418f3146f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:06.125548 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc0cc1-8d78-4fa2-a1b7-2f8418f3146f admin admin] PATH_INFO: `/v3/projects/649e2284a7e64c089333ff371793ea6a/users/5642eb912ebe4953a39cfeb5f3d0106b/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:06.166303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 935/1882] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:06.172717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc0cc1-8d78-4fa2-a1b7-2f8418f3146f admin admin] RBAC: Authorizing `identity:create_grant(project_id=649e2284a7e64c089333ff371793ea6a, user_id=5642eb912ebe4953a39cfeb5f3d0106b, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:06.175456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc0cc1-8d78-4fa2-a1b7-2f8418f3146f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:06.178178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30fcaf-c4e8-4350-be80-af8ae9cfa2f1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:06.179577 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1b30fcaf-c4e8-4350-be80-af8ae9cfa2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:06.194642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 948/1883] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:05 2022] PUT /identity/v3/projects/649e2284a7e64c089333ff371793ea6a/users/5642eb912ebe4953a39cfeb5f3d0106b/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:06.205164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a462-7371-45f3-8927-444efcc3ab9e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:06.205668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a462-7371-45f3-8927-444efcc3ab9e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:06.205998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a462-7371-45f3-8927-444efcc3ab9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:06.243056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:06.258287 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2f41a462-7371-45f3-8927-444efcc3ab9e None None] MFA Rules not processed for user `5642eb912ebe4953a39cfeb5f3d0106b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:06.260822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2f41a462-7371-45f3-8927-444efcc3ab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:06.266645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30fcaf-c4e8-4350-be80-af8ae9cfa2f1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:06.325496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958af1c-d134-4966-a336-ff8e235b8819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:06.326458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958af1c-d134-4966-a336-ff8e235b8819 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:06.326794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958af1c-d134-4966-a336-ff8e235b8819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:06.327251 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958af1c-d134-4966-a336-ff8e235b8819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:06.336792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 949/1884] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:06.348357 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a462-7371-45f3-8927-444efcc3ab9e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:06.349746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2f41a462-7371-45f3-8927-444efcc3ab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:06.361813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a462-7371-45f3-8927-444efcc3ab9e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:06.365481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecebfb-3b79-4cea-b5d4-e24f1eb0c180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:06.366112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecebfb-3b79-4cea-b5d4-e24f1eb0c180 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:06.366372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecebfb-3b79-4cea-b5d4-e24f1eb0c180 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:06.366647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecebfb-3b79-4cea-b5d4-e24f1eb0c180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:06.378371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecebfb-3b79-4cea-b5d4-e24f1eb0c180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:06.379984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecebfb-3b79-4cea-b5d4-e24f1eb0c180 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:06.390726 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 950/1885] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:13:06.401902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958af1c-d134-4966-a336-ff8e235b8819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:06.404135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958af1c-d134-4966-a336-ff8e235b8819 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:06.412072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecebfb-3b79-4cea-b5d4-e24f1eb0c180 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:06.419396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 936/1886] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:06.498735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecebfb-3b79-4cea-b5d4-e24f1eb0c180 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:06.503800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:06.504936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:06.505285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:06.505555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] PATH_INFO: `/v3/users/5642eb912ebe4953a39cfeb5f3d0106b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:06.507284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5642eb912ebe4953a39cfeb5f3d0106b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:06.509629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:06.574596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:06.577863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5642eb912ebe4953a39cfeb5f3d0106b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:06.579082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5642eb912ebe4953a39cfeb5f3d0106b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:06.599564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5642eb912ebe4953a39cfeb5f3d0106b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:06.610092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5642eb912ebe4953a39cfeb5f3d0106b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:06.610914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5642eb912ebe4953a39cfeb5f3d0106b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:06.638916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 951/1887] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:06 2022] DELETE /identity/v3/users/5642eb912ebe4953a39cfeb5f3d0106b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:06.646440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619722c-2330-4c28-8947-a257fe83aa86 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:06.646720 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619722c-2330-4c28-8947-a257fe83aa86 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:06.647160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619722c-2330-4c28-8947-a257fe83aa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:06.685458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0619722c-2330-4c28-8947-a257fe83aa86 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:06.693180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0619722c-2330-4c28-8947-a257fe83aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:06.797161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 937/1888] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:06.810688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:06.812211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:06.931324 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd3ce6-aec2-4d97-9462-2b6ba80791e1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:06.944782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4ec2b-72bd-4bdb-986f-7184d1efaa00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:06.945420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4ec2b-72bd-4bdb-986f-7184d1efaa00 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:06.945694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4ec2b-72bd-4bdb-986f-7184d1efaa00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:06.945966 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4ec2b-72bd-4bdb-986f-7184d1efaa00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:06.964623 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4ec2b-72bd-4bdb-986f-7184d1efaa00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:06.966180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4ec2b-72bd-4bdb-986f-7184d1efaa00 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:06.978514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 952/1889] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:07.151287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619722c-2330-4c28-8947-a257fe83aa86 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:07.154295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0619722c-2330-4c28-8947-a257fe83aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:07.170908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619722c-2330-4c28-8947-a257fe83aa86 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:07.179545 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64c954-ff90-4927-9cad-2df1d909f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:07.180638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64c954-ff90-4927-9cad-2df1d909f971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:07.181045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64c954-ff90-4927-9cad-2df1d909f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:07.181397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64c954-ff90-4927-9cad-2df1d909f971 admin admin] PATH_INFO: `/v3/users/660f213763404787a6200ff242739163` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:07.182748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64c954-ff90-4927-9cad-2df1d909f971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=660f213763404787a6200ff242739163)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:07.185072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64c954-ff90-4927-9cad-2df1d909f971 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:07.192563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4ec2b-72bd-4bdb-986f-7184d1efaa00 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:07.194613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-22b4ec2b-72bd-4bdb-986f-7184d1efaa00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:07.221970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4ec2b-72bd-4bdb-986f-7184d1efaa00 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:07.234679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebea0f5-e370-4347-8ce7-dd3b2726cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:07.234679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebea0f5-e370-4347-8ce7-dd3b2726cd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:07.235004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebea0f5-e370-4347-8ce7-dd3b2726cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:07.235178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebea0f5-e370-4347-8ce7-dd3b2726cd64 admin admin] PATH_INFO: `/v3/users/9fa28f78278a441d853378461b03fbf9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:07.237043 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebea0f5-e370-4347-8ce7-dd3b2726cd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa28f78278a441d853378461b03fbf9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:07.242405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebea0f5-e370-4347-8ce7-dd3b2726cd64 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:07.287812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:07.311307 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6a64c954-ff90-4927-9cad-2df1d909f971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '660f213763404787a6200ff242739163'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.316713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6a64c954-ff90-4927-9cad-2df1d909f971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '660f213763404787a6200ff242739163'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.330142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6a64c954-ff90-4927-9cad-2df1d909f971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '660f213763404787a6200ff242739163'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.333611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6a64c954-ff90-4927-9cad-2df1d909f971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '660f213763404787a6200ff242739163'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.358496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6a64c954-ff90-4927-9cad-2df1d909f971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '660f213763404787a6200ff242739163'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.368732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9ebea0f5-e370-4347-8ce7-dd3b2726cd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa28f78278a441d853378461b03fbf9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.369635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9ebea0f5-e370-4347-8ce7-dd3b2726cd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa28f78278a441d853378461b03fbf9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.381019 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9ebea0f5-e370-4347-8ce7-dd3b2726cd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa28f78278a441d853378461b03fbf9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.388751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 938/1890] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:07 2022] DELETE /identity/v3/users/660f213763404787a6200ff242739163 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:07.393002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9ebea0f5-e370-4347-8ce7-dd3b2726cd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa28f78278a441d853378461b03fbf9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.393364 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5b986-c773-4253-8fbe-b6dfacefa9bb None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:07.393979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5b986-c773-4253-8fbe-b6dfacefa9bb None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:07.394084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9ebea0f5-e370-4347-8ce7-dd3b2726cd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa28f78278a441d853378461b03fbf9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.394714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5b986-c773-4253-8fbe-b6dfacefa9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:07.424345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 953/1891] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:07 2022] DELETE /identity/v3/users/9fa28f78278a441d853378461b03fbf9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:07.429111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231e0f7-e987-4fa3-8e12-f2dcb58d83f9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:07.429400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231e0f7-e987-4fa3-8e12-f2dcb58d83f9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:07.432579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231e0f7-e987-4fa3-8e12-f2dcb58d83f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:07.437521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-19e5b986-c773-4253-8fbe-b6dfacefa9bb None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:07.439314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-19e5b986-c773-4253-8fbe-b6dfacefa9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:07.474768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4231e0f7-e987-4fa3-8e12-f2dcb58d83f9 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:07.476093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4231e0f7-e987-4fa3-8e12-f2dcb58d83f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:07.567493 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:07.598147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 939/1892] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:07.599329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5b986-c773-4253-8fbe-b6dfacefa9bb None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:07.600767 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-19e5b986-c773-4253-8fbe-b6dfacefa9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:07.613597 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5b986-c773-4253-8fbe-b6dfacefa9bb None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:07.619002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:07.619678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:07.619929 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:07.620203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] PATH_INFO: `/v3/projects/649e2284a7e64c089333ff371793ea6a` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:07.621457 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=649e2284a7e64c089333ff371793ea6a)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:07.623543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 954/1893] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:07.623661 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:07.624718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231e0f7-e987-4fa3-8e12-f2dcb58d83f9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:07.626783 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4231e0f7-e987-4fa3-8e12-f2dcb58d83f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:07.677807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649e2284a7e64c089333ff371793ea6a', 'request_id': 'req-c14f2c0b-0791-47b0-8840-95e89259cf6c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.685688 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649e2284a7e64c089333ff371793ea6a', 'request_id': 'req-c14f2c0b-0791-47b0-8840-95e89259cf6c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.697629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649e2284a7e64c089333ff371793ea6a', 'request_id': 'req-c14f2c0b-0791-47b0-8840-95e89259cf6c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.698107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231e0f7-e987-4fa3-8e12-f2dcb58d83f9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:07.711549 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] The token cache is being invalidate because project 649e2284a7e64c089333ff371793ea6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:07.711864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.712616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:07.718828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 940/1894] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:07 2022] DELETE /identity/v3/projects/649e2284a7e64c089333ff371793ea6a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:07.718828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:07.720410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:07.762738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba0bae-f7a5-4489-a2d4-bfcf031fbeac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:07.763366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba0bae-f7a5-4489-a2d4-bfcf031fbeac service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:07.763641 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba0bae-f7a5-4489-a2d4-bfcf031fbeac service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:07.763917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba0bae-f7a5-4489-a2d4-bfcf031fbeac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:07.766696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-84ba0bae-f7a5-4489-a2d4-bfcf031fbeac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:07.767581 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:07.786048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f2c0b-0791-47b0-8840-95e89259cf6c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:07.791701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcf8ee-8c56-4310-8fed-4f5416c51095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:07.792104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcf8ee-8c56-4310-8fed-4f5416c51095 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:07.792425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcf8ee-8c56-4310-8fed-4f5416c51095 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:07.792709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcf8ee-8c56-4310-8fed-4f5416c51095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:07.794524 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cafcf8ee-8c56-4310-8fed-4f5416c51095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:07.839675 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba0bae-f7a5-4489-a2d4-bfcf031fbeac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:07.841202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba0bae-f7a5-4489-a2d4-bfcf031fbeac service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:07.851665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 955/1895] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:07.853160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd7ed7-1371-440a-9a65-40028b7d8172 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:07.853445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd7ed7-1371-440a-9a65-40028b7d8172 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:07.853846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd7ed7-1371-440a-9a65-40028b7d8172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:07.861165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcf8ee-8c56-4310-8fed-4f5416c51095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:07.863380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcf8ee-8c56-4310-8fed-4f5416c51095 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:07.873590 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e2fd7ed7-1371-440a-9a65-40028b7d8172 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:07.874904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e2fd7ed7-1371-440a-9a65-40028b7d8172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:07.875609 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 941/1896] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:07.883314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 956/1897] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:07.891031 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cfdb1-af9f-48c9-81b1-439649c9603e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:07.891314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cfdb1-af9f-48c9-81b1-439649c9603e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:07.891590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cfdb1-af9f-48c9-81b1-439649c9603e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:07.912750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-355cfdb1-af9f-48c9-81b1-439649c9603e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:07.913952 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-355cfdb1-af9f-48c9-81b1-439649c9603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:07.923321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 942/1898] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:07.927192 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd7ed7-1371-440a-9a65-40028b7d8172 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:07.940955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd7ed7-1371-440a-9a65-40028b7d8172 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:07.947080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8246306-f64c-4718-9801-9987286c0624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:07.947757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8246306-f64c-4718-9801-9987286c0624 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:07.948154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8246306-f64c-4718-9801-9987286c0624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:07.948540 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8246306-f64c-4718-9801-9987286c0624 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:07.949318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8246306-f64c-4718-9801-9987286c0624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:07.950114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8246306-f64c-4718-9801-9987286c0624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:07.951835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8246306-f64c-4718-9801-9987286c0624 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:07.966757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 957/1899] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:07.970064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cfdb1-af9f-48c9-81b1-439649c9603e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:07.980163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cfdb1-af9f-48c9-81b1-439649c9603e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:07.986388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12d10a-8c45-4f9e-9566-1a524802c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:07.987348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12d10a-8c45-4f9e-9566-1a524802c9bb admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:07.987656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12d10a-8c45-4f9e-9566-1a524802c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:07.988117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12d10a-8c45-4f9e-9566-1a524802c9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:07.988823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12d10a-8c45-4f9e-9566-1a524802c9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:07.995177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12d10a-8c45-4f9e-9566-1a524802c9bb admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:08.035332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 943/1900] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:07 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:08.040042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8246306-f64c-4718-9801-9987286c0624 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:08.053495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8246306-f64c-4718-9801-9987286c0624 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:08.079243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:08.163349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1e8ce-3ca4-43d3-b524-2dae160d5e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:08.164126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1e8ce-3ca4-43d3-b524-2dae160d5e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:08.164375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1e8ce-3ca4-43d3-b524-2dae160d5e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:08.164712 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1e8ce-3ca4-43d3-b524-2dae160d5e7a admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:08.165425 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1e8ce-3ca4-43d3-b524-2dae160d5e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:08.168417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1e8ce-3ca4-43d3-b524-2dae160d5e7a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:08.202323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 958/1901] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:08 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:08.206823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12d10a-8c45-4f9e-9566-1a524802c9bb admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:08.223271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12d10a-8c45-4f9e-9566-1a524802c9bb admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:08.228603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc399ff4-2e18-4b47-aef2-90ba78c760df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:08.229330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc399ff4-2e18-4b47-aef2-90ba78c760df admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:08.229714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc399ff4-2e18-4b47-aef2-90ba78c760df admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:08.230165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc399ff4-2e18-4b47-aef2-90ba78c760df admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:08.231111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc399ff4-2e18-4b47-aef2-90ba78c760df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:08.233362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc399ff4-2e18-4b47-aef2-90ba78c760df admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:08.246514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 944/1902] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:08.250647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1e8ce-3ca4-43d3-b524-2dae160d5e7a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:08.264842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1e8ce-3ca4-43d3-b524-2dae160d5e7a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:08.270082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6ee2b-dc5a-414f-bcdb-4fce52983f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:08.270755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6ee2b-dc5a-414f-bcdb-4fce52983f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:08.271093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6ee2b-dc5a-414f-bcdb-4fce52983f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:08.271367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6ee2b-dc5a-414f-bcdb-4fce52983f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:08.276421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6ee2b-dc5a-414f-bcdb-4fce52983f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:08.278510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6ee2b-dc5a-414f-bcdb-4fce52983f69 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:08.309947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 959/1903] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:08.310460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc399ff4-2e18-4b47-aef2-90ba78c760df admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:08.314121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bc399ff4-2e18-4b47-aef2-90ba78c760df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:08.314474 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6ee2b-dc5a-414f-bcdb-4fce52983f69 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:08.338635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6ee2b-dc5a-414f-bcdb-4fce52983f69 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:08.339223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc399ff4-2e18-4b47-aef2-90ba78c760df admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:08.345883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:08.346616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:08.347157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:08.347792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] PATH_INFO: `/v3/projects/45a3d1d7164344ccb1cbd3645b198281` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:08.349496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a3d1d7164344ccb1cbd3645b198281)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:08.353044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:08.361769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b45847-6505-4af5-89ab-9ac34a8040ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:08.362525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b45847-6505-4af5-89ab-9ac34a8040ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:08.362774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b45847-6505-4af5-89ab-9ac34a8040ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:08.363154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b45847-6505-4af5-89ab-9ac34a8040ac admin admin] PATH_INFO: `/v3/projects/34447188d1e34269bfe0e5fa7d9b9ff8/users/2fca0878126f4f989136915f38485a9a/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:08.396729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b45847-6505-4af5-89ab-9ac34a8040ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=34447188d1e34269bfe0e5fa7d9b9ff8, user_id=2fca0878126f4f989136915f38485a9a, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:08.400885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b45847-6505-4af5-89ab-9ac34a8040ac admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:08.422042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 960/1904] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:08 2022] PUT /identity/v3/projects/34447188d1e34269bfe0e5fa7d9b9ff8/users/2fca0878126f4f989136915f38485a9a/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:08.431848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a3d1d7164344ccb1cbd3645b198281', 'request_id': 'req-850a1fcb-b3f7-4080-9566-ca2fda5a364c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:08.433806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb497b0-2474-4cdd-835e-427c1a7a1f92 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:08.434106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb497b0-2474-4cdd-835e-427c1a7a1f92 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:08.434380 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb497b0-2474-4cdd-835e-427c1a7a1f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:08.440368 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a3d1d7164344ccb1cbd3645b198281', 'request_id': 'req-850a1fcb-b3f7-4080-9566-ca2fda5a364c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:08.451969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a3d1d7164344ccb1cbd3645b198281', 'request_id': 'req-850a1fcb-b3f7-4080-9566-ca2fda5a364c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:08.467527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9cb497b0-2474-4cdd-835e-427c1a7a1f92 None None] MFA Rules not processed for user `2fca0878126f4f989136915f38485a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:08.468669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] The token cache is being invalidate because project 45a3d1d7164344ccb1cbd3645b198281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:08.468840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:08.469329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9cb497b0-2474-4cdd-835e-427c1a7a1f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:08.469523 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:08.472408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 945/1905] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:08 2022] DELETE /identity/v3/projects/45a3d1d7164344ccb1cbd3645b198281 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:08.475359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:08.478021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:08.525415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:08.571334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a1fcb-b3f7-4080-9566-ca2fda5a364c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:08.576239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 961/1906] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:08.576488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:08.577204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:08.577492 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:08.577915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] PATH_INFO: `/v3/users/5c512d90c07b4122840db70ec82a4a1b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:08.579085 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c512d90c07b4122840db70ec82a4a1b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:08.584003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:08.587682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb497b0-2474-4cdd-835e-427c1a7a1f92 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:08.589956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9cb497b0-2474-4cdd-835e-427c1a7a1f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:08.647355 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c512d90c07b4122840db70ec82a4a1b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:08.648058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c512d90c07b4122840db70ec82a4a1b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:08.655855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c512d90c07b4122840db70ec82a4a1b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:08.656750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c512d90c07b4122840db70ec82a4a1b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:08.669423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c512d90c07b4122840db70ec82a4a1b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:08.686456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 946/1907] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:08 2022] DELETE /identity/v3/users/5c512d90c07b4122840db70ec82a4a1b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:08.705718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:08.711833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb497b0-2474-4cdd-835e-427c1a7a1f92 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:08.812389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0192956-12c1-4b25-9950-1ced9ee4ed4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31ebbadd69da4bc6ad25b5c882962ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:08.813559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0192956-12c1-4b25-9950-1ced9ee4ed4c service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:08.815139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0192956-12c1-4b25-9950-1ced9ee4ed4c service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:08.815778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0192956-12c1-4b25-9950-1ced9ee4ed4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:08.817960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e0192956-12c1-4b25-9950-1ced9ee4ed4c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:08.909401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0192956-12c1-4b25-9950-1ced9ee4ed4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:08.911713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0192956-12c1-4b25-9950-1ced9ee4ed4c service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:08.924553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 962/1908] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:13:09.040227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:09.042081 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:09.090818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0192956-12c1-4b25-9950-1ced9ee4ed4c service glance] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:09.093499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e0192956-12c1-4b25-9950-1ced9ee4ed4c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:09.183322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0192956-12c1-4b25-9950-1ced9ee4ed4c service glance] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:09.185138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106b633-6835-41d4-a065-1d82d7e22a85 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:09.189913 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8404f9-683b-45c6-b5c2-d2c4b354b120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:09.190705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8404f9-683b-45c6-b5c2-d2c4b354b120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:09.190986 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8404f9-683b-45c6-b5c2-d2c4b354b120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:09.191433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8404f9-683b-45c6-b5c2-d2c4b354b120 admin admin] PATH_INFO: `/v3/projects/4fe6dc854fa7475a85e08951ac817bda` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:09.192504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:09.193346 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8404f9-683b-45c6-b5c2-d2c4b354b120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe6dc854fa7475a85e08951ac817bda)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:09.193528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:09.193857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:09.195508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8404f9-683b-45c6-b5c2-d2c4b354b120 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:09.198555 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] PATH_INFO: `/v3/projects/eccb22d7bf31460ea5a67a6e020a11b8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:09.200015 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eccb22d7bf31460ea5a67a6e020a11b8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:09.202316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:09.258951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fc8404f9-683b-45c6-b5c2-d2c4b354b120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe6dc854fa7475a85e08951ac817bda', 'request_id': 'req-fc8404f9-683b-45c6-b5c2-d2c4b354b120'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.266614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fc8404f9-683b-45c6-b5c2-d2c4b354b120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe6dc854fa7475a85e08951ac817bda', 'request_id': 'req-fc8404f9-683b-45c6-b5c2-d2c4b354b120'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.267411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eccb22d7bf31460ea5a67a6e020a11b8', 'request_id': 'req-7350f7ee-e15d-48c8-8630-25eefe4510e4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.269614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:09.271157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:09.277794 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fc8404f9-683b-45c6-b5c2-d2c4b354b120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe6dc854fa7475a85e08951ac817bda', 'request_id': 'req-fc8404f9-683b-45c6-b5c2-d2c4b354b120'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.278422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eccb22d7bf31460ea5a67a6e020a11b8', 'request_id': 'req-7350f7ee-e15d-48c8-8630-25eefe4510e4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.302391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eccb22d7bf31460ea5a67a6e020a11b8', 'request_id': 'req-7350f7ee-e15d-48c8-8630-25eefe4510e4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.305435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fc8404f9-683b-45c6-b5c2-d2c4b354b120 admin admin] The token cache is being invalidate because project 4fe6dc854fa7475a85e08951ac817bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:09.306015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fc8404f9-683b-45c6-b5c2-d2c4b354b120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.306881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fc8404f9-683b-45c6-b5c2-d2c4b354b120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.309016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 963/1909] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:09 2022] DELETE /identity/v3/projects/4fe6dc854fa7475a85e08951ac817bda => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:09.313656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb3592-cbf0-4f6c-917a-030209908484 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:09.314156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb3592-cbf0-4f6c-917a-030209908484 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:09.314604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb3592-cbf0-4f6c-917a-030209908484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:09.327791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] The token cache is being invalidate because project eccb22d7bf31460ea5a67a6e020a11b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:09.328349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.328781 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.331120 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 947/1910] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:09 2022] DELETE /identity/v3/projects/eccb22d7bf31460ea5a67a6e020a11b8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:09.335339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:09.336611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:09.356777 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d2eb3592-cbf0-4f6c-917a-030209908484 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:09.357994 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d2eb3592-cbf0-4f6c-917a-030209908484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:09.427197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350f7ee-e15d-48c8-8630-25eefe4510e4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:09.434991 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:09.435950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:09.436480 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:09.436984 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] PATH_INFO: `/v3/users/8a37cc222e954a4eb9fd3745f203f082` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:09.440427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a37cc222e954a4eb9fd3745f203f082)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:09.443494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:09.466332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 964/1911] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:09.476621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad88c72-6486-426d-963f-5509c2b2af7e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:09.476996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad88c72-6486-426d-963f-5509c2b2af7e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:09.477281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad88c72-6486-426d-963f-5509c2b2af7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:09.511734 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8ad88c72-6486-426d-963f-5509c2b2af7e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:09.513673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8ad88c72-6486-426d-963f-5509c2b2af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:09.528958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 965/1912] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:09.533410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad88c72-6486-426d-963f-5509c2b2af7e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:09.550502 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad88c72-6486-426d-963f-5509c2b2af7e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:09.568893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720faf68-3c80-4b04-a336-f605c374ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:09.570098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720faf68-3c80-4b04-a336-f605c374ce3e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:09.570688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720faf68-3c80-4b04-a336-f605c374ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:09.571209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720faf68-3c80-4b04-a336-f605c374ce3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:09.572365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720faf68-3c80-4b04-a336-f605c374ce3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:09.573174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720faf68-3c80-4b04-a336-f605c374ce3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:09.575708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720faf68-3c80-4b04-a336-f605c374ce3e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:09.580686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a37cc222e954a4eb9fd3745f203f082'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.584550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a37cc222e954a4eb9fd3745f203f082'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.609221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a37cc222e954a4eb9fd3745f203f082'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.610111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a37cc222e954a4eb9fd3745f203f082'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.620355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 966/1913] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:09.624866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720faf68-3c80-4b04-a336-f605c374ce3e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:09.629052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-720faf68-3c80-4b04-a336-f605c374ce3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:09.645475 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a37cc222e954a4eb9fd3745f203f082'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:09.657541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720faf68-3c80-4b04-a336-f605c374ce3e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:09.675405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 948/1914] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:09 2022] DELETE /identity/v3/users/8a37cc222e954a4eb9fd3745f203f082 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:09.676598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454645e-89ee-4e24-ad16-a1181ded9ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:09.677320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454645e-89ee-4e24-ad16-a1181ded9ece admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:09.677595 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454645e-89ee-4e24-ad16-a1181ded9ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:09.677862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454645e-89ee-4e24-ad16-a1181ded9ece admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:09.678581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454645e-89ee-4e24-ad16-a1181ded9ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:09.680602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454645e-89ee-4e24-ad16-a1181ded9ece admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:09.774178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:09.786517 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 967/1915] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:09 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:09.919752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f76912-b0cb-44f6-8f42-6ca3d869d461 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:09.935083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:10.073392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454645e-89ee-4e24-ad16-a1181ded9ece admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:10.075338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a454645e-89ee-4e24-ad16-a1181ded9ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:10.084202 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170860c-7b5a-4cdf-87db-9ca36be876b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:10.084872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170860c-7b5a-4cdf-87db-9ca36be876b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.085810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170860c-7b5a-4cdf-87db-9ca36be876b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.086102 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170860c-7b5a-4cdf-87db-9ca36be876b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.086944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170860c-7b5a-4cdf-87db-9ca36be876b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:10.089839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170860c-7b5a-4cdf-87db-9ca36be876b7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:10.151570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 949/1916] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:09 2022] POST /identity/v3/users => generated 283 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:10.153267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170860c-7b5a-4cdf-87db-9ca36be876b7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:10.155265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f170860c-7b5a-4cdf-87db-9ca36be876b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:10.170138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170860c-7b5a-4cdf-87db-9ca36be876b7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:10.177633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72ef85-2563-46f3-94b0-51df6719dfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:10.179011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72ef85-2563-46f3-94b0-51df6719dfa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.179370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72ef85-2563-46f3-94b0-51df6719dfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.179535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72ef85-2563-46f3-94b0-51df6719dfa1 admin admin] PATH_INFO: `/v3/users/160ed5c4fd2544109f0b59fc77b9ce46` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.181112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72ef85-2563-46f3-94b0-51df6719dfa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=160ed5c4fd2544109f0b59fc77b9ce46)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:10.183031 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72ef85-2563-46f3-94b0-51df6719dfa1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:10.204486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454645e-89ee-4e24-ad16-a1181ded9ece admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:10.211336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:10.212058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.212498 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.212781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] PATH_INFO: `/v3/projects/31307ed224304806a1154cc0ccdc87c1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.214195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=31307ed224304806a1154cc0ccdc87c1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:10.216842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:10.275556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb72ef85-2563-46f3-94b0-51df6719dfa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160ed5c4fd2544109f0b59fc77b9ce46'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:10.276499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb72ef85-2563-46f3-94b0-51df6719dfa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160ed5c4fd2544109f0b59fc77b9ce46'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:10.289503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb72ef85-2563-46f3-94b0-51df6719dfa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160ed5c4fd2544109f0b59fc77b9ce46'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:10.290949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb72ef85-2563-46f3-94b0-51df6719dfa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160ed5c4fd2544109f0b59fc77b9ce46'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:10.300967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31307ed224304806a1154cc0ccdc87c1', 'request_id': 'req-c5f86b78-6830-4843-aa91-16678d8ff9ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:10.302693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:10.311311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31307ed224304806a1154cc0ccdc87c1', 'request_id': 'req-c5f86b78-6830-4843-aa91-16678d8ff9ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:10.323591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31307ed224304806a1154cc0ccdc87c1', 'request_id': 'req-c5f86b78-6830-4843-aa91-16678d8ff9ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:10.341298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb72ef85-2563-46f3-94b0-51df6719dfa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160ed5c4fd2544109f0b59fc77b9ce46'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:10.342936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] The token cache is being invalidate because project 31307ed224304806a1154cc0ccdc87c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:10.343267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:10.344126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:10.346576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 968/1917] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:10 2022] DELETE /identity/v3/projects/31307ed224304806a1154cc0ccdc87c1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:10.347456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:10.349578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:10.368982 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 950/1918] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:10 2022] DELETE /identity/v3/users/160ed5c4fd2544109f0b59fc77b9ce46 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:10.370927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8388855-b4b4-4568-be9b-f66338e06a7c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.370927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8388855-b4b4-4568-be9b-f66338e06a7c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.371273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8388855-b4b4-4568-be9b-f66338e06a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.401130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f8388855-b4b4-4568-be9b-f66338e06a7c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:10.402874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f8388855-b4b4-4568-be9b-f66338e06a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:10.467555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f86b78-6830-4843-aa91-16678d8ff9ff admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:10.494069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 951/1919] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:10.494069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501a87c-7aee-4719-90e0-7be8af09f9e6 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.494069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501a87c-7aee-4719-90e0-7be8af09f9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.494069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501a87c-7aee-4719-90e0-7be8af09f9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.511021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e501a87c-7aee-4719-90e0-7be8af09f9e6 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:10.512714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e501a87c-7aee-4719-90e0-7be8af09f9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:10.521801 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 952/1920] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:10.523122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce17d6-a593-4b9a-a325-95c814436a43 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.523819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce17d6-a593-4b9a-a325-95c814436a43 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.524225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce17d6-a593-4b9a-a325-95c814436a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.537378 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:10.554896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-24ce17d6-a593-4b9a-a325-95c814436a43 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:10.556892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-24ce17d6-a593-4b9a-a325-95c814436a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:10.572159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 953/1921] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:10.576200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce17d6-a593-4b9a-a325-95c814436a43 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:10.577825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-24ce17d6-a593-4b9a-a325-95c814436a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:10.578940 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbd79d-4e51-47bc-8f7b-8bc3f7afbbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:10.580747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd79d-4e51-47bc-8f7b-8bc3f7afbbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.581261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd79d-4e51-47bc-8f7b-8bc3f7afbbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.581739 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd79d-4e51-47bc-8f7b-8bc3f7afbbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.582644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbd79d-4e51-47bc-8f7b-8bc3f7afbbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:10.585062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbd79d-4e51-47bc-8f7b-8bc3f7afbbb3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:10.603711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 969/1922] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:10.605036 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbd79d-4e51-47bc-8f7b-8bc3f7afbbb3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:10.626946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbd79d-4e51-47bc-8f7b-8bc3f7afbbb3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:10.634686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763df1c-20b9-4e49-ac33-53a3255f5aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:10.635576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763df1c-20b9-4e49-ac33-53a3255f5aac admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.635993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763df1c-20b9-4e49-ac33-53a3255f5aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.636242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763df1c-20b9-4e49-ac33-53a3255f5aac admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.636982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763df1c-20b9-4e49-ac33-53a3255f5aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:10.637362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763df1c-20b9-4e49-ac33-53a3255f5aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:10.640507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763df1c-20b9-4e49-ac33-53a3255f5aac admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:10.646091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce17d6-a593-4b9a-a325-95c814436a43 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:10.662839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6b12b-ba65-4ef6-888d-04d0f597f30a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:10.663491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6b12b-ba65-4ef6-888d-04d0f597f30a service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.663770 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6b12b-ba65-4ef6-888d-04d0f597f30a service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.664040 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6b12b-ba65-4ef6-888d-04d0f597f30a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.674646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 970/1923] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:10.677125 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763df1c-20b9-4e49-ac33-53a3255f5aac admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:10.681722 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6b12b-ba65-4ef6-888d-04d0f597f30a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:10.684447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6b12b-ba65-4ef6-888d-04d0f597f30a service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:10.708240 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 954/1924] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:10.709051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6b12b-ba65-4ef6-888d-04d0f597f30a service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:10.723447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763df1c-20b9-4e49-ac33-53a3255f5aac admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:10.724736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6b12b-ba65-4ef6-888d-04d0f597f30a service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:10.754669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3500b1-d835-4d3d-81b4-dd0378093721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:10.755594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3500b1-d835-4d3d-81b4-dd0378093721 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.755876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3500b1-d835-4d3d-81b4-dd0378093721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.756202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3500b1-d835-4d3d-81b4-dd0378093721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.756886 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3500b1-d835-4d3d-81b4-dd0378093721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:10.759826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3500b1-d835-4d3d-81b4-dd0378093721 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:10.766070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64871f62-a9e8-4b81-bcff-4ed91e5f925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:10.766854 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64871f62-a9e8-4b81-bcff-4ed91e5f925e admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.767075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64871f62-a9e8-4b81-bcff-4ed91e5f925e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.767303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64871f62-a9e8-4b81-bcff-4ed91e5f925e admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.768004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64871f62-a9e8-4b81-bcff-4ed91e5f925e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:10.772734 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64871f62-a9e8-4b81-bcff-4ed91e5f925e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:10.805503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 971/1925] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:10.806424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3500b1-d835-4d3d-81b4-dd0378093721 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:10.821650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3500b1-d835-4d3d-81b4-dd0378093721 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:10.828323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 955/1926] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:10 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:10.829001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccccbe-b810-4cc1-ada7-2f4abbe45758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:10.829823 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccccbe-b810-4cc1-ada7-2f4abbe45758 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.830516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccccbe-b810-4cc1-ada7-2f4abbe45758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.830791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccccbe-b810-4cc1-ada7-2f4abbe45758 admin admin] PATH_INFO: `/v3/projects/7805b09da04f4690916df3e4a1afc260/users/474a39e78d974fedbb7669fff0566a7b/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.833470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64871f62-a9e8-4b81-bcff-4ed91e5f925e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:10.850213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccccbe-b810-4cc1-ada7-2f4abbe45758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7805b09da04f4690916df3e4a1afc260, user_id=474a39e78d974fedbb7669fff0566a7b, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:10.853061 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccccbe-b810-4cc1-ada7-2f4abbe45758 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:10.871198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 972/1927] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:10 2022] PUT /identity/v3/projects/7805b09da04f4690916df3e4a1afc260/users/474a39e78d974fedbb7669fff0566a7b/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:10.881957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c833ea-5d58-444a-ac5e-7fd9936cdde1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:10.882246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c833ea-5d58-444a-ac5e-7fd9936cdde1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:10.882525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c833ea-5d58-444a-ac5e-7fd9936cdde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:10.918296 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f8c833ea-5d58-444a-ac5e-7fd9936cdde1 None None] MFA Rules not processed for user `474a39e78d974fedbb7669fff0566a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:10.919613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f8c833ea-5d58-444a-ac5e-7fd9936cdde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:10.933253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64871f62-a9e8-4b81-bcff-4ed91e5f925e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:10.957667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:11.010203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb90e9b-9899-426c-b92f-c60461db13d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:11.011423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb90e9b-9899-426c-b92f-c60461db13d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:11.012382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb90e9b-9899-426c-b92f-c60461db13d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:11.012732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb90e9b-9899-426c-b92f-c60461db13d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:11.013389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb90e9b-9899-426c-b92f-c60461db13d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:11.015539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb90e9b-9899-426c-b92f-c60461db13d7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:11.019002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 973/1928] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:11.021378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c833ea-5d58-444a-ac5e-7fd9936cdde1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:11.035513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c833ea-5d58-444a-ac5e-7fd9936cdde1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:11.042255 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a290f4e-55b1-46cc-b599-a9c1837a492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:11.043159 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a290f4e-55b1-46cc-b599-a9c1837a492d admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:11.043605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a290f4e-55b1-46cc-b599-a9c1837a492d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:11.044060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a290f4e-55b1-46cc-b599-a9c1837a492d admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:11.044970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a290f4e-55b1-46cc-b599-a9c1837a492d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:11.048154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a290f4e-55b1-46cc-b599-a9c1837a492d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:11.062141 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 956/1929] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:10 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:11.067280 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb90e9b-9899-426c-b92f-c60461db13d7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:11.081684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb90e9b-9899-426c-b92f-c60461db13d7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:11.087005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d8ec4-39ee-47ef-860e-e88ebb0d3b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:11.087676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d8ec4-39ee-47ef-860e-e88ebb0d3b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:11.088030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d8ec4-39ee-47ef-860e-e88ebb0d3b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:11.088378 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d8ec4-39ee-47ef-860e-e88ebb0d3b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:11.091923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d8ec4-39ee-47ef-860e-e88ebb0d3b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:11.093946 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d8ec4-39ee-47ef-860e-e88ebb0d3b1b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:11.097564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 974/1930] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:11 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:11.098841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a290f4e-55b1-46cc-b599-a9c1837a492d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:11.102676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9a290f4e-55b1-46cc-b599-a9c1837a492d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:11.111234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 957/1931] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:11.112173 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d8ec4-39ee-47ef-860e-e88ebb0d3b1b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:11.118299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:11.125103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d8ec4-39ee-47ef-860e-e88ebb0d3b1b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:11.192023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a290f4e-55b1-46cc-b599-a9c1837a492d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:11.196750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:11.197397 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:11.197670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:11.197939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] PATH_INFO: `/v3/projects/cc8347ab95a64016a06ed6300ec35888` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:11.199213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8347ab95a64016a06ed6300ec35888)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:11.201399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:11.204168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05414844-b485-4889-a816-78a481e86383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:11.204879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05414844-b485-4889-a816-78a481e86383 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:11.205222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05414844-b485-4889-a816-78a481e86383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:11.205557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05414844-b485-4889-a816-78a481e86383 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:11.206258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05414844-b485-4889-a816-78a481e86383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:11.208458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05414844-b485-4889-a816-78a481e86383 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:11.243601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 958/1932] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:11 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:11.243601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05414844-b485-4889-a816-78a481e86383 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:11.254034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05414844-b485-4889-a816-78a481e86383 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:11.272941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8347ab95a64016a06ed6300ec35888', 'request_id': 'req-a0e9c405-af4e-48b2-b70f-234dd98327dd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:11.279615 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8347ab95a64016a06ed6300ec35888', 'request_id': 'req-a0e9c405-af4e-48b2-b70f-234dd98327dd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:11.288160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8347ab95a64016a06ed6300ec35888', 'request_id': 'req-a0e9c405-af4e-48b2-b70f-234dd98327dd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:11.318838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] The token cache is being invalidate because project cc8347ab95a64016a06ed6300ec35888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:11.319620 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:11.320379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:11.322459 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 975/1933] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:11 2022] DELETE /identity/v3/projects/cc8347ab95a64016a06ed6300ec35888 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:11.323651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:11.326389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:11.368463 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84140c73-d4db-4082-a4f2-a0ea4aa933b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:11.369454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84140c73-d4db-4082-a4f2-a0ea4aa933b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:11.369923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84140c73-d4db-4082-a4f2-a0ea4aa933b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:11.370395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84140c73-d4db-4082-a4f2-a0ea4aa933b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:11.371293 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84140c73-d4db-4082-a4f2-a0ea4aa933b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:11.374567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84140c73-d4db-4082-a4f2-a0ea4aa933b5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:11.394099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:11.426188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 959/1934] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:11.427266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84140c73-d4db-4082-a4f2-a0ea4aa933b5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:11.430751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-84140c73-d4db-4082-a4f2-a0ea4aa933b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:11.459827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9c405-af4e-48b2-b70f-234dd98327dd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:11.478328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84140c73-d4db-4082-a4f2-a0ea4aa933b5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:11.490848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7102d3-3f15-4e7e-99ce-10132f1c5483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:11.491655 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7102d3-3f15-4e7e-99ce-10132f1c5483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:11.491935 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3770942-941c-4d79-9cc1-b4432b42fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:11.492105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7102d3-3f15-4e7e-99ce-10132f1c5483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:11.492663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7102d3-3f15-4e7e-99ce-10132f1c5483 admin admin] PATH_INFO: `/v3/users/2fd3f58b848d4830b5f4507557cfd059` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:11.492801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3770942-941c-4d79-9cc1-b4432b42fc73 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:11.493180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3770942-941c-4d79-9cc1-b4432b42fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:11.493512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3770942-941c-4d79-9cc1-b4432b42fc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:11.494145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7102d3-3f15-4e7e-99ce-10132f1c5483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd3f58b848d4830b5f4507557cfd059)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:11.494251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3770942-941c-4d79-9cc1-b4432b42fc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:11.499339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3770942-941c-4d79-9cc1-b4432b42fc73 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:11.499564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7102d3-3f15-4e7e-99ce-10132f1c5483 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:11.508669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 976/1935] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:11.509996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3770942-941c-4d79-9cc1-b4432b42fc73 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:11.511752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b3770942-941c-4d79-9cc1-b4432b42fc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:11.526818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3770942-941c-4d79-9cc1-b4432b42fc73 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:11.533119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e0920-9173-474e-b4cc-cc7f1b78bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:11.533861 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e0920-9173-474e-b4cc-cc7f1b78bb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:11.534175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e0920-9173-474e-b4cc-cc7f1b78bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:11.534498 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e0920-9173-474e-b4cc-cc7f1b78bb03 admin admin] PATH_INFO: `/v3/projects/269eb417c633446cb6fe83b151f4a3ca/users/d772cc9adc6f4d13a81a5cd475a7bd92/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:11.555615 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e0920-9173-474e-b4cc-cc7f1b78bb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=269eb417c633446cb6fe83b151f4a3ca, user_id=d772cc9adc6f4d13a81a5cd475a7bd92, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:11.560587 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e0920-9173-474e-b4cc-cc7f1b78bb03 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:11.572316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aa7102d3-3f15-4e7e-99ce-10132f1c5483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd3f58b848d4830b5f4507557cfd059'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:11.573210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aa7102d3-3f15-4e7e-99ce-10132f1c5483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd3f58b848d4830b5f4507557cfd059'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:11.588423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 977/1936] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:11 2022] PUT /identity/v3/projects/269eb417c633446cb6fe83b151f4a3ca/users/d772cc9adc6f4d13a81a5cd475a7bd92/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:11.588423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e0920-9173-474e-b4cc-cc7f1b78bb03 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:11.590640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fd4e0920-9173-474e-b4cc-cc7f1b78bb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:11.606324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aa7102d3-3f15-4e7e-99ce-10132f1c5483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd3f58b848d4830b5f4507557cfd059'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:11.607815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aa7102d3-3f15-4e7e-99ce-10132f1c5483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd3f58b848d4830b5f4507557cfd059'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:11.630403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aa7102d3-3f15-4e7e-99ce-10132f1c5483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd3f58b848d4830b5f4507557cfd059'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:11.643923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:11.650648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 960/1937] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:11 2022] DELETE /identity/v3/users/2fd3f58b848d4830b5f4507557cfd059 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:11.652959 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffffb3-976e-4b1f-9afd-61f7103bb238 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:11.654347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffffb3-976e-4b1f-9afd-61f7103bb238 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:11.654781 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffffb3-976e-4b1f-9afd-61f7103bb238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:11.683474 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e0920-9173-474e-b4cc-cc7f1b78bb03 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:11.695741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3fffffb3-976e-4b1f-9afd-61f7103bb238 None None] MFA Rules not processed for user `d772cc9adc6f4d13a81a5cd475a7bd92`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:11.697257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3fffffb3-976e-4b1f-9afd-61f7103bb238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:11.782015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c49d5-8981-4c72-b4fb-82b4e9b5d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:11.784632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c49d5-8981-4c72-b4fb-82b4e9b5d62b admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:11.786850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c49d5-8981-4c72-b4fb-82b4e9b5d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:11.787688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c49d5-8981-4c72-b4fb-82b4e9b5d62b admin admin] PATH_INFO: `/v3/projects/5e0c2089c5354a8086a3f675c7b0726f/users/6c948b28be4b4733ab5d601e046a1d29/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:11.826086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 961/1938] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:11.830790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffffb3-976e-4b1f-9afd-61f7103bb238 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:11.833102 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3fffffb3-976e-4b1f-9afd-61f7103bb238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:11.833796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c49d5-8981-4c72-b4fb-82b4e9b5d62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0c2089c5354a8086a3f675c7b0726f, user_id=6c948b28be4b4733ab5d601e046a1d29, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:11.836587 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c49d5-8981-4c72-b4fb-82b4e9b5d62b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:11.868393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffffb3-976e-4b1f-9afd-61f7103bb238 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:11.871316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 978/1939] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:11 2022] PUT /identity/v3/projects/5e0c2089c5354a8086a3f675c7b0726f/users/6c948b28be4b4733ab5d601e046a1d29/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:11.875343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c49d5-8981-4c72-b4fb-82b4e9b5d62b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:11.975137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:11.999888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2c7f4-2db8-411f-8668-062c76b31925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.001205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2c7f4-2db8-411f-8668-062c76b31925 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.003703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2c7f4-2db8-411f-8668-062c76b31925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.004303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2c7f4-2db8-411f-8668-062c76b31925 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.005293 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2c7f4-2db8-411f-8668-062c76b31925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:12.014955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2c7f4-2db8-411f-8668-062c76b31925 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:12.032136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c49d5-8981-4c72-b4fb-82b4e9b5d62b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:12.039902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8772-0917-431a-83ae-66d62a460a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.046941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8772-0917-431a-83ae-66d62a460a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.047229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8772-0917-431a-83ae-66d62a460a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.047497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8772-0917-431a-83ae-66d62a460a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.048179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c8772-0917-431a-83ae-66d62a460a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:12.050155 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c8772-0917-431a-83ae-66d62a460a0a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:12.062414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 979/1940] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:12.066464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 962/1941] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:11 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:12.066817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8772-0917-431a-83ae-66d62a460a0a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:12.070334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2c7f4-2db8-411f-8668-062c76b31925 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:12.082846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8772-0917-431a-83ae-66d62a460a0a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:12.178020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2c7f4-2db8-411f-8668-062c76b31925 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:12.184214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4d17a-03c7-46d2-8c46-dc2c33193dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.185003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4d17a-03c7-46d2-8c46-dc2c33193dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.185284 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4d17a-03c7-46d2-8c46-dc2c33193dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.185442 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77bf19-635e-44fe-abab-f07a33b577e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.185625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4d17a-03c7-46d2-8c46-dc2c33193dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.186433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77bf19-635e-44fe-abab-f07a33b577e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.186720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77bf19-635e-44fe-abab-f07a33b577e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.186837 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4d17a-03c7-46d2-8c46-dc2c33193dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:12.186995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77bf19-635e-44fe-abab-f07a33b577e9 admin admin] PATH_INFO: `/v3/projects/5e0c2089c5354a8086a3f675c7b0726f/users/6c948b28be4b4733ab5d601e046a1d29/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.191734 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4d17a-03c7-46d2-8c46-dc2c33193dc1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:12.191955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77bf19-635e-44fe-abab-f07a33b577e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0c2089c5354a8086a3f675c7b0726f, user_id=6c948b28be4b4733ab5d601e046a1d29, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:12.193610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77bf19-635e-44fe-abab-f07a33b577e9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:12.208724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 980/1942] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:12 2022] PUT /identity/v3/projects/5e0c2089c5354a8086a3f675c7b0726f/users/6c948b28be4b4733ab5d601e046a1d29/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:12.209760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77bf19-635e-44fe-abab-f07a33b577e9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:12.217710 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3e77bf19-635e-44fe-abab-f07a33b577e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:12.225957 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 963/1943] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:12 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:12.227373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f64fc7-2829-4a04-9aaa-6ff35ff4a15e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.227718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f64fc7-2829-4a04-9aaa-6ff35ff4a15e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.228054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f64fc7-2829-4a04-9aaa-6ff35ff4a15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.238676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:12.262553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-30f64fc7-2829-4a04-9aaa-6ff35ff4a15e None None] MFA Rules not processed for user `6c948b28be4b4733ab5d601e046a1d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:12.263932 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-30f64fc7-2829-4a04-9aaa-6ff35ff4a15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:12.309308 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77bf19-635e-44fe-abab-f07a33b577e9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:12.319466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.320480 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.320830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.321174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] PATH_INFO: `/v3/projects/6fffba1def294da8a7e0ec236e91304b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.322816 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fffba1def294da8a7e0ec236e91304b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:12.325597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:12.373201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 964/1944] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:12.374683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f64fc7-2829-4a04-9aaa-6ff35ff4a15e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:12.385239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f64fc7-2829-4a04-9aaa-6ff35ff4a15e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:12.396658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fffba1def294da8a7e0ec236e91304b', 'request_id': 'req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:12.402791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fffba1def294da8a7e0ec236e91304b', 'request_id': 'req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:12.410703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fffba1def294da8a7e0ec236e91304b', 'request_id': 'req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:12.413860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:12.430245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] The token cache is being invalidate because project 6fffba1def294da8a7e0ec236e91304b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:12.430545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:12.431457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:12.433842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 981/1945] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:12 2022] DELETE /identity/v3/projects/6fffba1def294da8a7e0ec236e91304b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:12.437360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:12.439255 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:12.449177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc1070-de1e-4dea-9f0a-cf55b541aff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.449806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc1070-de1e-4dea-9f0a-cf55b541aff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.450075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc1070-de1e-4dea-9f0a-cf55b541aff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.450345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc1070-de1e-4dea-9f0a-cf55b541aff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.450996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc1070-de1e-4dea-9f0a-cf55b541aff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:12.453561 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc1070-de1e-4dea-9f0a-cf55b541aff9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:12.463623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 965/1946] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:12.464796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5f23c-c963-42d5-b06a-e75bbfa19001 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.465083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5f23c-c963-42d5-b06a-e75bbfa19001 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.465356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5f23c-c963-42d5-b06a-e75bbfa19001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.486094 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-91f5f23c-c963-42d5-b06a-e75bbfa19001 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:12.487213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-91f5f23c-c963-42d5-b06a-e75bbfa19001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:12.495139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 966/1947] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:12.495872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5f23c-c963-42d5-b06a-e75bbfa19001 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:12.497082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-91f5f23c-c963-42d5-b06a-e75bbfa19001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:12.502482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b08c4-43a2-4bf2-9e1d-0e4af0981f6a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:12.507024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e25173-fa52-49ad-a683-b3b052f7870f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.507814 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e25173-fa52-49ad-a683-b3b052f7870f service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.508208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e25173-fa52-49ad-a683-b3b052f7870f service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.508529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e25173-fa52-49ad-a683-b3b052f7870f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.510434 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5f23c-c963-42d5-b06a-e75bbfa19001 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:12.510587 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b5e25173-fa52-49ad-a683-b3b052f7870f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:12.516648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cc2d0-8a78-4733-8e83-0f578479b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.517332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cc2d0-8a78-4733-8e83-0f578479b8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.517608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cc2d0-8a78-4733-8e83-0f578479b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.517874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cc2d0-8a78-4733-8e83-0f578479b8c3 admin admin] PATH_INFO: `/v3/projects/126e00b7b279475f92daafa066f4e242/users/c506e607ec5f4ece95f5f26393e6df1f/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.533648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cc2d0-8a78-4733-8e83-0f578479b8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=126e00b7b279475f92daafa066f4e242, user_id=c506e607ec5f4ece95f5f26393e6df1f, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:12.536390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cc2d0-8a78-4733-8e83-0f578479b8c3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:12.554510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 967/1948] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:12 2022] PUT /identity/v3/projects/126e00b7b279475f92daafa066f4e242/users/c506e607ec5f4ece95f5f26393e6df1f/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:12.554510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7d80f-d8ee-4ef2-b4c1-05c774a47c52 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.554510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7d80f-d8ee-4ef2-b4c1-05c774a47c52 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.554510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7d80f-d8ee-4ef2-b4c1-05c774a47c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.573793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-13d7d80f-d8ee-4ef2-b4c1-05c774a47c52 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:12.575003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-13d7d80f-d8ee-4ef2-b4c1-05c774a47c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:12.587785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e25173-fa52-49ad-a683-b3b052f7870f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:12.589440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e25173-fa52-49ad-a683-b3b052f7870f service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:12.604754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 982/1949] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:12.604754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e25173-fa52-49ad-a683-b3b052f7870f service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:12.617841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e25173-fa52-49ad-a683-b3b052f7870f service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:12.664488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:12.697179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 968/1950] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:12.700538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7d80f-d8ee-4ef2-b4c1-05c774a47c52 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:12.723194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74f586-817f-42e1-bf32-f7f31e6978a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.723866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74f586-817f-42e1-bf32-f7f31e6978a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.724141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74f586-817f-42e1-bf32-f7f31e6978a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.724479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74f586-817f-42e1-bf32-f7f31e6978a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.725152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74f586-817f-42e1-bf32-f7f31e6978a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:12.726658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7d80f-d8ee-4ef2-b4c1-05c774a47c52 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:12.727909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74f586-817f-42e1-bf32-f7f31e6978a9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:12.731947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715ff65-7ac9-40cb-8fc5-582584ecf8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.733094 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715ff65-7ac9-40cb-8fc5-582584ecf8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.734223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715ff65-7ac9-40cb-8fc5-582584ecf8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.734571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715ff65-7ac9-40cb-8fc5-582584ecf8b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.735303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715ff65-7ac9-40cb-8fc5-582584ecf8b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:12.735675 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715ff65-7ac9-40cb-8fc5-582584ecf8b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:12.737499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715ff65-7ac9-40cb-8fc5-582584ecf8b3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:12.739349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 983/1951] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:12.740586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74f586-817f-42e1-bf32-f7f31e6978a9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:12.756751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 969/1952] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:12.762627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715ff65-7ac9-40cb-8fc5-582584ecf8b3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:12.778252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715ff65-7ac9-40cb-8fc5-582584ecf8b3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:12.784403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9ef22-1776-46a8-b5cc-f66084497a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.793831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9ef22-1776-46a8-b5cc-f66084497a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.793831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9ef22-1776-46a8-b5cc-f66084497a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.793831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9ef22-1776-46a8-b5cc-f66084497a55 admin admin] PATH_INFO: `/v3/projects/126e00b7b279475f92daafa066f4e242/users/c506e607ec5f4ece95f5f26393e6df1f/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.797426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9ef22-1776-46a8-b5cc-f66084497a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=126e00b7b279475f92daafa066f4e242, user_id=c506e607ec5f4ece95f5f26393e6df1f, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:12.800460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9ef22-1776-46a8-b5cc-f66084497a55 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:12.816647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 970/1953] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:12 2022] PUT /identity/v3/projects/126e00b7b279475f92daafa066f4e242/users/c506e607ec5f4ece95f5f26393e6df1f/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:12.817784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9ef22-1776-46a8-b5cc-f66084497a55 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:12.824068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:12.852714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74f586-817f-42e1-bf32-f7f31e6978a9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:12.918782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c17caa-eac8-4cb6-b5e2-0b99dde4bc05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.919510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c17caa-eac8-4cb6-b5e2-0b99dde4bc05 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.919839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c17caa-eac8-4cb6-b5e2-0b99dde4bc05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.920466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c17caa-eac8-4cb6-b5e2-0b99dde4bc05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.923768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-57c17caa-eac8-4cb6-b5e2-0b99dde4bc05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:12.948353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9ef22-1776-46a8-b5cc-f66084497a55 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:12.957037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3b119-02f0-4e6a-8713-b716b6a4168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:12.957860 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3b119-02f0-4e6a-8713-b716b6a4168e admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:12.958287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3b119-02f0-4e6a-8713-b716b6a4168e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:12.958866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3b119-02f0-4e6a-8713-b716b6a4168e admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:12.959807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3b119-02f0-4e6a-8713-b716b6a4168e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:12.961953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3b119-02f0-4e6a-8713-b716b6a4168e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:12.996369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 971/1954] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:12 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:13.001741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47476f-e13d-4759-8239-169af349ffdf None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:13.001741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47476f-e13d-4759-8239-169af349ffdf None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:13.001741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47476f-e13d-4759-8239-169af349ffdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:13.009790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c17caa-eac8-4cb6-b5e2-0b99dde4bc05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:13.011378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c17caa-eac8-4cb6-b5e2-0b99dde4bc05 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:13.022065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 984/1955] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:13.022896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c17caa-eac8-4cb6-b5e2-0b99dde4bc05 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:13.035136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c17caa-eac8-4cb6-b5e2-0b99dde4bc05 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:13.069286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ad47476f-e13d-4759-8239-169af349ffdf None None] MFA Rules not processed for user `c506e607ec5f4ece95f5f26393e6df1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:13.070584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ad47476f-e13d-4759-8239-169af349ffdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:13.146235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b75f90-8447-4d07-a953-355870fb5ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:13.146964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75f90-8447-4d07-a953-355870fb5ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:13.147329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75f90-8447-4d07-a953-355870fb5ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:13.148649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75f90-8447-4d07-a953-355870fb5ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:13.149409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b75f90-8447-4d07-a953-355870fb5ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:13.152881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b75f90-8447-4d07-a953-355870fb5ca5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:13.188378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 985/1956] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:13 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:13.188653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 972/1957] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:13.192774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b75f90-8447-4d07-a953-355870fb5ca5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:13.205779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b75f90-8447-4d07-a953-355870fb5ca5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:13.206756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47476f-e13d-4759-8239-169af349ffdf None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:13.217717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460aac3-3d62-449d-a9a4-66878aba5af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:13.218860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460aac3-3d62-449d-a9a4-66878aba5af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:13.219209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460aac3-3d62-449d-a9a4-66878aba5af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:13.219545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460aac3-3d62-449d-a9a4-66878aba5af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:13.220772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460aac3-3d62-449d-a9a4-66878aba5af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:13.223347 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460aac3-3d62-449d-a9a4-66878aba5af7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:13.240393 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 986/1958] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:13.244589 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460aac3-3d62-449d-a9a4-66878aba5af7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:13.262279 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460aac3-3d62-449d-a9a4-66878aba5af7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:13.271020 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0254b6-ddf9-4612-9f99-ff265b46475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:13.271825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0254b6-ddf9-4612-9f99-ff265b46475b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:13.272134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0254b6-ddf9-4612-9f99-ff265b46475b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:13.272514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0254b6-ddf9-4612-9f99-ff265b46475b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:13.274049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0254b6-ddf9-4612-9f99-ff265b46475b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:13.281385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0254b6-ddf9-4612-9f99-ff265b46475b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:13.285766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:13.305201 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 987/1959] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:13.310170 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0254b6-ddf9-4612-9f99-ff265b46475b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:13.328088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0254b6-ddf9-4612-9f99-ff265b46475b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:13.333432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748067a2-63cb-47df-a196-331be94b26f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:13.334121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748067a2-63cb-47df-a196-331be94b26f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:13.334401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748067a2-63cb-47df-a196-331be94b26f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:13.334756 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748067a2-63cb-47df-a196-331be94b26f6 admin admin] PATH_INFO: `/v3/projects/61949c95ba1643918210245f45235f82/users/4e2039c4cd354889b63b2d3ddbf8f1ff/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:13.348987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47476f-e13d-4759-8239-169af349ffdf None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:13.369160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa47fe-5d2e-4fc8-9952-e4001974743d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:13.372118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa47fe-5d2e-4fc8-9952-e4001974743d service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:13.372118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa47fe-5d2e-4fc8-9952-e4001974743d service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:13.372118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa47fe-5d2e-4fc8-9952-e4001974743d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:13.397217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748067a2-63cb-47df-a196-331be94b26f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61949c95ba1643918210245f45235f82, user_id=4e2039c4cd354889b63b2d3ddbf8f1ff, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:13.407372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748067a2-63cb-47df-a196-331be94b26f6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:13.417108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:13.427552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa47fe-5d2e-4fc8-9952-e4001974743d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:13.429418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa47fe-5d2e-4fc8-9952-e4001974743d service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:13.462325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 988/1960] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:13 2022] PUT /identity/v3/projects/61949c95ba1643918210245f45235f82/users/4e2039c4cd354889b63b2d3ddbf8f1ff/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:13.463947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f26a6-6a5d-4e9e-8adf-39abccbab96d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:13.464228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f26a6-6a5d-4e9e-8adf-39abccbab96d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:13.465198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f26a6-6a5d-4e9e-8adf-39abccbab96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:13.469510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 973/1961] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:13.543173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f07f26a6-6a5d-4e9e-8adf-39abccbab96d None None] MFA Rules not processed for user `4e2039c4cd354889b63b2d3ddbf8f1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:13.545344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f07f26a6-6a5d-4e9e-8adf-39abccbab96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:13.687025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 989/1962] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:13.691827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa47fe-5d2e-4fc8-9952-e4001974743d service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:13.711004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa47fe-5d2e-4fc8-9952-e4001974743d service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:13.796940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4ddf9-9e48-4a08-bf76-31f15d3da23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:13.797584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4ddf9-9e48-4a08-bf76-31f15d3da23e admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:13.797864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4ddf9-9e48-4a08-bf76-31f15d3da23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:13.798142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4ddf9-9e48-4a08-bf76-31f15d3da23e admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:13.799291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4ddf9-9e48-4a08-bf76-31f15d3da23e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:13.801653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4ddf9-9e48-4a08-bf76-31f15d3da23e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:13.856105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 974/1963] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:13 2022] POST /identity/v3/projects => generated 363 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:13.858593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f26a6-6a5d-4e9e-8adf-39abccbab96d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:13.876262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f26a6-6a5d-4e9e-8adf-39abccbab96d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:13.965664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cc7a3-3d0d-496c-b214-f3a266d66222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:13.966309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cc7a3-3d0d-496c-b214-f3a266d66222 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:13.966591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cc7a3-3d0d-496c-b214-f3a266d66222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:13.966863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cc7a3-3d0d-496c-b214-f3a266d66222 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:13.967556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cc7a3-3d0d-496c-b214-f3a266d66222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:13.975049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cc7a3-3d0d-496c-b214-f3a266d66222 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:14.040460 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 990/1964] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:13 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:14.041930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4ddf9-9e48-4a08-bf76-31f15d3da23e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:14.055079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4ddf9-9e48-4a08-bf76-31f15d3da23e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:14.064344 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba12bb-c3a0-4a8a-bbca-b3a14bc1ba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:14.065738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba12bb-c3a0-4a8a-bbca-b3a14bc1ba41 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:14.066183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba12bb-c3a0-4a8a-bbca-b3a14bc1ba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:14.066596 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba12bb-c3a0-4a8a-bbca-b3a14bc1ba41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:14.067401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba12bb-c3a0-4a8a-bbca-b3a14bc1ba41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:14.069462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba12bb-c3a0-4a8a-bbca-b3a14bc1ba41 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:14.088544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 975/1965] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:14.093212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cc7a3-3d0d-496c-b214-f3a266d66222 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:14.105998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cc7a3-3d0d-496c-b214-f3a266d66222 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:14.111432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0e75b-3888-43e4-bcbf-c5c0cfa48a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:14.112341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0e75b-3888-43e4-bcbf-c5c0cfa48a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:14.112724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0e75b-3888-43e4-bcbf-c5c0cfa48a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:14.113098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0e75b-3888-43e4-bcbf-c5c0cfa48a17 admin admin] PATH_INFO: `/v3/projects/765be366272840ea8e4190d39abdd8fa/users/305ff36ddb70490088444aaadec1fa41/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:14.131815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0e75b-3888-43e4-bcbf-c5c0cfa48a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765be366272840ea8e4190d39abdd8fa, user_id=305ff36ddb70490088444aaadec1fa41, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:14.135104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0e75b-3888-43e4-bcbf-c5c0cfa48a17 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:14.152559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 991/1966] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:14 2022] PUT /identity/v3/projects/765be366272840ea8e4190d39abdd8fa/users/305ff36ddb70490088444aaadec1fa41/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:14.157118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba12bb-c3a0-4a8a-bbca-b3a14bc1ba41 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:14.173712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba12bb-c3a0-4a8a-bbca-b3a14bc1ba41 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:14.173879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0e75b-3888-43e4-bcbf-c5c0cfa48a17 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:14.249064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8931c5c-697c-41dc-a0c1-71e3dcf338dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:14.249502 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:14.249841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8931c5c-697c-41dc-a0c1-71e3dcf338dc admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:14.250281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8931c5c-697c-41dc-a0c1-71e3dcf338dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:14.250407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8931c5c-697c-41dc-a0c1-71e3dcf338dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:14.251278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8931c5c-697c-41dc-a0c1-71e3dcf338dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:14.253023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8931c5c-697c-41dc-a0c1-71e3dcf338dc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:14.264328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 976/1967] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:14.264704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0e75b-3888-43e4-bcbf-c5c0cfa48a17 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:14.267766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8931c5c-697c-41dc-a0c1-71e3dcf338dc admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:14.269821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e75213-2562-4bfb-b02f-7d45d513c0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:14.270617 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e75213-2562-4bfb-b02f-7d45d513c0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:14.270899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e75213-2562-4bfb-b02f-7d45d513c0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:14.271168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e75213-2562-4bfb-b02f-7d45d513c0e7 admin admin] PATH_INFO: `/v3/users/d772cc9adc6f4d13a81a5cd475a7bd92` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:14.272373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e75213-2562-4bfb-b02f-7d45d513c0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d772cc9adc6f4d13a81a5cd475a7bd92)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:14.275150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e75213-2562-4bfb-b02f-7d45d513c0e7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:14.279163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8931c5c-697c-41dc-a0c1-71e3dcf338dc admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:14.287540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa3be-f87b-4fe4-bafc-49735a9ffef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:14.288232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa3be-f87b-4fe4-bafc-49735a9ffef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:14.288546 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa3be-f87b-4fe4-bafc-49735a9ffef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:14.288824 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa3be-f87b-4fe4-bafc-49735a9ffef2 admin admin] PATH_INFO: `/v3/projects/765be366272840ea8e4190d39abdd8fa/users/305ff36ddb70490088444aaadec1fa41/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:14.290914 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa3be-f87b-4fe4-bafc-49735a9ffef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765be366272840ea8e4190d39abdd8fa, user_id=305ff36ddb70490088444aaadec1fa41, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:14.293664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa3be-f87b-4fe4-bafc-49735a9ffef2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:14.305527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 977/1968] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:14 2022] PUT /identity/v3/projects/765be366272840ea8e4190d39abdd8fa/users/305ff36ddb70490088444aaadec1fa41/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:14.318831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c85d-f426-4faa-a898-480ded40233b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:14.319204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c85d-f426-4faa-a898-480ded40233b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:14.319420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c85d-f426-4faa-a898-480ded40233b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:14.333368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-80e75213-2562-4bfb-b02f-7d45d513c0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd772cc9adc6f4d13a81a5cd475a7bd92'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:14.334060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-80e75213-2562-4bfb-b02f-7d45d513c0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd772cc9adc6f4d13a81a5cd475a7bd92'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:14.342998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-80e75213-2562-4bfb-b02f-7d45d513c0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd772cc9adc6f4d13a81a5cd475a7bd92'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:14.350620 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-80e75213-2562-4bfb-b02f-7d45d513c0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd772cc9adc6f4d13a81a5cd475a7bd92'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:14.350802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0c68c85d-f426-4faa-a898-480ded40233b None None] MFA Rules not processed for user `305ff36ddb70490088444aaadec1fa41`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:14.351449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-80e75213-2562-4bfb-b02f-7d45d513c0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd772cc9adc6f4d13a81a5cd475a7bd92'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:14.352153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0c68c85d-f426-4faa-a898-480ded40233b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:14.370335 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 992/1969] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:14 2022] DELETE /identity/v3/users/d772cc9adc6f4d13a81a5cd475a7bd92 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:14.375011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777fc4e-3051-4e1e-a109-53b16d69f73c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:14.375267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777fc4e-3051-4e1e-a109-53b16d69f73c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:14.375620 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777fc4e-3051-4e1e-a109-53b16d69f73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:14.385608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:14.395482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3777fc4e-3051-4e1e-a109-53b16d69f73c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:14.396787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3777fc4e-3051-4e1e-a109-53b16d69f73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:14.428243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 978/1970] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:14.442702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68c85d-f426-4faa-a898-480ded40233b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:14.444204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0c68c85d-f426-4faa-a898-480ded40233b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:14.459781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 993/1971] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:14.469925 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777fc4e-3051-4e1e-a109-53b16d69f73c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:14.471319 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3777fc4e-3051-4e1e-a109-53b16d69f73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:14.509079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68c85d-f426-4faa-a898-480ded40233b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:14.531427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777fc4e-3051-4e1e-a109-53b16d69f73c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:14.536216 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13c528-3219-49d0-b0c4-e92283ab00cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:14.537336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13c528-3219-49d0-b0c4-e92283ab00cb service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:14.537336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13c528-3219-49d0-b0c4-e92283ab00cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:14.537560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13c528-3219-49d0-b0c4-e92283ab00cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:14.549231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13c528-3219-49d0-b0c4-e92283ab00cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:14.550744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13c528-3219-49d0-b0c4-e92283ab00cb service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:14.560809 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 994/1972] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:13:14.575306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe91643-d4ca-4091-96e3-f395e8372027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:14.575936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe91643-d4ca-4091-96e3-f395e8372027 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:14.576211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe91643-d4ca-4091-96e3-f395e8372027 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:14.576603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe91643-d4ca-4091-96e3-f395e8372027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:14.644767 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe91643-d4ca-4091-96e3-f395e8372027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:14.646472 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe91643-d4ca-4091-96e3-f395e8372027 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:14.658631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 979/1973] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:14.773627 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13c528-3219-49d0-b0c4-e92283ab00cb service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:14.775220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9f13c528-3219-49d0-b0c4-e92283ab00cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:14.787149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13c528-3219-49d0-b0c4-e92283ab00cb service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:14.791280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0df8a-6045-48bb-ad37-a009bf678aab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:14.791895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0df8a-6045-48bb-ad37-a009bf678aab service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:14.792169 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0df8a-6045-48bb-ad37-a009bf678aab service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:14.792478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0df8a-6045-48bb-ad37-a009bf678aab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:14.794194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-63a0df8a-6045-48bb-ad37-a009bf678aab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:14.805425 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:14.861606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0df8a-6045-48bb-ad37-a009bf678aab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:14.863398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0df8a-6045-48bb-ad37-a009bf678aab service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:14.876083 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 995/1974] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:14.877164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe91643-d4ca-4091-96e3-f395e8372027 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:14.878561 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9fe91643-d4ca-4091-96e3-f395e8372027 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:14.897239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe91643-d4ca-4091-96e3-f395e8372027 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:14.903258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:14.904018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:14.904413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:14.904828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] PATH_INFO: `/v3/projects/269eb417c633446cb6fe83b151f4a3ca` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:14.906340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=269eb417c633446cb6fe83b151f4a3ca)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:14.908553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:14.941931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:14.963387 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269eb417c633446cb6fe83b151f4a3ca', 'request_id': 'req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:14.971006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269eb417c633446cb6fe83b151f4a3ca', 'request_id': 'req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:14.979056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269eb417c633446cb6fe83b151f4a3ca', 'request_id': 'req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:14.990935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] The token cache is being invalidate because project 269eb417c633446cb6fe83b151f4a3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:14.991273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:14.992918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:14.995170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 980/1975] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:14 2022] DELETE /identity/v3/projects/269eb417c633446cb6fe83b151f4a3ca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:15.001551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0df8a-6045-48bb-ad37-a009bf678aab service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:15.024051 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0df8a-6045-48bb-ad37-a009bf678aab service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:15.094990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:15.095821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:15.096105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:15.096414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] PATH_INFO: `/v3/users/c506e607ec5f4ece95f5f26393e6df1f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:15.097566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c506e607ec5f4ece95f5f26393e6df1f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:15.099676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:15.168961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c506e607ec5f4ece95f5f26393e6df1f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.169612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c506e607ec5f4ece95f5f26393e6df1f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.178805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c506e607ec5f4ece95f5f26393e6df1f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.187705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c506e607ec5f4ece95f5f26393e6df1f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.188606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c506e607ec5f4ece95f5f26393e6df1f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.210259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 996/1976] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:15 2022] DELETE /identity/v3/users/c506e607ec5f4ece95f5f26393e6df1f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:15.382763 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:15.384342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:15.398200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5ed2f-50d8-4672-a6f6-50a44002abc7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:15.498606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e51434-396e-4595-a7d5-fbf50a9ff535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:15.499911 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51434-396e-4595-a7d5-fbf50a9ff535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:15.500374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51434-396e-4595-a7d5-fbf50a9ff535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:15.500808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51434-396e-4595-a7d5-fbf50a9ff535 admin admin] PATH_INFO: `/v3/users/474a39e78d974fedbb7669fff0566a7b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:15.502133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e51434-396e-4595-a7d5-fbf50a9ff535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=474a39e78d974fedbb7669fff0566a7b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:15.504363 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e51434-396e-4595-a7d5-fbf50a9ff535 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:15.570856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-51e51434-396e-4595-a7d5-fbf50a9ff535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474a39e78d974fedbb7669fff0566a7b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.571618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-51e51434-396e-4595-a7d5-fbf50a9ff535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474a39e78d974fedbb7669fff0566a7b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.581528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-51e51434-396e-4595-a7d5-fbf50a9ff535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474a39e78d974fedbb7669fff0566a7b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.582557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-51e51434-396e-4595-a7d5-fbf50a9ff535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474a39e78d974fedbb7669fff0566a7b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.610103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:15.612043 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:15.618237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-51e51434-396e-4595-a7d5-fbf50a9ff535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474a39e78d974fedbb7669fff0566a7b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.625954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ff787-5492-4b64-aa92-f610c6f5fd06 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:15.632782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:15.633636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:15.633921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:15.636978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 981/1977] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:15 2022] DELETE /identity/v3/users/474a39e78d974fedbb7669fff0566a7b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:15.637305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] PATH_INFO: `/v3/projects/126e00b7b279475f92daafa066f4e242` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:15.640987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=126e00b7b279475f92daafa066f4e242)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:15.641776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00535a3-d5a3-478a-bf2e-e8d4c7dc8d1e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:15.642145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00535a3-d5a3-478a-bf2e-e8d4c7dc8d1e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:15.642494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00535a3-d5a3-478a-bf2e-e8d4c7dc8d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:15.646510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:15.667068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b00535a3-d5a3-478a-bf2e-e8d4c7dc8d1e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:15.668399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b00535a3-d5a3-478a-bf2e-e8d4c7dc8d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:15.683328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:15.700776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:15.715972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126e00b7b279475f92daafa066f4e242', 'request_id': 'req-9a4bb26d-4815-4459-9495-49c75fc5d8eb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.724379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126e00b7b279475f92daafa066f4e242', 'request_id': 'req-9a4bb26d-4815-4459-9495-49c75fc5d8eb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.731562 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126e00b7b279475f92daafa066f4e242', 'request_id': 'req-9a4bb26d-4815-4459-9495-49c75fc5d8eb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.745812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 982/1978] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:15.748332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] The token cache is being invalidate because project 126e00b7b279475f92daafa066f4e242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:15.748792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.749445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:15.750964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 997/1979] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:15 2022] DELETE /identity/v3/projects/126e00b7b279475f92daafa066f4e242 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:15.755803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5757ae0-f69c-4953-bc3c-44c60ebd7b03 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:15.756318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5757ae0-f69c-4953-bc3c-44c60ebd7b03 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:15.756671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5757ae0-f69c-4953-bc3c-44c60ebd7b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:15.757468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:15.758800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:15.779041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c5757ae0-f69c-4953-bc3c-44c60ebd7b03 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:15.780337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c5757ae0-f69c-4953-bc3c-44c60ebd7b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:15.823729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bb26d-4815-4459-9495-49c75fc5d8eb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:15.827501 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af657d07-c354-4ab7-aa24-c2cf7db92d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:15.828109 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af657d07-c354-4ab7-aa24-c2cf7db92d7f service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:15.828417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af657d07-c354-4ab7-aa24-c2cf7db92d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:15.828689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af657d07-c354-4ab7-aa24-c2cf7db92d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:15.830615 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-af657d07-c354-4ab7-aa24-c2cf7db92d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:15.845408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 983/1980] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:15.853284 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4a53-d316-4489-b455-342e5afbbf32 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:15.853571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4a53-d316-4489-b455-342e5afbbf32 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:15.853849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4a53-d316-4489-b455-342e5afbbf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:15.874872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-165a4a53-d316-4489-b455-342e5afbbf32 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:15.876092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-165a4a53-d316-4489-b455-342e5afbbf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:15.885369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 984/1981] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:15.889737 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a4a53-d316-4489-b455-342e5afbbf32 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:15.899627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a4a53-d316-4489-b455-342e5afbbf32 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:15.902628 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af657d07-c354-4ab7-aa24-c2cf7db92d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:15.904188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af657d07-c354-4ab7-aa24-c2cf7db92d7f service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:15.904612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c4040-83d0-41da-b3ef-ed2f4fcc028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:15.905293 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c4040-83d0-41da-b3ef-ed2f4fcc028d admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:15.905572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c4040-83d0-41da-b3ef-ed2f4fcc028d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:15.905907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c4040-83d0-41da-b3ef-ed2f4fcc028d admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:15.906560 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c4040-83d0-41da-b3ef-ed2f4fcc028d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:15.906983 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c4040-83d0-41da-b3ef-ed2f4fcc028d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:15.908700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c4040-83d0-41da-b3ef-ed2f4fcc028d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:15.915005 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 998/1982] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:13:15.922982 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 985/1983] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:13:15.927273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af657d07-c354-4ab7-aa24-c2cf7db92d7f service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:15.939340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af657d07-c354-4ab7-aa24-c2cf7db92d7f service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:15.944161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71fe39-3fe5-4627-a2e6-80ac1bfa0634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:15.944813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71fe39-3fe5-4627-a2e6-80ac1bfa0634 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:15.945087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71fe39-3fe5-4627-a2e6-80ac1bfa0634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:15.945356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71fe39-3fe5-4627-a2e6-80ac1bfa0634 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:15.945995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71fe39-3fe5-4627-a2e6-80ac1bfa0634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:15.947977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71fe39-3fe5-4627-a2e6-80ac1bfa0634 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:15.982665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 999/1984] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:15 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:15.984241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c4040-83d0-41da-b3ef-ed2f4fcc028d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:15.995147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c4040-83d0-41da-b3ef-ed2f4fcc028d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:16.068798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6009-550b-4add-be39-9b6634e1902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:16.069637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6009-550b-4add-be39-9b6634e1902e admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:16.070242 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6009-550b-4add-be39-9b6634e1902e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:16.070242 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6009-550b-4add-be39-9b6634e1902e admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:16.071299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c6009-550b-4add-be39-9b6634e1902e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:16.073220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c6009-550b-4add-be39-9b6634e1902e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:16.113059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 986/1985] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:15 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:16.117476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71fe39-3fe5-4627-a2e6-80ac1bfa0634 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:16.133174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71fe39-3fe5-4627-a2e6-80ac1bfa0634 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:16.138554 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167c4f5-22bb-490a-95df-957ea7b653de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:16.139200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167c4f5-22bb-490a-95df-957ea7b653de admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:16.139548 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167c4f5-22bb-490a-95df-957ea7b653de admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:16.139824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167c4f5-22bb-490a-95df-957ea7b653de admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:16.140505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167c4f5-22bb-490a-95df-957ea7b653de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:16.142185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167c4f5-22bb-490a-95df-957ea7b653de admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:16.156323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1000/1986] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:16.159093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6009-550b-4add-be39-9b6634e1902e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:16.172970 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6009-550b-4add-be39-9b6634e1902e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:16.179490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d4765-f545-48e8-961f-40ff609531f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:16.180497 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d4765-f545-48e8-961f-40ff609531f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:16.180920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d4765-f545-48e8-961f-40ff609531f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:16.181368 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d4765-f545-48e8-961f-40ff609531f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:16.182171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d4765-f545-48e8-961f-40ff609531f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:16.184122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d4765-f545-48e8-961f-40ff609531f8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:16.197590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 987/1987] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:16.202834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167c4f5-22bb-490a-95df-957ea7b653de admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:16.232817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167c4f5-22bb-490a-95df-957ea7b653de admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:16.244687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21990519-f252-4b34-921a-dc648a809e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:16.245302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21990519-f252-4b34-921a-dc648a809e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:16.245601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21990519-f252-4b34-921a-dc648a809e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:16.245951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21990519-f252-4b34-921a-dc648a809e2a admin admin] PATH_INFO: `/v3/projects/eef5ce596ec74c728368d39ecfff1155/users/f400accbfcb8435b99757872c027cc74/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:16.267697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21990519-f252-4b34-921a-dc648a809e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef5ce596ec74c728368d39ecfff1155, user_id=f400accbfcb8435b99757872c027cc74, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:16.274200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d4765-f545-48e8-961f-40ff609531f8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:16.275038 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21990519-f252-4b34-921a-dc648a809e2a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:16.278119 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c98d4765-f545-48e8-961f-40ff609531f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:16.305953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d4765-f545-48e8-961f-40ff609531f8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:16.323649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1001/1988] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:16 2022] PUT /identity/v3/projects/eef5ce596ec74c728368d39ecfff1155/users/f400accbfcb8435b99757872c027cc74/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:16.334750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5742ad-c5a0-4669-a382-618c78c80e6a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:16.335054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5742ad-c5a0-4669-a382-618c78c80e6a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:16.335634 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5742ad-c5a0-4669-a382-618c78c80e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:16.351168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:16.392453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4e5742ad-c5a0-4669-a382-618c78c80e6a None None] MFA Rules not processed for user `f400accbfcb8435b99757872c027cc74`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:16.394309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4e5742ad-c5a0-4669-a382-618c78c80e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:16.409468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:16.473882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:16.474633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:16.474910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:16.475185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] PATH_INFO: `/v3/projects/7805b09da04f4690916df3e4a1afc260` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:16.476469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7805b09da04f4690916df3e4a1afc260)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:16.478428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:16.508684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1002/1989] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:16.513846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5742ad-c5a0-4669-a382-618c78c80e6a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:16.528713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5742ad-c5a0-4669-a382-618c78c80e6a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:16.567082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7805b09da04f4690916df3e4a1afc260', 'request_id': 'req-7158ab79-8b46-4a09-8efb-974c1c314c5f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:16.589849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7805b09da04f4690916df3e4a1afc260', 'request_id': 'req-7158ab79-8b46-4a09-8efb-974c1c314c5f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:16.607230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7805b09da04f4690916df3e4a1afc260', 'request_id': 'req-7158ab79-8b46-4a09-8efb-974c1c314c5f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:16.632695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] The token cache is being invalidate because project 7805b09da04f4690916df3e4a1afc260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:16.633088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:16.634075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:16.636110 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 988/1990] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:16 2022] DELETE /identity/v3/projects/7805b09da04f4690916df3e4a1afc260 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:16.639628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:16.641407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:16.642344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28a9b7-cd77-4ca5-b1c4-c7780421637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:16.643062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28a9b7-cd77-4ca5-b1c4-c7780421637a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:16.643462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28a9b7-cd77-4ca5-b1c4-c7780421637a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:16.643792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28a9b7-cd77-4ca5-b1c4-c7780421637a admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:16.644613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28a9b7-cd77-4ca5-b1c4-c7780421637a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:16.647367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28a9b7-cd77-4ca5-b1c4-c7780421637a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:16.681901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158ab79-8b46-4a09-8efb-974c1c314c5f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:16.689060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:16.690072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:16.690409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:16.690692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] PATH_INFO: `/v3/users/6c948b28be4b4733ab5d601e046a1d29` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:16.692867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c948b28be4b4733ab5d601e046a1d29)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:16.695647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:16.701314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1003/1991] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:16 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:16.703889 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28a9b7-cd77-4ca5-b1c4-c7780421637a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:16.707716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8e28a9b7-cd77-4ca5-b1c4-c7780421637a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:16.762897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c948b28be4b4733ab5d601e046a1d29'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:16.763574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c948b28be4b4733ab5d601e046a1d29'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:16.771609 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c948b28be4b4733ab5d601e046a1d29'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:16.772325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c948b28be4b4733ab5d601e046a1d29'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:16.779589 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28a9b7-cd77-4ca5-b1c4-c7780421637a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:16.784520 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfc251-96ba-4f65-b161-606bd58dc7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:16.785141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfc251-96ba-4f65-b161-606bd58dc7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:16.785416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfc251-96ba-4f65-b161-606bd58dc7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:16.785682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfc251-96ba-4f65-b161-606bd58dc7f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:16.786322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfc251-96ba-4f65-b161-606bd58dc7f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:16.788317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfc251-96ba-4f65-b161-606bd58dc7f1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:16.798071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c948b28be4b4733ab5d601e046a1d29'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:16.823708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1004/1992] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:16 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:16.823931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 989/1993] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:16 2022] DELETE /identity/v3/users/6c948b28be4b4733ab5d601e046a1d29 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:16.825498 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfc251-96ba-4f65-b161-606bd58dc7f1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:16.828100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-22dfc251-96ba-4f65-b161-606bd58dc7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:16.840180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfc251-96ba-4f65-b161-606bd58dc7f1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:16.845481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:16.907539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543b24c-7368-49b7-8d99-a3f1ea0631cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:16.908325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543b24c-7368-49b7-8d99-a3f1ea0631cb admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:16.908656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543b24c-7368-49b7-8d99-a3f1ea0631cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:16.908990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543b24c-7368-49b7-8d99-a3f1ea0631cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:16.909715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543b24c-7368-49b7-8d99-a3f1ea0631cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:16.911538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543b24c-7368-49b7-8d99-a3f1ea0631cb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:16.931940 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1005/1994] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:16.933945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:16.945229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c5df7-c206-48cc-9f3d-ccb9a7b02706 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:16.953382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57181408-dc4e-43ed-a716-2a1800c43e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:16.953382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57181408-dc4e-43ed-a716-2a1800c43e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:16.953382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57181408-dc4e-43ed-a716-2a1800c43e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:16.953382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57181408-dc4e-43ed-a716-2a1800c43e4f admin admin] PATH_INFO: `/v3/projects/3e2d1b5545c14471b4d7b838c954e5a6/users/60e4047abc094e42a74338cf5db9432f/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:16.973307 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57181408-dc4e-43ed-a716-2a1800c43e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2d1b5545c14471b4d7b838c954e5a6, user_id=60e4047abc094e42a74338cf5db9432f, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:16.976406 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57181408-dc4e-43ed-a716-2a1800c43e4f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:16.992174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 990/1995] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:16 2022] PUT /identity/v3/projects/3e2d1b5545c14471b4d7b838c954e5a6/users/60e4047abc094e42a74338cf5db9432f/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:16.997465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543b24c-7368-49b7-8d99-a3f1ea0631cb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:17.015928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543b24c-7368-49b7-8d99-a3f1ea0631cb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:17.125369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf35417-fa4d-410f-b3ed-415489a71e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:17.127418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf35417-fa4d-410f-b3ed-415489a71e55 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:17.127937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf35417-fa4d-410f-b3ed-415489a71e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:17.129656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf35417-fa4d-410f-b3ed-415489a71e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:17.130609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf35417-fa4d-410f-b3ed-415489a71e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:17.135103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf35417-fa4d-410f-b3ed-415489a71e55 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:17.153800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1006/1996] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:17.159803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57181408-dc4e-43ed-a716-2a1800c43e4f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:17.177106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57181408-dc4e-43ed-a716-2a1800c43e4f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:17.187603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc87e60-0a3e-464d-abfa-ee2604bfe944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:17.188556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc87e60-0a3e-464d-abfa-ee2604bfe944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:17.188989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc87e60-0a3e-464d-abfa-ee2604bfe944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:17.190460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc87e60-0a3e-464d-abfa-ee2604bfe944 admin admin] PATH_INFO: `/v3/projects/3e2d1b5545c14471b4d7b838c954e5a6/users/60e4047abc094e42a74338cf5db9432f/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:17.194872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc87e60-0a3e-464d-abfa-ee2604bfe944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2d1b5545c14471b4d7b838c954e5a6, user_id=60e4047abc094e42a74338cf5db9432f, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:17.208320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc87e60-0a3e-464d-abfa-ee2604bfe944 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:17.224316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=79,keystone:DELETE=17,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:17.232317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 991/1997] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:17 2022] PUT /identity/v3/projects/3e2d1b5545c14471b4d7b838c954e5a6/users/60e4047abc094e42a74338cf5db9432f/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:17.244665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18999db-f842-420f-baf5-2530ff4c9f0f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:17.244918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18999db-f842-420f-baf5-2530ff4c9f0f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:17.245289 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18999db-f842-420f-baf5-2530ff4c9f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:17.312384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e18999db-f842-420f-baf5-2530ff4c9f0f None None] MFA Rules not processed for user `60e4047abc094e42a74338cf5db9432f`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:17.313792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e18999db-f842-420f-baf5-2530ff4c9f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:17.458308 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1007/1998] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:17.469700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc87e60-0a3e-464d-abfa-ee2604bfe944 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:17.472185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cfc87e60-0a3e-464d-abfa-ee2604bfe944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:17.592466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18999db-f842-420f-baf5-2530ff4c9f0f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:17.594599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e18999db-f842-420f-baf5-2530ff4c9f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:17.624677 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc87e60-0a3e-464d-abfa-ee2604bfe944 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:17.639574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489cef9-9110-4d78-973d-17982ea366bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:17.644447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489cef9-9110-4d78-973d-17982ea366bf service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:17.644447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489cef9-9110-4d78-973d-17982ea366bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:17.644447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489cef9-9110-4d78-973d-17982ea366bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:17.657076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a489cef9-9110-4d78-973d-17982ea366bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:17.711601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:17.762950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18999db-f842-420f-baf5-2530ff4c9f0f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:17.768839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:17.772175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:17.772175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:17.772175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107 admin admin] PATH_INFO: `/v3/projects/5e0c2089c5354a8086a3f675c7b0726f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:17.773709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0c2089c5354a8086a3f675c7b0726f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:17.776269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:17.786255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489cef9-9110-4d78-973d-17982ea366bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:17.788452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489cef9-9110-4d78-973d-17982ea366bf service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:17.810429 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 992/1999] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:17.875306 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0c2089c5354a8086a3f675c7b0726f', 'request_id': 'req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:17.907060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0c2089c5354a8086a3f675c7b0726f', 'request_id': 'req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:17.919888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0c2089c5354a8086a3f675c7b0726f', 'request_id': 'req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:17.955938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107 admin admin] The token cache is being invalidate because project 5e0c2089c5354a8086a3f675c7b0726f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:17.956067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:17.972683 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-06bd7d24-9b91-4207-9ef8-6e68ef9fd107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:17.976400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1008/2000] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:17 2022] DELETE /identity/v3/projects/5e0c2089c5354a8086a3f675c7b0726f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:17.981616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da878-bab8-49b6-ae1b-2f7ea2c81514 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:17.981909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da878-bab8-49b6-ae1b-2f7ea2c81514 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:17.982178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da878-bab8-49b6-ae1b-2f7ea2c81514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:18.027373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ca0da878-bab8-49b6-ae1b-2f7ea2c81514 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:18.028480 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ca0da878-bab8-49b6-ae1b-2f7ea2c81514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:18.112793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 993/2001] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:18.121312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548c171-74c1-4be3-8387-6bf67fb67563 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:18.121866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548c171-74c1-4be3-8387-6bf67fb67563 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:18.122086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548c171-74c1-4be3-8387-6bf67fb67563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:18.166512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a548c171-74c1-4be3-8387-6bf67fb67563 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:18.168046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a548c171-74c1-4be3-8387-6bf67fb67563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:18.188929 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1009/2002] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:18.193947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0da878-bab8-49b6-ae1b-2f7ea2c81514 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:18.209121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0da878-bab8-49b6-ae1b-2f7ea2c81514 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:18.217170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1367b6-d741-46cf-a4a2-939ff91b5675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:18.217916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1367b6-d741-46cf-a4a2-939ff91b5675 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:18.218182 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1367b6-d741-46cf-a4a2-939ff91b5675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:18.218679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1367b6-d741-46cf-a4a2-939ff91b5675 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:18.219350 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1367b6-d741-46cf-a4a2-939ff91b5675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:18.219934 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1367b6-d741-46cf-a4a2-939ff91b5675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:18.222145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1367b6-d741-46cf-a4a2-939ff91b5675 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:18.240916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 994/2003] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:18.241812 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548c171-74c1-4be3-8387-6bf67fb67563 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:18.257120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548c171-74c1-4be3-8387-6bf67fb67563 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:18.272009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070eb1c-031f-4577-a6f6-78e9843ad97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:18.272672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070eb1c-031f-4577-a6f6-78e9843ad97b admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:18.272950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070eb1c-031f-4577-a6f6-78e9843ad97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:18.273564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070eb1c-031f-4577-a6f6-78e9843ad97b admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:18.274229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070eb1c-031f-4577-a6f6-78e9843ad97b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:18.276189 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070eb1c-031f-4577-a6f6-78e9843ad97b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:18.317163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1010/2004] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:18 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:18.322162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1367b6-d741-46cf-a4a2-939ff91b5675 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:18.342290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1367b6-d741-46cf-a4a2-939ff91b5675 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:18.417100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:18.459284 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d23a1f-af25-4809-aba7-32c1441243d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:18.460232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d23a1f-af25-4809-aba7-32c1441243d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:18.460723 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d23a1f-af25-4809-aba7-32c1441243d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:18.461439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d23a1f-af25-4809-aba7-32c1441243d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:18.462956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d23a1f-af25-4809-aba7-32c1441243d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:18.467058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d23a1f-af25-4809-aba7-32c1441243d5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:18.517012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 995/2005] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:18 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:18.521081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070eb1c-031f-4577-a6f6-78e9843ad97b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:18.547086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070eb1c-031f-4577-a6f6-78e9843ad97b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:18.561394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52316614-1b22-4030-abbb-8c8fc8dfedea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:18.562376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52316614-1b22-4030-abbb-8c8fc8dfedea admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:18.562928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52316614-1b22-4030-abbb-8c8fc8dfedea admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:18.563338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52316614-1b22-4030-abbb-8c8fc8dfedea admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:18.564135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52316614-1b22-4030-abbb-8c8fc8dfedea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:18.566180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52316614-1b22-4030-abbb-8c8fc8dfedea admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:18.588504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1011/2006] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:18.590055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d23a1f-af25-4809-aba7-32c1441243d5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:18.604768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d23a1f-af25-4809-aba7-32c1441243d5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:18.610575 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c80e6-534f-4f13-bfd6-911c20922611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:18.611308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c80e6-534f-4f13-bfd6-911c20922611 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:18.611676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c80e6-534f-4f13-bfd6-911c20922611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:18.621095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c80e6-534f-4f13-bfd6-911c20922611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:18.622608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c80e6-534f-4f13-bfd6-911c20922611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:18.625015 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c80e6-534f-4f13-bfd6-911c20922611 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:18.656315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 996/2007] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:18.660578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52316614-1b22-4030-abbb-8c8fc8dfedea admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:18.675526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52316614-1b22-4030-abbb-8c8fc8dfedea admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:18.680883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346df30f-f468-4f1c-a9b5-853f69bea0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:18.681565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346df30f-f468-4f1c-a9b5-853f69bea0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:18.681848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346df30f-f468-4f1c-a9b5-853f69bea0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:18.682126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346df30f-f468-4f1c-a9b5-853f69bea0e9 admin admin] PATH_INFO: `/v3/projects/c25349ee2cc943e39d6541cab7a9d6ac/users/7fba7da879ef437abaa1eb5369c08c65/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:18.708911 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346df30f-f468-4f1c-a9b5-853f69bea0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25349ee2cc943e39d6541cab7a9d6ac, user_id=7fba7da879ef437abaa1eb5369c08c65, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:18.712543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346df30f-f468-4f1c-a9b5-853f69bea0e9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:18.758399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1012/2008] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:18 2022] PUT /identity/v3/projects/c25349ee2cc943e39d6541cab7a9d6ac/users/7fba7da879ef437abaa1eb5369c08c65/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:18.765456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a7206-91a3-4e39-9e9e-30a885a79d5e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:18.766745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a7206-91a3-4e39-9e9e-30a885a79d5e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:18.767242 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a7206-91a3-4e39-9e9e-30a885a79d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:18.821210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-881a7206-91a3-4e39-9e9e-30a885a79d5e None None] MFA Rules not processed for user `7fba7da879ef437abaa1eb5369c08c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:18.822783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-881a7206-91a3-4e39-9e9e-30a885a79d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:18.897583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 997/2009] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:18.899012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346df30f-f468-4f1c-a9b5-853f69bea0e9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:18.962625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:18.975134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346df30f-f468-4f1c-a9b5-853f69bea0e9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:18.981626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab21e8-4ccd-411f-8479-a5c991ba93a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:18.982607 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab21e8-4ccd-411f-8479-a5c991ba93a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:18.983207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab21e8-4ccd-411f-8479-a5c991ba93a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:18.983568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab21e8-4ccd-411f-8479-a5c991ba93a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:18.984370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab21e8-4ccd-411f-8479-a5c991ba93a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:18.986486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab21e8-4ccd-411f-8479-a5c991ba93a9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:19.031978 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1013/2010] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:18 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:19.036241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a7206-91a3-4e39-9e9e-30a885a79d5e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:19.057259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a7206-91a3-4e39-9e9e-30a885a79d5e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:19.130598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ff888-8864-42e7-9eb2-f9b28c16af5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:19.131226 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ff888-8864-42e7-9eb2-f9b28c16af5a admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:19.131504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ff888-8864-42e7-9eb2-f9b28c16af5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:19.131815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ff888-8864-42e7-9eb2-f9b28c16af5a admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:19.132526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ff888-8864-42e7-9eb2-f9b28c16af5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:19.134711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ff888-8864-42e7-9eb2-f9b28c16af5a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:19.159463 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 998/2011] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:19 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:19.163127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab21e8-4ccd-411f-8479-a5c991ba93a9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:19.174324 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab21e8-4ccd-411f-8479-a5c991ba93a9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:19.180166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c190-78ec-4e61-9a65-85a9f540e4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:19.180835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c190-78ec-4e61-9a65-85a9f540e4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:19.181112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c190-78ec-4e61-9a65-85a9f540e4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:19.181383 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c190-78ec-4e61-9a65-85a9f540e4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:19.182091 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081c190-78ec-4e61-9a65-85a9f540e4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:19.184015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081c190-78ec-4e61-9a65-85a9f540e4c1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:19.195629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1014/2012] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:19.199893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ff888-8864-42e7-9eb2-f9b28c16af5a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:19.210895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ff888-8864-42e7-9eb2-f9b28c16af5a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:19.216149 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861da32-d3e1-45bc-9f7e-800158f7ca3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:19.217023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861da32-d3e1-45bc-9f7e-800158f7ca3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:19.217416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861da32-d3e1-45bc-9f7e-800158f7ca3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:19.217788 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861da32-d3e1-45bc-9f7e-800158f7ca3e admin admin] PATH_INFO: `/v3/projects/ccda46b4e08642d093d2c2759f512125/users/236169f5201c4ba5b9b44d1e179b2d6b/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:19.234134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861da32-d3e1-45bc-9f7e-800158f7ca3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccda46b4e08642d093d2c2759f512125, user_id=236169f5201c4ba5b9b44d1e179b2d6b, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:19.236987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861da32-d3e1-45bc-9f7e-800158f7ca3e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:19.252540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 999/2013] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:19 2022] PUT /identity/v3/projects/ccda46b4e08642d093d2c2759f512125/users/236169f5201c4ba5b9b44d1e179b2d6b/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:19.256606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c190-78ec-4e61-9a65-85a9f540e4c1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:19.267938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c190-78ec-4e61-9a65-85a9f540e4c1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:19.338278 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d18e0-03b1-4b60-98b8-73e2739adf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:19.338905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d18e0-03b1-4b60-98b8-73e2739adf03 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:19.339188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d18e0-03b1-4b60-98b8-73e2739adf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:19.339449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d18e0-03b1-4b60-98b8-73e2739adf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:19.340094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d18e0-03b1-4b60-98b8-73e2739adf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:19.342185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d18e0-03b1-4b60-98b8-73e2739adf03 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:19.357011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1015/2014] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:19.361491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861da32-d3e1-45bc-9f7e-800158f7ca3e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:19.372722 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861da32-d3e1-45bc-9f7e-800158f7ca3e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:19.377704 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3d5ac-6e23-4ad3-94d4-b3341d684f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:19.378697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3d5ac-6e23-4ad3-94d4-b3341d684f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:19.378938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3d5ac-6e23-4ad3-94d4-b3341d684f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:19.379271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3d5ac-6e23-4ad3-94d4-b3341d684f2c admin admin] PATH_INFO: `/v3/projects/ccda46b4e08642d093d2c2759f512125/users/236169f5201c4ba5b9b44d1e179b2d6b/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:19.381276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3d5ac-6e23-4ad3-94d4-b3341d684f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccda46b4e08642d093d2c2759f512125, user_id=236169f5201c4ba5b9b44d1e179b2d6b, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:19.384011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3d5ac-6e23-4ad3-94d4-b3341d684f2c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:19.392551 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:19.400549 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1000/2015] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:19 2022] PUT /identity/v3/projects/ccda46b4e08642d093d2c2759f512125/users/236169f5201c4ba5b9b44d1e179b2d6b/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:19.421246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d60f4-61c1-46c5-92f6-5503a897d174 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:19.421447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d60f4-61c1-46c5-92f6-5503a897d174 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:19.421688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d60f4-61c1-46c5-92f6-5503a897d174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:19.451862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3a2d60f4-61c1-46c5-92f6-5503a897d174 None None] MFA Rules not processed for user `236169f5201c4ba5b9b44d1e179b2d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:19.453131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3a2d60f4-61c1-46c5-92f6-5503a897d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:19.541812 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1016/2016] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:19.554019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3d5ac-6e23-4ad3-94d4-b3341d684f2c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:19.556708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-32d3d5ac-6e23-4ad3-94d4-b3341d684f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:19.657184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3d5ac-6e23-4ad3-94d4-b3341d684f2c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:19.663374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ea2ad-dbe0-4788-88e8-64003b7cf4b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:19.664029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ea2ad-dbe0-4788-88e8-64003b7cf4b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:19.664320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ea2ad-dbe0-4788-88e8-64003b7cf4b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:19.664668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ea2ad-dbe0-4788-88e8-64003b7cf4b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:19.675879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ea2ad-dbe0-4788-88e8-64003b7cf4b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:19.677325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ea2ad-dbe0-4788-88e8-64003b7cf4b3 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:19.689868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1001/2017] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:19.721894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d60f4-61c1-46c5-92f6-5503a897d174 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:19.823904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:19.843024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d60f4-61c1-46c5-92f6-5503a897d174 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:19.848155 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:19.849011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:19.849462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:19.850004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] PATH_INFO: `/v3/users/7fba7da879ef437abaa1eb5369c08c65` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:19.851444 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fba7da879ef437abaa1eb5369c08c65)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:19.853987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:19.931108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fba7da879ef437abaa1eb5369c08c65'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:19.931748 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fba7da879ef437abaa1eb5369c08c65'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:19.945404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fba7da879ef437abaa1eb5369c08c65'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:19.969773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fba7da879ef437abaa1eb5369c08c65'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:19.970595 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fba7da879ef437abaa1eb5369c08c65'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:20.015471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1017/2018] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:19 2022] DELETE /identity/v3/users/7fba7da879ef437abaa1eb5369c08c65 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:20.020208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beadbff-8f91-4148-88fc-c54f21f72512 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:20.020590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beadbff-8f91-4148-88fc-c54f21f72512 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:20.020871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beadbff-8f91-4148-88fc-c54f21f72512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:20.056717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3beadbff-8f91-4148-88fc-c54f21f72512 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:20.058110 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3beadbff-8f91-4148-88fc-c54f21f72512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:20.159491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1002/2019] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:20.170002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:20.172055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:20.241212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7e18b-b55a-45e9-89fe-da7c33a8d90b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:20.245535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2034b84-1987-42f3-9c2d-66b9a4307b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:20.247474 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2034b84-1987-42f3-9c2d-66b9a4307b6a service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:20.247840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2034b84-1987-42f3-9c2d-66b9a4307b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:20.248040 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2034b84-1987-42f3-9c2d-66b9a4307b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:20.260679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2034b84-1987-42f3-9c2d-66b9a4307b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:20.262561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2034b84-1987-42f3-9c2d-66b9a4307b6a service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:20.279047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1018/2020] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:21.399259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beadbff-8f91-4148-88fc-c54f21f72512 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:21.401653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3beadbff-8f91-4148-88fc-c54f21f72512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:21.422554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beadbff-8f91-4148-88fc-c54f21f72512 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:21.438545 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:21.440044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:21.442030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:21.442541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] PATH_INFO: `/v3/projects/c25349ee2cc943e39d6541cab7a9d6ac` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:21.445479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25349ee2cc943e39d6541cab7a9d6ac)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:21.449819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:21.520057 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25349ee2cc943e39d6541cab7a9d6ac', 'request_id': 'req-f4923511-39af-4706-babd-ce730b88405a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:21.532466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25349ee2cc943e39d6541cab7a9d6ac', 'request_id': 'req-f4923511-39af-4706-babd-ce730b88405a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:21.548903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25349ee2cc943e39d6541cab7a9d6ac', 'request_id': 'req-f4923511-39af-4706-babd-ce730b88405a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:21.595522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] The token cache is being invalidate because project c25349ee2cc943e39d6541cab7a9d6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:21.595522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:21.595522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:21.597520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1003/2021] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:21 2022] DELETE /identity/v3/projects/c25349ee2cc943e39d6541cab7a9d6ac => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:21.598523 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2034b84-1987-42f3-9c2d-66b9a4307b6a service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:21.617282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2034b84-1987-42f3-9c2d-66b9a4307b6a service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:21.826610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9e4d-1133-403d-87a0-7eea6c5b1003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:21.827360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9e4d-1133-403d-87a0-7eea6c5b1003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:21.827635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9e4d-1133-403d-87a0-7eea6c5b1003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:21.832552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9e4d-1133-403d-87a0-7eea6c5b1003 admin admin] PATH_INFO: `/v3/users/236169f5201c4ba5b9b44d1e179b2d6b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:21.835572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf9e4d-1133-403d-87a0-7eea6c5b1003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236169f5201c4ba5b9b44d1e179b2d6b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:21.852226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf9e4d-1133-403d-87a0-7eea6c5b1003 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:21.873591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:21.939211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fbcf9e4d-1133-403d-87a0-7eea6c5b1003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236169f5201c4ba5b9b44d1e179b2d6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:21.940004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fbcf9e4d-1133-403d-87a0-7eea6c5b1003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236169f5201c4ba5b9b44d1e179b2d6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:21.955166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fbcf9e4d-1133-403d-87a0-7eea6c5b1003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236169f5201c4ba5b9b44d1e179b2d6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:21.965205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fbcf9e4d-1133-403d-87a0-7eea6c5b1003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236169f5201c4ba5b9b44d1e179b2d6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:21.966108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fbcf9e4d-1133-403d-87a0-7eea6c5b1003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236169f5201c4ba5b9b44d1e179b2d6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:21.995971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1019/2022] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:21 2022] DELETE /identity/v3/users/236169f5201c4ba5b9b44d1e179b2d6b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:22.517333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:22.519946 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:22.535169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4923511-39af-4706-babd-ce730b88405a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:22.564154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:22.598041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:22.598827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:22.599211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:22.599696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4 admin admin] PATH_INFO: `/v3/projects/ccda46b4e08642d093d2c2759f512125` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:22.600914 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccda46b4e08642d093d2c2759f512125)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:22.602876 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:22.656480 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccda46b4e08642d093d2c2759f512125', 'request_id': 'req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:22.662693 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccda46b4e08642d093d2c2759f512125', 'request_id': 'req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:22.671543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccda46b4e08642d093d2c2759f512125', 'request_id': 'req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:22.682255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4 admin admin] The token cache is being invalidate because project ccda46b4e08642d093d2c2759f512125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:22.682552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:22.683200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e7a9d9b6-560e-4c50-98c1-241e2dda8bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:22.684755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1004/2023] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:22 2022] DELETE /identity/v3/projects/ccda46b4e08642d093d2c2759f512125 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:22.689814 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142420f-0665-4c3c-b355-35cd9de610a0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:22.690300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142420f-0665-4c3c-b355-35cd9de610a0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:22.690391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142420f-0665-4c3c-b355-35cd9de610a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:22.714119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8142420f-0665-4c3c-b355-35cd9de610a0 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:22.715467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8142420f-0665-4c3c-b355-35cd9de610a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:22.785161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1020/2024] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:22.793130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ba75d-1b6e-4a4c-8995-f0481fd4f22b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:22.793744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ba75d-1b6e-4a4c-8995-f0481fd4f22b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:22.794171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ba75d-1b6e-4a4c-8995-f0481fd4f22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:22.829996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142420f-0665-4c3c-b355-35cd9de610a0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:22.831899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8142420f-0665-4c3c-b355-35cd9de610a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:22.832195 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-441ba75d-1b6e-4a4c-8995-f0481fd4f22b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:22.833474 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-441ba75d-1b6e-4a4c-8995-f0481fd4f22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:22.844406 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1005/2025] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:22.847689 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ba75d-1b6e-4a4c-8995-f0481fd4f22b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:22.873310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ba75d-1b6e-4a4c-8995-f0481fd4f22b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:22.887123 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb9c50-8592-4c0b-b1e3-8b3ac62b9320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:22.887768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb9c50-8592-4c0b-b1e3-8b3ac62b9320 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:22.888050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb9c50-8592-4c0b-b1e3-8b3ac62b9320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:22.888342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb9c50-8592-4c0b-b1e3-8b3ac62b9320 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:22.889090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb9c50-8592-4c0b-b1e3-8b3ac62b9320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:22.889404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb9c50-8592-4c0b-b1e3-8b3ac62b9320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:22.891332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb9c50-8592-4c0b-b1e3-8b3ac62b9320 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:22.915197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142420f-0665-4c3c-b355-35cd9de610a0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:22.918326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1006/2026] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:22.919974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c59a4a-6f5b-42df-8da5-00b3c21e8763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:22.920684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c59a4a-6f5b-42df-8da5-00b3c21e8763 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:22.920983 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c59a4a-6f5b-42df-8da5-00b3c21e8763 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:22.921229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c59a4a-6f5b-42df-8da5-00b3c21e8763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:22.924228 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb9c50-8592-4c0b-b1e3-8b3ac62b9320 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:22.932873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f8c59a4a-6f5b-42df-8da5-00b3c21e8763 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:22.940169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb9c50-8592-4c0b-b1e3-8b3ac62b9320 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:22.947712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e48cf-fb26-4585-bb29-efbbbf9610a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:22.948371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e48cf-fb26-4585-bb29-efbbbf9610a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:22.948651 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e48cf-fb26-4585-bb29-efbbbf9610a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:22.948920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e48cf-fb26-4585-bb29-efbbbf9610a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:22.949563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e48cf-fb26-4585-bb29-efbbbf9610a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:22.951618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e48cf-fb26-4585-bb29-efbbbf9610a6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:23.011079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1007/2027] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:22 2022] POST /identity/v3/projects => generated 393 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:23.015175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e48cf-fb26-4585-bb29-efbbbf9610a6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:23.026022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:23.071840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c59a4a-6f5b-42df-8da5-00b3c21e8763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:23.073718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c59a4a-6f5b-42df-8da5-00b3c21e8763 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:23.095723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1021/2028] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:13:23.168420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c59a4a-6f5b-42df-8da5-00b3c21e8763 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:23.170392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f8c59a4a-6f5b-42df-8da5-00b3c21e8763 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:23.183098 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e48cf-fb26-4585-bb29-efbbbf9610a6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:23.187656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c59a4a-6f5b-42df-8da5-00b3c21e8763 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:23.190165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1622f-d5e4-4606-9acd-5d51f1864f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:23.191267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1622f-d5e4-4606-9acd-5d51f1864f3e admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:23.192456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1622f-d5e4-4606-9acd-5d51f1864f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:23.192910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1622f-d5e4-4606-9acd-5d51f1864f3e admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:23.193073 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf246f47-b3d6-4c09-9d10-c9bb8c7c6e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:23.193970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf246f47-b3d6-4c09-9d10-c9bb8c7c6e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:23.194412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf246f47-b3d6-4c09-9d10-c9bb8c7c6e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:23.194525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1622f-d5e4-4606-9acd-5d51f1864f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:23.194925 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf246f47-b3d6-4c09-9d10-c9bb8c7c6e03 admin admin] PATH_INFO: `/v3/users/4e2039c4cd354889b63b2d3ddbf8f1ff` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:23.196436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf246f47-b3d6-4c09-9d10-c9bb8c7c6e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2039c4cd354889b63b2d3ddbf8f1ff)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:23.197607 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1622f-d5e4-4606-9acd-5d51f1864f3e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:23.198567 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf246f47-b3d6-4c09-9d10-c9bb8c7c6e03 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:23.240271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1008/2029] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:23 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:23.242619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1622f-d5e4-4606-9acd-5d51f1864f3e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:23.249434 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:23.253589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1622f-d5e4-4606-9acd-5d51f1864f3e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:23.258906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced0564-3929-43db-b398-254fff06280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:23.259718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced0564-3929-43db-b398-254fff06280a admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:23.260137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced0564-3929-43db-b398-254fff06280a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:23.260596 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced0564-3929-43db-b398-254fff06280a admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:23.261844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced0564-3929-43db-b398-254fff06280a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:23.264059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced0564-3929-43db-b398-254fff06280a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:23.279170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1009/2030] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:23.280486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced0564-3929-43db-b398-254fff06280a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:23.291450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced0564-3929-43db-b398-254fff06280a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:23.297315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b4333-2f89-4f43-a6a2-8f0e85d2e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:23.297940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b4333-2f89-4f43-a6a2-8f0e85d2e45a admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:23.298209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b4333-2f89-4f43-a6a2-8f0e85d2e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:23.298474 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b4333-2f89-4f43-a6a2-8f0e85d2e45a admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:23.299130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b4333-2f89-4f43-a6a2-8f0e85d2e45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:23.300829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b4333-2f89-4f43-a6a2-8f0e85d2e45a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:23.308887 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cf246f47-b3d6-4c09-9d10-c9bb8c7c6e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2039c4cd354889b63b2d3ddbf8f1ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:23.310565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cf246f47-b3d6-4c09-9d10-c9bb8c7c6e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2039c4cd354889b63b2d3ddbf8f1ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:23.315063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1010/2031] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:23.319476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b4333-2f89-4f43-a6a2-8f0e85d2e45a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:23.321643 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-709b4333-2f89-4f43-a6a2-8f0e85d2e45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:23.331018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cf246f47-b3d6-4c09-9d10-c9bb8c7c6e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2039c4cd354889b63b2d3ddbf8f1ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:23.336600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b4333-2f89-4f43-a6a2-8f0e85d2e45a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:23.341895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50432736-a250-4157-8133-6f74ccd7d58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:23.342773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50432736-a250-4157-8133-6f74ccd7d58d admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:23.343095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50432736-a250-4157-8133-6f74ccd7d58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:23.344396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50432736-a250-4157-8133-6f74ccd7d58d admin admin] PATH_INFO: `/v3/projects/d3a24a3056624eea93eb42961ec65d8c/users/c897fc86f67a41a78f1515697cabd0ee/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:23.352741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cf246f47-b3d6-4c09-9d10-c9bb8c7c6e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2039c4cd354889b63b2d3ddbf8f1ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:23.353841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cf246f47-b3d6-4c09-9d10-c9bb8c7c6e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2039c4cd354889b63b2d3ddbf8f1ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:23.363344 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50432736-a250-4157-8133-6f74ccd7d58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a24a3056624eea93eb42961ec65d8c, user_id=c897fc86f67a41a78f1515697cabd0ee, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:23.367708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50432736-a250-4157-8133-6f74ccd7d58d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:23.386040 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1022/2032] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:23 2022] DELETE /identity/v3/users/4e2039c4cd354889b63b2d3ddbf8f1ff => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:23.391086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd666c-5fcd-4382-afac-54df79e55e15 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:23.391888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd666c-5fcd-4382-afac-54df79e55e15 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:23.392375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd666c-5fcd-4382-afac-54df79e55e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:23.398590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1011/2033] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:23 2022] PUT /identity/v3/projects/d3a24a3056624eea93eb42961ec65d8c/users/c897fc86f67a41a78f1515697cabd0ee/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:23.410305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5862d1a-7f4e-429b-8040-6e3832bcb996 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:23.411186 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5862d1a-7f4e-429b-8040-6e3832bcb996 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:23.411539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5862d1a-7f4e-429b-8040-6e3832bcb996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:23.430348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-04cd666c-5fcd-4382-afac-54df79e55e15 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:23.432203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-04cd666c-5fcd-4382-afac-54df79e55e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:23.447500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d5862d1a-7f4e-429b-8040-6e3832bcb996 None None] MFA Rules not processed for user `c897fc86f67a41a78f1515697cabd0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:23.449015 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d5862d1a-7f4e-429b-8040-6e3832bcb996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:23.518527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1023/2034] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:23.531599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd666c-5fcd-4382-afac-54df79e55e15 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:23.537260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-04cd666c-5fcd-4382-afac-54df79e55e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:23.594612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1012/2035] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:23.596268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5862d1a-7f4e-429b-8040-6e3832bcb996 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:23.613146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5862d1a-7f4e-429b-8040-6e3832bcb996 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:23.621108 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f81d-1636-4fd3-923f-2575e49ea816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:23.621648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f81d-1636-4fd3-923f-2575e49ea816 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:23.621924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f81d-1636-4fd3-923f-2575e49ea816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:23.622742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f81d-1636-4fd3-923f-2575e49ea816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:23.622869 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9f81d-1636-4fd3-923f-2575e49ea816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:23.626074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9f81d-1636-4fd3-923f-2575e49ea816 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:23.677481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd666c-5fcd-4382-afac-54df79e55e15 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:23.685392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1013/2036] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:23 2022] POST /identity/v3/projects => generated 393 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:23.686261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62c053-f795-4c9b-8d1f-c56be3807e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:23.686927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62c053-f795-4c9b-8d1f-c56be3807e00 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:23.687200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62c053-f795-4c9b-8d1f-c56be3807e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:23.688208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f81d-1636-4fd3-923f-2575e49ea816 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:23.688834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62c053-f795-4c9b-8d1f-c56be3807e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:23.701166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:23.705922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62c053-f795-4c9b-8d1f-c56be3807e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:23.708017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62c053-f795-4c9b-8d1f-c56be3807e00 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:23.724196 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1024/2037] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:23.802247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f81d-1636-4fd3-923f-2575e49ea816 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:23.811322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd68c1-ff88-4643-a9b1-9f5ec747015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:23.812454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd68c1-ff88-4643-a9b1-9f5ec747015f admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:23.812867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd68c1-ff88-4643-a9b1-9f5ec747015f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:23.813276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd68c1-ff88-4643-a9b1-9f5ec747015f admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:23.814060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd68c1-ff88-4643-a9b1-9f5ec747015f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:23.816578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd68c1-ff88-4643-a9b1-9f5ec747015f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:23.840809 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1014/2038] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:23 2022] POST /identity/v3/users => generated 303 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:23.845199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62c053-f795-4c9b-8d1f-c56be3807e00 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:23.855887 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62c053-f795-4c9b-8d1f-c56be3807e00 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:23.861603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564e4d1-389e-410d-bf38-a214dce631fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:23.862262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564e4d1-389e-410d-bf38-a214dce631fb admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:23.862681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564e4d1-389e-410d-bf38-a214dce631fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:23.862960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564e4d1-389e-410d-bf38-a214dce631fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:23.864225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564e4d1-389e-410d-bf38-a214dce631fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:23.865979 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564e4d1-389e-410d-bf38-a214dce631fb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:23.876863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1025/2039] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:23.881080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd68c1-ff88-4643-a9b1-9f5ec747015f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:23.892517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd68c1-ff88-4643-a9b1-9f5ec747015f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:23.898468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82f3ab-e431-41d5-ac1a-f9ab0f2836c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:23.899217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82f3ab-e431-41d5-ac1a-f9ab0f2836c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:23.899558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82f3ab-e431-41d5-ac1a-f9ab0f2836c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:23.899912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82f3ab-e431-41d5-ac1a-f9ab0f2836c0 admin admin] PATH_INFO: `/v3/projects/d77468256c4c442d8270a470df9e21e6/users/e78f01b881a745a2ad517106961ba7bf/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:23.912985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:23.916134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82f3ab-e431-41d5-ac1a-f9ab0f2836c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77468256c4c442d8270a470df9e21e6, user_id=e78f01b881a745a2ad517106961ba7bf, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:23.919008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82f3ab-e431-41d5-ac1a-f9ab0f2836c0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:23.939772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1015/2040] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:23 2022] PUT /identity/v3/projects/d77468256c4c442d8270a470df9e21e6/users/e78f01b881a745a2ad517106961ba7bf/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:23.943596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564e4d1-389e-410d-bf38-a214dce631fb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:23.956110 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564e4d1-389e-410d-bf38-a214dce631fb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:24.026788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548e2d7-809e-4fe5-9156-e987d3a20695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:24.027412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548e2d7-809e-4fe5-9156-e987d3a20695 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:24.027686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548e2d7-809e-4fe5-9156-e987d3a20695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:24.027955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548e2d7-809e-4fe5-9156-e987d3a20695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:24.028641 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548e2d7-809e-4fe5-9156-e987d3a20695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:24.030548 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548e2d7-809e-4fe5-9156-e987d3a20695 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:24.044574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1026/2041] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:24.045525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82f3ab-e431-41d5-ac1a-f9ab0f2836c0 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:24.056625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82f3ab-e431-41d5-ac1a-f9ab0f2836c0 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:24.061248 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77fc9e-a69b-4416-abe5-3e02bc63098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:24.061936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77fc9e-a69b-4416-abe5-3e02bc63098d admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:24.062212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77fc9e-a69b-4416-abe5-3e02bc63098d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:24.062610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77fc9e-a69b-4416-abe5-3e02bc63098d admin admin] PATH_INFO: `/v3/projects/d77468256c4c442d8270a470df9e21e6/users/e78f01b881a745a2ad517106961ba7bf/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:24.064507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77fc9e-a69b-4416-abe5-3e02bc63098d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77468256c4c442d8270a470df9e21e6, user_id=e78f01b881a745a2ad517106961ba7bf, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:24.067215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77fc9e-a69b-4416-abe5-3e02bc63098d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:24.078239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1016/2042] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:24 2022] PUT /identity/v3/projects/d77468256c4c442d8270a470df9e21e6/users/e78f01b881a745a2ad517106961ba7bf/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:24.089285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29fe0b-b9cc-471a-9ca3-a3ed8311ace1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:24.089575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29fe0b-b9cc-471a-9ca3-a3ed8311ace1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:24.089853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29fe0b-b9cc-471a-9ca3-a3ed8311ace1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:24.121302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-cd29fe0b-b9cc-471a-9ca3-a3ed8311ace1 None None] MFA Rules not processed for user `e78f01b881a745a2ad517106961ba7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:24.122518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cd29fe0b-b9cc-471a-9ca3-a3ed8311ace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:24.128016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77fc9e-a69b-4416-abe5-3e02bc63098d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:24.135009 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1a77fc9e-a69b-4416-abe5-3e02bc63098d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:24.210266 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1027/2043] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:24.210577 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77fc9e-a69b-4416-abe5-3e02bc63098d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:24.215594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:24.216161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:24.216424 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:24.216701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] PATH_INFO: `/v3/projects/61949c95ba1643918210245f45235f82` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:24.217879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61949c95ba1643918210245f45235f82)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:24.219844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:24.223256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29fe0b-b9cc-471a-9ca3-a3ed8311ace1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:24.225737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cd29fe0b-b9cc-471a-9ca3-a3ed8311ace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:24.280668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61949c95ba1643918210245f45235f82', 'request_id': 'req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:24.288097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61949c95ba1643918210245f45235f82', 'request_id': 'req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:24.293103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29fe0b-b9cc-471a-9ca3-a3ed8311ace1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:24.298003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61949c95ba1643918210245f45235f82', 'request_id': 'req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:24.313445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] The token cache is being invalidate because project 61949c95ba1643918210245f45235f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:24.314254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:24.314977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:24.317008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1017/2044] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:24 2022] DELETE /identity/v3/projects/61949c95ba1643918210245f45235f82 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:24.320750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:24.322628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:24.328741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:24.348388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f89b6-b9db-4c7d-93d1-9a09369874bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:24.349167 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f89b6-b9db-4c7d-93d1-9a09369874bc service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:24.349445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f89b6-b9db-4c7d-93d1-9a09369874bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:24.349715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f89b6-b9db-4c7d-93d1-9a09369874bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:24.351476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-996f89b6-b9db-4c7d-93d1-9a09369874bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:24.387697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c38842-0a4f-4f81-ba2a-cadd5986b4b1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:24.392450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:24.393089 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:24.393364 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:24.393637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] PATH_INFO: `/v3/users/305ff36ddb70490088444aaadec1fa41` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:24.394758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=305ff36ddb70490088444aaadec1fa41)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:24.396749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:24.408866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:24.419286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f89b6-b9db-4c7d-93d1-9a09369874bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:24.421690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f89b6-b9db-4c7d-93d1-9a09369874bc service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:24.432263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1028/2045] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:24.456600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '305ff36ddb70490088444aaadec1fa41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:24.457719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '305ff36ddb70490088444aaadec1fa41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:24.468856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '305ff36ddb70490088444aaadec1fa41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:24.469606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '305ff36ddb70490088444aaadec1fa41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:24.490075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '305ff36ddb70490088444aaadec1fa41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:24.493893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f89b6-b9db-4c7d-93d1-9a09369874bc service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:24.496085 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-996f89b6-b9db-4c7d-93d1-9a09369874bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:24.508018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1018/2046] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:24 2022] DELETE /identity/v3/users/305ff36ddb70490088444aaadec1fa41 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:24.508418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f89b6-b9db-4c7d-93d1-9a09369874bc service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:24.570944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83985a-a46f-4284-b13b-fe3f7bee4a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:24.571621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83985a-a46f-4284-b13b-fe3f7bee4a4e service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:24.571946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83985a-a46f-4284-b13b-fe3f7bee4a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:24.572339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83985a-a46f-4284-b13b-fe3f7bee4a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:24.575108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1a83985a-a46f-4284-b13b-fe3f7bee4a4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:24.645743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83985a-a46f-4284-b13b-fe3f7bee4a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:24.647305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83985a-a46f-4284-b13b-fe3f7bee4a4e service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:24.657943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1029/2047] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:25.029747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:25.032674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:25.155341 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25b98b-1b0d-4305-a9f5-bb216d75da90 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:25.165541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6e3d2-fd56-42f3-8752-e488aeeb2488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:25.166221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6e3d2-fd56-42f3-8752-e488aeeb2488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:25.166503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6e3d2-fd56-42f3-8752-e488aeeb2488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:25.167088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6e3d2-fd56-42f3-8752-e488aeeb2488 admin admin] PATH_INFO: `/v3/projects/765be366272840ea8e4190d39abdd8fa` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:25.168393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6e3d2-fd56-42f3-8752-e488aeeb2488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765be366272840ea8e4190d39abdd8fa)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:25.170505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6e3d2-fd56-42f3-8752-e488aeeb2488 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:25.221304 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-75c6e3d2-fd56-42f3-8752-e488aeeb2488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765be366272840ea8e4190d39abdd8fa', 'request_id': 'req-75c6e3d2-fd56-42f3-8752-e488aeeb2488'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:25.227916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-75c6e3d2-fd56-42f3-8752-e488aeeb2488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765be366272840ea8e4190d39abdd8fa', 'request_id': 'req-75c6e3d2-fd56-42f3-8752-e488aeeb2488'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:25.237411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-75c6e3d2-fd56-42f3-8752-e488aeeb2488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765be366272840ea8e4190d39abdd8fa', 'request_id': 'req-75c6e3d2-fd56-42f3-8752-e488aeeb2488'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:25.247882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-75c6e3d2-fd56-42f3-8752-e488aeeb2488 admin admin] The token cache is being invalidate because project 765be366272840ea8e4190d39abdd8fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:25.248205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-75c6e3d2-fd56-42f3-8752-e488aeeb2488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:25.248876 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-75c6e3d2-fd56-42f3-8752-e488aeeb2488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:25.250391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1019/2048] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:25 2022] DELETE /identity/v3/projects/765be366272840ea8e4190d39abdd8fa => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:25.255401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8d9fc-99b5-4b3d-bd63-71796bff72da None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:25.255902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8d9fc-99b5-4b3d-bd63-71796bff72da None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:25.255996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8d9fc-99b5-4b3d-bd63-71796bff72da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:25.276315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5bb8d9fc-99b5-4b3d-bd63-71796bff72da None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:25.277513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5bb8d9fc-99b5-4b3d-bd63-71796bff72da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:25.299648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:25.344392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1030/2049] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:25.352701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f67f54-60a9-48d5-b02d-6dbe2ac8a371 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:25.352989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f67f54-60a9-48d5-b02d-6dbe2ac8a371 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:25.353281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f67f54-60a9-48d5-b02d-6dbe2ac8a371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:25.376510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d3f67f54-60a9-48d5-b02d-6dbe2ac8a371 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:25.377745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d3f67f54-60a9-48d5-b02d-6dbe2ac8a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:25.386533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1020/2050] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:25.391540 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8d9fc-99b5-4b3d-bd63-71796bff72da None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:25.403507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8d9fc-99b5-4b3d-bd63-71796bff72da None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:25.408872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aa9e8-f388-443e-b282-24dca07e2c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:25.409428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aa9e8-f388-443e-b282-24dca07e2c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:25.409711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aa9e8-f388-443e-b282-24dca07e2c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:25.409985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aa9e8-f388-443e-b282-24dca07e2c82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:25.410645 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9aa9e8-f388-443e-b282-24dca07e2c82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:25.410950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9aa9e8-f388-443e-b282-24dca07e2c82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:25.413310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9aa9e8-f388-443e-b282-24dca07e2c82 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:25.426417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1031/2051] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:13:25.431268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f67f54-60a9-48d5-b02d-6dbe2ac8a371 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:25.443552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f67f54-60a9-48d5-b02d-6dbe2ac8a371 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:25.449717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89645531-a584-4e13-b03f-c6c884559aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:25.450334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89645531-a584-4e13-b03f-c6c884559aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:25.450629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89645531-a584-4e13-b03f-c6c884559aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:25.450983 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89645531-a584-4e13-b03f-c6c884559aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:25.452029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89645531-a584-4e13-b03f-c6c884559aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:25.454348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89645531-a584-4e13-b03f-c6c884559aa3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:25.465108 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:25.491351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1021/2052] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:25 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:25.493468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aa9e8-f388-443e-b282-24dca07e2c82 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:25.506313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aa9e8-f388-443e-b282-24dca07e2c82 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:25.571996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74213ae9-2d34-4af7-beb7-d71bf3f10a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:25.572647 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74213ae9-2d34-4af7-beb7-d71bf3f10a72 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:25.573054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74213ae9-2d34-4af7-beb7-d71bf3f10a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:25.573330 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74213ae9-2d34-4af7-beb7-d71bf3f10a72 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:25.574032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74213ae9-2d34-4af7-beb7-d71bf3f10a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:25.576131 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74213ae9-2d34-4af7-beb7-d71bf3f10a72 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:25.605314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1032/2053] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:25 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:25.606574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89645531-a584-4e13-b03f-c6c884559aa3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:25.619495 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89645531-a584-4e13-b03f-c6c884559aa3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:25.625929 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45536237-fa34-41d1-ad84-672786c2ec34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:25.626890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45536237-fa34-41d1-ad84-672786c2ec34 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:25.627373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45536237-fa34-41d1-ad84-672786c2ec34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:25.636335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45536237-fa34-41d1-ad84-672786c2ec34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:25.649001 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45536237-fa34-41d1-ad84-672786c2ec34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:25.650694 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45536237-fa34-41d1-ad84-672786c2ec34 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:25.663845 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1022/2054] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:25.668059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74213ae9-2d34-4af7-beb7-d71bf3f10a72 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:25.679709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74213ae9-2d34-4af7-beb7-d71bf3f10a72 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:25.686950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b60b88-b7e3-4d36-84f4-c01d880e61bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:25.687742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60b88-b7e3-4d36-84f4-c01d880e61bf admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:25.688054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60b88-b7e3-4d36-84f4-c01d880e61bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:25.688464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60b88-b7e3-4d36-84f4-c01d880e61bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:25.689491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b60b88-b7e3-4d36-84f4-c01d880e61bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:25.691341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b60b88-b7e3-4d36-84f4-c01d880e61bf admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:25.704579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1033/2055] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:25.708875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45536237-fa34-41d1-ad84-672786c2ec34 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:25.720701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45536237-fa34-41d1-ad84-672786c2ec34 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:25.725810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f00ca-4751-4d11-8856-2b1b490e3104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:25.726736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f00ca-4751-4d11-8856-2b1b490e3104 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:25.727211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f00ca-4751-4d11-8856-2b1b490e3104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:25.727700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f00ca-4751-4d11-8856-2b1b490e3104 admin admin] PATH_INFO: `/v3/projects/0af58531223344bfbce73f02790fd30d/users/7802d78fb84044baae2e90f10a70574a/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:25.744361 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f00ca-4751-4d11-8856-2b1b490e3104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af58531223344bfbce73f02790fd30d, user_id=7802d78fb84044baae2e90f10a70574a, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:25.747225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f00ca-4751-4d11-8856-2b1b490e3104 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:25.763069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1023/2056] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:25 2022] PUT /identity/v3/projects/0af58531223344bfbce73f02790fd30d/users/7802d78fb84044baae2e90f10a70574a/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:25.774108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444431ae-3caa-43ab-bd6a-80bc22ecc21b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:25.774396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444431ae-3caa-43ab-bd6a-80bc22ecc21b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:25.774665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444431ae-3caa-43ab-bd6a-80bc22ecc21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:25.803178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-444431ae-3caa-43ab-bd6a-80bc22ecc21b None None] MFA Rules not processed for user `7802d78fb84044baae2e90f10a70574a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:25.804431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-444431ae-3caa-43ab-bd6a-80bc22ecc21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:25.872354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1034/2057] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:25.877277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f00ca-4751-4d11-8856-2b1b490e3104 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:25.948429 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f00ca-4751-4d11-8856-2b1b490e3104 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:25.953871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daa0b3-974e-4c15-b4a8-6049986ea434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:25.954514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daa0b3-974e-4c15-b4a8-6049986ea434 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:25.954790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daa0b3-974e-4c15-b4a8-6049986ea434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:25.955099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daa0b3-974e-4c15-b4a8-6049986ea434 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:25.955726 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daa0b3-974e-4c15-b4a8-6049986ea434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:25.957746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daa0b3-974e-4c15-b4a8-6049986ea434 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:25.989505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1024/2058] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:25 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:25.994253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444431ae-3caa-43ab-bd6a-80bc22ecc21b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:26.006854 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444431ae-3caa-43ab-bd6a-80bc22ecc21b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:26.049270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:26.111161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af25c3-de5c-4bd5-825b-86098c16dc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:26.112408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af25c3-de5c-4bd5-825b-86098c16dc9d admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:26.112694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af25c3-de5c-4bd5-825b-86098c16dc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:26.113286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af25c3-de5c-4bd5-825b-86098c16dc9d admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:26.113998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af25c3-de5c-4bd5-825b-86098c16dc9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:26.116435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af25c3-de5c-4bd5-825b-86098c16dc9d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:26.162640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1035/2059] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:25 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:26.166935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daa0b3-974e-4c15-b4a8-6049986ea434 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:26.180464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daa0b3-974e-4c15-b4a8-6049986ea434 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:26.189561 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba02a3-9c7d-454d-bfe5-4b76bde7a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:26.190567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba02a3-9c7d-454d-bfe5-4b76bde7a537 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:26.191129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba02a3-9c7d-454d-bfe5-4b76bde7a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:26.191536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba02a3-9c7d-454d-bfe5-4b76bde7a537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:26.193224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba02a3-9c7d-454d-bfe5-4b76bde7a537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:26.195216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba02a3-9c7d-454d-bfe5-4b76bde7a537 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:26.212340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1025/2060] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:26.216502 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af25c3-de5c-4bd5-825b-86098c16dc9d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:26.230376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af25c3-de5c-4bd5-825b-86098c16dc9d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:26.237384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6554dac-49a6-477a-9375-39588fc254db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:26.238239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6554dac-49a6-477a-9375-39588fc254db admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:26.238515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6554dac-49a6-477a-9375-39588fc254db admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:26.238799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6554dac-49a6-477a-9375-39588fc254db admin admin] PATH_INFO: `/v3/projects/224f7dc044ea452e82d9e17ff3ce9ddb/users/086030a70f2644bc9c1464b62164e388/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:26.262277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6554dac-49a6-477a-9375-39588fc254db admin admin] RBAC: Authorizing `identity:create_grant(project_id=224f7dc044ea452e82d9e17ff3ce9ddb, user_id=086030a70f2644bc9c1464b62164e388, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:26.266028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6554dac-49a6-477a-9375-39588fc254db admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:26.291104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1036/2061] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:26 2022] PUT /identity/v3/projects/224f7dc044ea452e82d9e17ff3ce9ddb/users/086030a70f2644bc9c1464b62164e388/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:26.300183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba02a3-9c7d-454d-bfe5-4b76bde7a537 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:26.317391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba02a3-9c7d-454d-bfe5-4b76bde7a537 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:26.401050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516f192-07a5-4495-8a23-f5840df35832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:26.401694 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516f192-07a5-4495-8a23-f5840df35832 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:26.401979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516f192-07a5-4495-8a23-f5840df35832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:26.402253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516f192-07a5-4495-8a23-f5840df35832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:26.402898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516f192-07a5-4495-8a23-f5840df35832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:26.404925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516f192-07a5-4495-8a23-f5840df35832 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:26.436916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1026/2062] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:26.438049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6554dac-49a6-477a-9375-39588fc254db admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:26.451138 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6554dac-49a6-477a-9375-39588fc254db admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:26.456938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ed9e5-9ecb-4c0a-b46d-532ceb2a1c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:26.458536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ed9e5-9ecb-4c0a-b46d-532ceb2a1c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:26.459025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ed9e5-9ecb-4c0a-b46d-532ceb2a1c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:26.459398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ed9e5-9ecb-4c0a-b46d-532ceb2a1c3f admin admin] PATH_INFO: `/v3/projects/224f7dc044ea452e82d9e17ff3ce9ddb/users/086030a70f2644bc9c1464b62164e388/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:26.463058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ed9e5-9ecb-4c0a-b46d-532ceb2a1c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=224f7dc044ea452e82d9e17ff3ce9ddb, user_id=086030a70f2644bc9c1464b62164e388, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:26.468141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ed9e5-9ecb-4c0a-b46d-532ceb2a1c3f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:26.492355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1037/2063] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:26 2022] PUT /identity/v3/projects/224f7dc044ea452e82d9e17ff3ce9ddb/users/086030a70f2644bc9c1464b62164e388/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:26.496441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ab56d-1060-4550-b5a8-f1b78e7a2275 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:26.496768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ab56d-1060-4550-b5a8-f1b78e7a2275 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:26.496990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ab56d-1060-4550-b5a8-f1b78e7a2275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:26.549825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7a6ab56d-1060-4550-b5a8-f1b78e7a2275 None None] MFA Rules not processed for user `086030a70f2644bc9c1464b62164e388`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:26.554606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7a6ab56d-1060-4550-b5a8-f1b78e7a2275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:26.576414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:26.669284 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1027/2064] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:26.682921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ed9e5-9ecb-4c0a-b46d-532ceb2a1c3f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:26.685857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8d8ed9e5-9ecb-4c0a-b46d-532ceb2a1c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:26.784231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ed9e5-9ecb-4c0a-b46d-532ceb2a1c3f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:26.789348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525450-0d07-4eee-ae4e-a41c137e7db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:26.789995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525450-0d07-4eee-ae4e-a41c137e7db5 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:26.792621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525450-0d07-4eee-ae4e-a41c137e7db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:26.793103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525450-0d07-4eee-ae4e-a41c137e7db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:26.864544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa525450-0d07-4eee-ae4e-a41c137e7db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:26.866183 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa525450-0d07-4eee-ae4e-a41c137e7db5 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:26.876786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1038/2065] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:28.420095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ab56d-1060-4550-b5a8-f1b78e7a2275 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:28.431220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ab56d-1060-4550-b5a8-f1b78e7a2275 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:28.435359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499eb3e-f16f-4c89-9859-9ac34bb0883f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:28.436095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499eb3e-f16f-4c89-9859-9ac34bb0883f service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:28.436444 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499eb3e-f16f-4c89-9859-9ac34bb0883f service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:28.436840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499eb3e-f16f-4c89-9859-9ac34bb0883f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:28.450768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499eb3e-f16f-4c89-9859-9ac34bb0883f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:28.452876 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499eb3e-f16f-4c89-9859-9ac34bb0883f service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:28.469995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1028/2066] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:28.628277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525450-0d07-4eee-ae4e-a41c137e7db5 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:28.634778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fa525450-0d07-4eee-ae4e-a41c137e7db5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:28.679803 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:28.691489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499eb3e-f16f-4c89-9859-9ac34bb0883f service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:28.693597 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6499eb3e-f16f-4c89-9859-9ac34bb0883f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:28.774870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525450-0d07-4eee-ae4e-a41c137e7db5 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:28.781052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf2744-b767-4e1b-a0d8-f85dcdc8ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:28.792316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf2744-b767-4e1b-a0d8-f85dcdc8ef51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:28.792316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf2744-b767-4e1b-a0d8-f85dcdc8ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:28.792316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf2744-b767-4e1b-a0d8-f85dcdc8ef51 admin admin] PATH_INFO: `/v3/users/f400accbfcb8435b99757872c027cc74` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:28.792316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf2744-b767-4e1b-a0d8-f85dcdc8ef51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f400accbfcb8435b99757872c027cc74)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:28.792316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf2744-b767-4e1b-a0d8-f85dcdc8ef51 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:28.883279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499eb3e-f16f-4c89-9859-9ac34bb0883f service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:28.886815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-44bf2744-b767-4e1b-a0d8-f85dcdc8ef51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f400accbfcb8435b99757872c027cc74'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:28.887949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-44bf2744-b767-4e1b-a0d8-f85dcdc8ef51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f400accbfcb8435b99757872c027cc74'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:28.890863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba555496-8d76-448e-ba42-c220b1304df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:28.892064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555496-8d76-448e-ba42-c220b1304df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:28.892645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555496-8d76-448e-ba42-c220b1304df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:28.893148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555496-8d76-448e-ba42-c220b1304df6 admin admin] PATH_INFO: `/v3/users/c897fc86f67a41a78f1515697cabd0ee` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:28.895037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba555496-8d76-448e-ba42-c220b1304df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c897fc86f67a41a78f1515697cabd0ee)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:28.897753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba555496-8d76-448e-ba42-c220b1304df6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:28.919668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-44bf2744-b767-4e1b-a0d8-f85dcdc8ef51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f400accbfcb8435b99757872c027cc74'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:28.936326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-44bf2744-b767-4e1b-a0d8-f85dcdc8ef51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f400accbfcb8435b99757872c027cc74'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:28.938383 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-44bf2744-b767-4e1b-a0d8-f85dcdc8ef51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f400accbfcb8435b99757872c027cc74'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:28.972923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1039/2067] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:28 2022] DELETE /identity/v3/users/f400accbfcb8435b99757872c027cc74 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:28.976694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2389a9e-71a9-4571-8f2e-ebeafa1e82d3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:28.976694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2389a9e-71a9-4571-8f2e-ebeafa1e82d3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:28.977540 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2389a9e-71a9-4571-8f2e-ebeafa1e82d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:28.987857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ba555496-8d76-448e-ba42-c220b1304df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c897fc86f67a41a78f1515697cabd0ee'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:28.988924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ba555496-8d76-448e-ba42-c220b1304df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c897fc86f67a41a78f1515697cabd0ee'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:29.009375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d2389a9e-71a9-4571-8f2e-ebeafa1e82d3 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:29.010082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ba555496-8d76-448e-ba42-c220b1304df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c897fc86f67a41a78f1515697cabd0ee'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:29.010857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d2389a9e-71a9-4571-8f2e-ebeafa1e82d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:29.011921 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ba555496-8d76-448e-ba42-c220b1304df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c897fc86f67a41a78f1515697cabd0ee'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:29.044544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ba555496-8d76-448e-ba42-c220b1304df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c897fc86f67a41a78f1515697cabd0ee'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:29.070875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1029/2068] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:28 2022] DELETE /identity/v3/users/c897fc86f67a41a78f1515697cabd0ee => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:29.073817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b39600-04a2-465d-948f-e450782af842 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:29.074243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b39600-04a2-465d-948f-e450782af842 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:29.074614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b39600-04a2-465d-948f-e450782af842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:29.103871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c0b39600-04a2-465d-948f-e450782af842 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:29.103871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c0b39600-04a2-465d-948f-e450782af842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:29.118242 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:29.151314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1040/2069] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:29.162926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2389a9e-71a9-4571-8f2e-ebeafa1e82d3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:29.165012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d2389a9e-71a9-4571-8f2e-ebeafa1e82d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:29.204784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1030/2070] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:29.215047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b39600-04a2-465d-948f-e450782af842 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:29.217217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c0b39600-04a2-465d-948f-e450782af842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:29.263996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:29.269744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2389a9e-71a9-4571-8f2e-ebeafa1e82d3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:29.308997 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b39600-04a2-465d-948f-e450782af842 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:29.318379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf18a1-279c-499e-9a0c-5b76ac173329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:29.319199 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf18a1-279c-499e-9a0c-5b76ac173329 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:29.321313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf18a1-279c-499e-9a0c-5b76ac173329 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:29.322140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf18a1-279c-499e-9a0c-5b76ac173329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:29.345491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf18a1-279c-499e-9a0c-5b76ac173329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:29.348748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf18a1-279c-499e-9a0c-5b76ac173329 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:29.352121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaddea-c9c2-4f72-b948-0643e2825ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:29.352892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaddea-c9c2-4f72-b948-0643e2825ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:29.353297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaddea-c9c2-4f72-b948-0643e2825ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:29.353633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaddea-c9c2-4f72-b948-0643e2825ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:29.363333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1031/2071] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:29.374611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebaddea-c9c2-4f72-b948-0643e2825ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:29.376765 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebaddea-c9c2-4f72-b948-0643e2825ae1 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:29.412624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1041/2072] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:29.852911 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf18a1-279c-499e-9a0c-5b76ac173329 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:29.854683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-efcf18a1-279c-499e-9a0c-5b76ac173329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:29.880939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf18a1-279c-499e-9a0c-5b76ac173329 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:29.889405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:29.890408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:29.890691 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:29.890953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] PATH_INFO: `/v3/projects/d3a24a3056624eea93eb42961ec65d8c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:29.892236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a24a3056624eea93eb42961ec65d8c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:29.894312 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:29.906893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaddea-c9c2-4f72-b948-0643e2825ae1 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:29.908638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7ebaddea-c9c2-4f72-b948-0643e2825ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:29.940196 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaddea-c9c2-4f72-b948-0643e2825ae1 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:29.947232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:29.947884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:29.948213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:29.948576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] PATH_INFO: `/v3/projects/eef5ce596ec74c728368d39ecfff1155` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:29.949725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef5ce596ec74c728368d39ecfff1155)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:29.952756 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:30.035123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef5ce596ec74c728368d39ecfff1155', 'request_id': 'req-021c8946-7e1c-4bbc-921a-dc87daedb1f8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.042532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a24a3056624eea93eb42961ec65d8c', 'request_id': 'req-ff944959-2443-45a6-ba71-52a125f1b324'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.048796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef5ce596ec74c728368d39ecfff1155', 'request_id': 'req-021c8946-7e1c-4bbc-921a-dc87daedb1f8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.057014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a24a3056624eea93eb42961ec65d8c', 'request_id': 'req-ff944959-2443-45a6-ba71-52a125f1b324'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.059760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef5ce596ec74c728368d39ecfff1155', 'request_id': 'req-021c8946-7e1c-4bbc-921a-dc87daedb1f8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.071666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a24a3056624eea93eb42961ec65d8c', 'request_id': 'req-ff944959-2443-45a6-ba71-52a125f1b324'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.089067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] The token cache is being invalidate because project eef5ce596ec74c728368d39ecfff1155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:30.089929 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.090757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.093543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] The token cache is being invalidate because project d3a24a3056624eea93eb42961ec65d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:30.093930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.094101 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1042/2073] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:29 2022] DELETE /identity/v3/projects/eef5ce596ec74c728368d39ecfff1155 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:30.097076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.098935 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:30.100828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:30.104727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1032/2074] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:29 2022] DELETE /identity/v3/projects/d3a24a3056624eea93eb42961ec65d8c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:30.106054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:30.111015 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:30.190957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c8946-7e1c-4bbc-921a-dc87daedb1f8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:30.197534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:30.197534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:30.197826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:30.206441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:30.208687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] PATH_INFO: `/v3/users/60e4047abc094e42a74338cf5db9432f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:30.213396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e4047abc094e42a74338cf5db9432f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:30.220335 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:30.243185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944959-2443-45a6-ba71-52a125f1b324 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:30.249482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:30.250330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:30.250607 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:30.250941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] PATH_INFO: `/v3/users/e78f01b881a745a2ad517106961ba7bf` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:30.252531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78f01b881a745a2ad517106961ba7bf)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:30.254971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:30.296381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:30.319058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e4047abc094e42a74338cf5db9432f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.320792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e4047abc094e42a74338cf5db9432f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.324922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78f01b881a745a2ad517106961ba7bf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.325666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78f01b881a745a2ad517106961ba7bf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.330067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e4047abc094e42a74338cf5db9432f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.335191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78f01b881a745a2ad517106961ba7bf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.336067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78f01b881a745a2ad517106961ba7bf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.338112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e4047abc094e42a74338cf5db9432f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.338772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e4047abc094e42a74338cf5db9432f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.349706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78f01b881a745a2ad517106961ba7bf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:30.358350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1043/2075] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:30 2022] DELETE /identity/v3/users/60e4047abc094e42a74338cf5db9432f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:30.364781 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1033/2076] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:30 2022] DELETE /identity/v3/users/e78f01b881a745a2ad517106961ba7bf => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:31.106211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.107741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:31.161138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.163545 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:31.248519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f26f0c-cbe8-4cf5-a666-4ec85068af78 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.255421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.256163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.256534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.256765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ce9f2-ec34-43c7-8202-e0ede3fd7b88 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.256931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488 admin admin] PATH_INFO: `/v3/projects/d77468256c4c442d8270a470df9e21e6` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.260776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77468256c4c442d8270a470df9e21e6)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.262974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.267286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.267967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.268222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.268686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a admin admin] PATH_INFO: `/v3/projects/3e2d1b5545c14471b4d7b838c954e5a6` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.269791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2d1b5545c14471b4d7b838c954e5a6)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.272257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.337959 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77468256c4c442d8270a470df9e21e6', 'request_id': 'req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:31.355990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2d1b5545c14471b4d7b838c954e5a6', 'request_id': 'req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:31.356103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77468256c4c442d8270a470df9e21e6', 'request_id': 'req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:31.368223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77468256c4c442d8270a470df9e21e6', 'request_id': 'req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:31.371049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2d1b5545c14471b4d7b838c954e5a6', 'request_id': 'req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:31.392159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2d1b5545c14471b4d7b838c954e5a6', 'request_id': 'req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:31.398716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488 admin admin] The token cache is being invalidate because project d77468256c4c442d8270a470df9e21e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:31.399130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:31.400049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7f09e5dc-ff2f-4eaa-b6c4-e46659f0f488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:31.402377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1044/2077] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:31 2022] DELETE /identity/v3/projects/d77468256c4c442d8270a470df9e21e6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:31.408132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:31.408356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bd380-fed4-4bf0-9d02-2a2317ef725e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.408853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bd380-fed4-4bf0-9d02-2a2317ef725e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.409192 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bd380-fed4-4bf0-9d02-2a2317ef725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.423484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a admin admin] The token cache is being invalidate because project 3e2d1b5545c14471b4d7b838c954e5a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:31.423953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:31.424887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2fb6f13-114b-4419-a0a6-4a4e8fb1dd7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:31.429850 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1034/2078] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:31 2022] DELETE /identity/v3/projects/3e2d1b5545c14471b4d7b838c954e5a6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:31.441415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf97a5-ccc7-4ff3-b685-9b3e7893b5e0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.441909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf97a5-ccc7-4ff3-b685-9b3e7893b5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.442235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf97a5-ccc7-4ff3-b685-9b3e7893b5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.445678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-048bd380-fed4-4bf0-9d02-2a2317ef725e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:31.447094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-048bd380-fed4-4bf0-9d02-2a2317ef725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:31.477342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8cbf97a5-ccc7-4ff3-b685-9b3e7893b5e0 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:31.478570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8cbf97a5-ccc7-4ff3-b685-9b3e7893b5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:31.493887 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:31.527865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1045/2079] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:31.536398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4408d3-6e86-4024-a1db-017848d3876e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.537032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4408d3-6e86-4024-a1db-017848d3876e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.537495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4408d3-6e86-4024-a1db-017848d3876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.565499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4e4408d3-6e86-4024-a1db-017848d3876e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:31.566807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4e4408d3-6e86-4024-a1db-017848d3876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:31.567494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1035/2080] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:31.576309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd65125-efce-455d-8ba8-fcff736b6415 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.576739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd65125-efce-455d-8ba8-fcff736b6415 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.577221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd65125-efce-455d-8ba8-fcff736b6415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.592465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1046/2081] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:31.593563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4408d3-6e86-4024-a1db-017848d3876e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.600409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2fd65125-efce-455d-8ba8-fcff736b6415 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:31.601635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2fd65125-efce-455d-8ba8-fcff736b6415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:31.605229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4408d3-6e86-4024-a1db-017848d3876e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.610636 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1036/2082] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:31.611623 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e14c98-50a3-45d5-a966-188d78f7b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.612339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e14c98-50a3-45d5-a966-188d78f7b810 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.613069 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e14c98-50a3-45d5-a966-188d78f7b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.613069 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e14c98-50a3-45d5-a966-188d78f7b810 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.613697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e14c98-50a3-45d5-a966-188d78f7b810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:31.614387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e14c98-50a3-45d5-a966-188d78f7b810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.615144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd65125-efce-455d-8ba8-fcff736b6415 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.616361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e14c98-50a3-45d5-a966-188d78f7b810 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.625738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd65125-efce-455d-8ba8-fcff736b6415 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.631787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e62cb-af41-433e-b448-f788deb350d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.632383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e62cb-af41-433e-b448-f788deb350d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.632736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e62cb-af41-433e-b448-f788deb350d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.633166 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e62cb-af41-433e-b448-f788deb350d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.633290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1047/2083] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:31.633983 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e62cb-af41-433e-b448-f788deb350d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:31.634130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e14c98-50a3-45d5-a966-188d78f7b810 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.634349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e62cb-af41-433e-b448-f788deb350d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.636171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e62cb-af41-433e-b448-f788deb350d8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.644618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e14c98-50a3-45d5-a966-188d78f7b810 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.650533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188202-181a-41d7-b888-4c55ee982559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.651159 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188202-181a-41d7-b888-4c55ee982559 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.651791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188202-181a-41d7-b888-4c55ee982559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.651791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188202-181a-41d7-b888-4c55ee982559 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.652773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1037/2084] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:13:31.656572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e188202-181a-41d7-b888-4c55ee982559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.658803 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e188202-181a-41d7-b888-4c55ee982559 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.661495 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e62cb-af41-433e-b448-f788deb350d8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.675508 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e62cb-af41-433e-b448-f788deb350d8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.680589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c0e4c-9ff5-4c20-84f6-14efb93ced39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.681245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c0e4c-9ff5-4c20-84f6-14efb93ced39 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.681712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c0e4c-9ff5-4c20-84f6-14efb93ced39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.682027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c0e4c-9ff5-4c20-84f6-14efb93ced39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.682771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c0e4c-9ff5-4c20-84f6-14efb93ced39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.684849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c0e4c-9ff5-4c20-84f6-14efb93ced39 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.697982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1048/2085] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:31 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:31.699091 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188202-181a-41d7-b888-4c55ee982559 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.723263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1038/2086] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:31 2022] POST /identity/v3/projects => generated 361 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:31.727135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c0e4c-9ff5-4c20-84f6-14efb93ced39 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.779347 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188202-181a-41d7-b888-4c55ee982559 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.808723 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c0e4c-9ff5-4c20-84f6-14efb93ced39 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.819231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc9439-bbfc-4e72-9996-dd7b4115ef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.819860 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc9439-bbfc-4e72-9996-dd7b4115ef95 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.820135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc9439-bbfc-4e72-9996-dd7b4115ef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.820435 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc9439-bbfc-4e72-9996-dd7b4115ef95 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.821076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc9439-bbfc-4e72-9996-dd7b4115ef95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.823042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc9439-bbfc-4e72-9996-dd7b4115ef95 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.848282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1039/2087] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:31 2022] POST /identity/v3/users => generated 281 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:31.852604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc9439-bbfc-4e72-9996-dd7b4115ef95 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.857149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f0f17-217c-41db-87b4-718c8cbefca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.858095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f0f17-217c-41db-87b4-718c8cbefca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.858550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f0f17-217c-41db-87b4-718c8cbefca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.858787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f0f17-217c-41db-87b4-718c8cbefca4 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.859702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f0f17-217c-41db-87b4-718c8cbefca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.861850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f0f17-217c-41db-87b4-718c8cbefca4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.864829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc9439-bbfc-4e72-9996-dd7b4115ef95 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.871042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f76237-ced7-4489-8b34-8ecf2fb09f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.871861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76237-ced7-4489-8b34-8ecf2fb09f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.872364 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76237-ced7-4489-8b34-8ecf2fb09f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.872645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76237-ced7-4489-8b34-8ecf2fb09f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.873588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f76237-ced7-4489-8b34-8ecf2fb09f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.876539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f76237-ced7-4489-8b34-8ecf2fb09f6e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.892346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1040/2088] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:31.895933 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f76237-ced7-4489-8b34-8ecf2fb09f6e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.905037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1049/2089] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:31 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:31.909506 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f0f17-217c-41db-87b4-718c8cbefca4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.917645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f76237-ced7-4489-8b34-8ecf2fb09f6e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.920869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f0f17-217c-41db-87b4-718c8cbefca4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.924370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dd6bd-ab34-4cd2-bd2c-8b0762b1827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.925658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dd6bd-ab34-4cd2-bd2c-8b0762b1827e admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.925658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dd6bd-ab34-4cd2-bd2c-8b0762b1827e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.925887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dd6bd-ab34-4cd2-bd2c-8b0762b1827e admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.926683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dd6bd-ab34-4cd2-bd2c-8b0762b1827e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.928931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7bc93-03f8-4907-9764-03af6c3af6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.929552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7bc93-03f8-4907-9764-03af6c3af6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.929801 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dd6bd-ab34-4cd2-bd2c-8b0762b1827e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.929910 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7bc93-03f8-4907-9764-03af6c3af6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.930084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7bc93-03f8-4907-9764-03af6c3af6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.930738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7bc93-03f8-4907-9764-03af6c3af6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.932420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7bc93-03f8-4907-9764-03af6c3af6f2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.946859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1050/2090] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:31.947933 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7bc93-03f8-4907-9764-03af6c3af6f2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.950364 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1041/2091] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:31.951892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dd6bd-ab34-4cd2-bd2c-8b0762b1827e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:31.952539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2fd7bc93-03f8-4907-9764-03af6c3af6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:31.964469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dd6bd-ab34-4cd2-bd2c-8b0762b1827e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.972538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bf44c-63ee-4dbb-8299-c3a116ebb87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.973489 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bf44c-63ee-4dbb-8299-c3a116ebb87f admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.973842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bf44c-63ee-4dbb-8299-c3a116ebb87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.974206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bf44c-63ee-4dbb-8299-c3a116ebb87f admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.974963 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bf44c-63ee-4dbb-8299-c3a116ebb87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.976787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bf44c-63ee-4dbb-8299-c3a116ebb87f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.980546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7bc93-03f8-4907-9764-03af6c3af6f2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:31.985842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cb7a1-3059-4b9f-a37f-fb0f9bef4cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:31.986669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb7a1-3059-4b9f-a37f-fb0f9bef4cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:31.987095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb7a1-3059-4b9f-a37f-fb0f9bef4cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:31.987515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb7a1-3059-4b9f-a37f-fb0f9bef4cca admin admin] PATH_INFO: `/v3/users/2fca0878126f4f989136915f38485a9a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:31.988878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cb7a1-3059-4b9f-a37f-fb0f9bef4cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fca0878126f4f989136915f38485a9a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:31.990727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1042/2092] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:31.991438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cb7a1-3059-4b9f-a37f-fb0f9bef4cca admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:31.991738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bf44c-63ee-4dbb-8299-c3a116ebb87f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:32.006214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bf44c-63ee-4dbb-8299-c3a116ebb87f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:32.019251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:32.024392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2242850-8959-404d-9570-0e0535000353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:32.025262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242850-8959-404d-9570-0e0535000353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:32.025576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242850-8959-404d-9570-0e0535000353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:32.025930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242850-8959-404d-9570-0e0535000353 admin admin] PATH_INFO: `/v3/projects/3fde5b24f7d146fe91cf14aff53ba4f0/users/670d5d504b924bb492cd17d57969ed01/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:32.030168 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:32.048495 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2242850-8959-404d-9570-0e0535000353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fde5b24f7d146fe91cf14aff53ba4f0, user_id=670d5d504b924bb492cd17d57969ed01, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:32.053449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2242850-8959-404d-9570-0e0535000353 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:32.074800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1043/2093] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:31 2022] PUT /identity/v3/projects/3fde5b24f7d146fe91cf14aff53ba4f0/users/670d5d504b924bb492cd17d57969ed01/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:32.078920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ed7cb7a1-3059-4b9f-a37f-fb0f9bef4cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fca0878126f4f989136915f38485a9a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.079655 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ed7cb7a1-3059-4b9f-a37f-fb0f9bef4cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fca0878126f4f989136915f38485a9a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.081145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2242850-8959-404d-9570-0e0535000353 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:32.085963 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c2242850-8959-404d-9570-0e0535000353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:32.094610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ed7cb7a1-3059-4b9f-a37f-fb0f9bef4cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fca0878126f4f989136915f38485a9a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.104746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ed7cb7a1-3059-4b9f-a37f-fb0f9bef4cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fca0878126f4f989136915f38485a9a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.106027 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ed7cb7a1-3059-4b9f-a37f-fb0f9bef4cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fca0878126f4f989136915f38485a9a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.132256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1051/2094] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:31 2022] DELETE /identity/v3/users/2fca0878126f4f989136915f38485a9a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:32.132256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1076b-e917-4d3d-a584-15ae499fce7d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:32.132256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1076b-e917-4d3d-a584-15ae499fce7d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:32.132256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1076b-e917-4d3d-a584-15ae499fce7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:32.164328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0ba1076b-e917-4d3d-a584-15ae499fce7d None None] MFA Rules not processed for user `670d5d504b924bb492cd17d57969ed01`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:32.165464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0ba1076b-e917-4d3d-a584-15ae499fce7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:32.168470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2242850-8959-404d-9570-0e0535000353 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:32.240577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1052/2095] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:32.240577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab52bb-a60e-4974-860d-cc32bf82f779 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:32.240577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab52bb-a60e-4974-860d-cc32bf82f779 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:32.240577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab52bb-a60e-4974-860d-cc32bf82f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:32.241981 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4bcec-a21f-4a28-8d65-0b2ad3763c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:32.242935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4bcec-a21f-4a28-8d65-0b2ad3763c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:32.244089 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4bcec-a21f-4a28-8d65-0b2ad3763c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:32.244089 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4bcec-a21f-4a28-8d65-0b2ad3763c19 admin admin] PATH_INFO: `/v3/projects/aa66e7a7731d4f1aaedd2822204b0bff/users/05a9bc165e1046ebbba3ab0aa4432b3d/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:32.274469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4bcec-a21f-4a28-8d65-0b2ad3763c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa66e7a7731d4f1aaedd2822204b0bff, user_id=05a9bc165e1046ebbba3ab0aa4432b3d, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:32.276926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9eab52bb-a60e-4974-860d-cc32bf82f779 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:32.277240 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4bcec-a21f-4a28-8d65-0b2ad3763c19 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:32.278340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9eab52bb-a60e-4974-860d-cc32bf82f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:32.288764 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1053/2096] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:32.292798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab52bb-a60e-4974-860d-cc32bf82f779 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:32.294062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9eab52bb-a60e-4974-860d-cc32bf82f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:32.294253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1044/2097] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:32 2022] PUT /identity/v3/projects/aa66e7a7731d4f1aaedd2822204b0bff/users/05a9bc165e1046ebbba3ab0aa4432b3d/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:32.300849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72755ef-f04f-49c7-af47-8bc5bea0bdf5 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:32.304697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72755ef-f04f-49c7-af47-8bc5bea0bdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:32.305315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72755ef-f04f-49c7-af47-8bc5bea0bdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:32.325571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a72755ef-f04f-49c7-af47-8bc5bea0bdf5 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:32.326828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a72755ef-f04f-49c7-af47-8bc5bea0bdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:32.367401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab52bb-a60e-4974-860d-cc32bf82f779 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:32.400616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1045/2098] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:32.401866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72755ef-f04f-49c7-af47-8bc5bea0bdf5 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:32.403182 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a72755ef-f04f-49c7-af47-8bc5bea0bdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:32.412653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:32.425635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:32.449167 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736ba1b-d65e-4ac2-9b20-d85febae67d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:32.451412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736ba1b-d65e-4ac2-9b20-d85febae67d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:32.452106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736ba1b-d65e-4ac2-9b20-d85febae67d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:32.452106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736ba1b-d65e-4ac2-9b20-d85febae67d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:32.492494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72755ef-f04f-49c7-af47-8bc5bea0bdf5 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:32.497085 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deec33c-99f8-44f5-80c2-ce0f0cc53d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:32.497902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec33c-99f8-44f5-80c2-ce0f0cc53d51 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:32.498321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec33c-99f8-44f5-80c2-ce0f0cc53d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:32.498736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec33c-99f8-44f5-80c2-ce0f0cc53d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:32.510589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deec33c-99f8-44f5-80c2-ce0f0cc53d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:32.513292 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deec33c-99f8-44f5-80c2-ce0f0cc53d51 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:32.525502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1046/2099] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:32.527097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deec33c-99f8-44f5-80c2-ce0f0cc53d51 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:32.538759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deec33c-99f8-44f5-80c2-ce0f0cc53d51 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:32.540656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736ba1b-d65e-4ac2-9b20-d85febae67d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:32.542645 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736ba1b-d65e-4ac2-9b20-d85febae67d2 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:32.545287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b857d7-f3e8-4164-9591-329706b6ba2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:32.546889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b857d7-f3e8-4164-9591-329706b6ba2a service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:32.547380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b857d7-f3e8-4164-9591-329706b6ba2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:32.548177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b857d7-f3e8-4164-9591-329706b6ba2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:32.555511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1054/2100] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:32.575809 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736ba1b-d65e-4ac2-9b20-d85febae67d2 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:32.578249 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d736ba1b-d65e-4ac2-9b20-d85febae67d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:32.579276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b857d7-f3e8-4164-9591-329706b6ba2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:32.581037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b857d7-f3e8-4164-9591-329706b6ba2a service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:32.596600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1047/2101] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:32.603096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736ba1b-d65e-4ac2-9b20-d85febae67d2 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:32.609245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41e810-6dac-4fb0-a89e-ac7809432c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:32.610115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41e810-6dac-4fb0-a89e-ac7809432c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:32.610637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41e810-6dac-4fb0-a89e-ac7809432c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:32.611058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41e810-6dac-4fb0-a89e-ac7809432c2c admin admin] PATH_INFO: `/v3/users/670d5d504b924bb492cd17d57969ed01` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:32.612991 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41e810-6dac-4fb0-a89e-ac7809432c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=670d5d504b924bb492cd17d57969ed01)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:32.616352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41e810-6dac-4fb0-a89e-ac7809432c2c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:32.676727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b857d7-f3e8-4164-9591-329706b6ba2a service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:32.678686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-87b857d7-f3e8-4164-9591-329706b6ba2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:32.704930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b857d7-f3e8-4164-9591-329706b6ba2a service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:32.716446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dae038-f8f8-4a5b-805f-a3434a5c2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:32.718252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dae038-f8f8-4a5b-805f-a3434a5c2ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:32.719132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dae038-f8f8-4a5b-805f-a3434a5c2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:32.719737 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dae038-f8f8-4a5b-805f-a3434a5c2ef0 admin admin] PATH_INFO: `/v3/users/7802d78fb84044baae2e90f10a70574a` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:32.721450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dae038-f8f8-4a5b-805f-a3434a5c2ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7802d78fb84044baae2e90f10a70574a)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:32.731357 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dae038-f8f8-4a5b-805f-a3434a5c2ef0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:32.774456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fc41e810-6dac-4fb0-a89e-ac7809432c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670d5d504b924bb492cd17d57969ed01'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.776185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fc41e810-6dac-4fb0-a89e-ac7809432c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670d5d504b924bb492cd17d57969ed01'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.807678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fc41e810-6dac-4fb0-a89e-ac7809432c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670d5d504b924bb492cd17d57969ed01'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.832958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fc41e810-6dac-4fb0-a89e-ac7809432c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670d5d504b924bb492cd17d57969ed01'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.834155 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fc41e810-6dac-4fb0-a89e-ac7809432c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670d5d504b924bb492cd17d57969ed01'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.857374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1055/2102] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:32 2022] DELETE /identity/v3/users/670d5d504b924bb492cd17d57969ed01 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:32.859237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2dae038-f8f8-4a5b-805f-a3434a5c2ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7802d78fb84044baae2e90f10a70574a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.859386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a049b81-89c3-475a-b448-27d43a3707bd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:32.859727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a049b81-89c3-475a-b448-27d43a3707bd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:32.859954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a049b81-89c3-475a-b448-27d43a3707bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:32.861153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2dae038-f8f8-4a5b-805f-a3434a5c2ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7802d78fb84044baae2e90f10a70574a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.870862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2dae038-f8f8-4a5b-805f-a3434a5c2ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7802d78fb84044baae2e90f10a70574a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.872271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2dae038-f8f8-4a5b-805f-a3434a5c2ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7802d78fb84044baae2e90f10a70574a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.885942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4a049b81-89c3-475a-b448-27d43a3707bd None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:32.887258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4a049b81-89c3-475a-b448-27d43a3707bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:32.891457 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2dae038-f8f8-4a5b-805f-a3434a5c2ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7802d78fb84044baae2e90f10a70574a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:32.917867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1048/2103] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:32 2022] DELETE /identity/v3/users/7802d78fb84044baae2e90f10a70574a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:32.923042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0bb31-2fdf-490b-8927-2d71e7e60440 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:32.924633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0bb31-2fdf-490b-8927-2d71e7e60440 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:32.925051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0bb31-2fdf-490b-8927-2d71e7e60440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:32.963838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1056/2104] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:32.973376 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e6e0bb31-2fdf-490b-8927-2d71e7e60440 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:32.974663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e6e0bb31-2fdf-490b-8927-2d71e7e60440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:32.990580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a049b81-89c3-475a-b448-27d43a3707bd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:32.992181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4a049b81-89c3-475a-b448-27d43a3707bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:32.997362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:33.073683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1049/2105] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:33.099367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a049b81-89c3-475a-b448-27d43a3707bd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:33.152534 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0bb31-2fdf-490b-8927-2d71e7e60440 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:33.166555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65b338-3ef6-4512-9393-23a4ed26fcb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:33.167284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65b338-3ef6-4512-9393-23a4ed26fcb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:33.167559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65b338-3ef6-4512-9393-23a4ed26fcb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:33.167649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65b338-3ef6-4512-9393-23a4ed26fcb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:33.178953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65b338-3ef6-4512-9393-23a4ed26fcb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:33.180513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65b338-3ef6-4512-9393-23a4ed26fcb6 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:33.192479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1057/2106] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:13:33.202275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:33.253180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0bb31-2fdf-490b-8927-2d71e7e60440 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:33.257473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0e506-47b9-4f65-bbc4-7bb8d97bf8fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:33.258206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0e506-47b9-4f65-bbc4-7bb8d97bf8fd service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:33.258559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0e506-47b9-4f65-bbc4-7bb8d97bf8fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:33.258902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0e506-47b9-4f65-bbc4-7bb8d97bf8fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:33.274339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0e506-47b9-4f65-bbc4-7bb8d97bf8fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:33.276666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0e506-47b9-4f65-bbc4-7bb8d97bf8fd service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:33.289317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1050/2107] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:13:33.499754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65b338-3ef6-4512-9393-23a4ed26fcb6 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:33.502777 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9c65b338-3ef6-4512-9393-23a4ed26fcb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:33.520031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65b338-3ef6-4512-9393-23a4ed26fcb6 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:33.527958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427696a-0189-4b76-a5c4-a92e7aeb2220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:33.528864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427696a-0189-4b76-a5c4-a92e7aeb2220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:33.529398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427696a-0189-4b76-a5c4-a92e7aeb2220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:33.529841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427696a-0189-4b76-a5c4-a92e7aeb2220 admin admin] PATH_INFO: `/v3/projects/34447188d1e34269bfe0e5fa7d9b9ff8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:33.531382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427696a-0189-4b76-a5c4-a92e7aeb2220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34447188d1e34269bfe0e5fa7d9b9ff8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:33.534527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427696a-0189-4b76-a5c4-a92e7aeb2220 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:33.609037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a427696a-0189-4b76-a5c4-a92e7aeb2220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34447188d1e34269bfe0e5fa7d9b9ff8', 'request_id': 'req-a427696a-0189-4b76-a5c4-a92e7aeb2220'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:33.624880 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a427696a-0189-4b76-a5c4-a92e7aeb2220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34447188d1e34269bfe0e5fa7d9b9ff8', 'request_id': 'req-a427696a-0189-4b76-a5c4-a92e7aeb2220'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:33.634644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a427696a-0189-4b76-a5c4-a92e7aeb2220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34447188d1e34269bfe0e5fa7d9b9ff8', 'request_id': 'req-a427696a-0189-4b76-a5c4-a92e7aeb2220'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:33.664442 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a427696a-0189-4b76-a5c4-a92e7aeb2220 admin admin] The token cache is being invalidate because project 34447188d1e34269bfe0e5fa7d9b9ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:33.664899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a427696a-0189-4b76-a5c4-a92e7aeb2220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:33.665640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a427696a-0189-4b76-a5c4-a92e7aeb2220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:33.668927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1058/2108] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:33 2022] DELETE /identity/v3/projects/34447188d1e34269bfe0e5fa7d9b9ff8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:33.672650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc55d0-cc8a-48be-9168-e19c53676aac None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:33.673587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc55d0-cc8a-48be-9168-e19c53676aac None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:33.674077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc55d0-cc8a-48be-9168-e19c53676aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:33.712663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-11bc55d0-cc8a-48be-9168-e19c53676aac None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:33.714393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-11bc55d0-cc8a-48be-9168-e19c53676aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:33.817664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1051/2109] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:33.825557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1527ab-981f-471c-be18-cc9da4b5b052 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:33.825847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1527ab-981f-471c-be18-cc9da4b5b052 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:33.826204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1527ab-981f-471c-be18-cc9da4b5b052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:33.853101 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ff1527ab-981f-471c-be18-cc9da4b5b052 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:33.854865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ff1527ab-981f-471c-be18-cc9da4b5b052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:33.865288 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1059/2110] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:33.869525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc55d0-cc8a-48be-9168-e19c53676aac None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:33.879966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc55d0-cc8a-48be-9168-e19c53676aac None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:33.885564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd510db1-af10-4468-bca9-7024fd6349fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:33.886308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd510db1-af10-4468-bca9-7024fd6349fd admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:33.886680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd510db1-af10-4468-bca9-7024fd6349fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:33.887121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd510db1-af10-4468-bca9-7024fd6349fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:33.887845 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd510db1-af10-4468-bca9-7024fd6349fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:33.888236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd510db1-af10-4468-bca9-7024fd6349fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:33.890313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd510db1-af10-4468-bca9-7024fd6349fd admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:33.904564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1052/2111] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:33.906478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1527ab-981f-471c-be18-cc9da4b5b052 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:33.911438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ff1527ab-981f-471c-be18-cc9da4b5b052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:33.919268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd510db1-af10-4468-bca9-7024fd6349fd admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:33.932367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1527ab-981f-471c-be18-cc9da4b5b052 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:33.939121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd510db1-af10-4468-bca9-7024fd6349fd admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:33.944219 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:33.945077 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:33.945467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:33.945835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] PATH_INFO: `/v3/projects/3fde5b24f7d146fe91cf14aff53ba4f0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:33.947862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fde5b24f7d146fe91cf14aff53ba4f0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:33.951317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:33.954132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93114e5-5fe4-4bc0-b626-e8c5724b3aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:33.956337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93114e5-5fe4-4bc0-b626-e8c5724b3aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:33.956337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93114e5-5fe4-4bc0-b626-e8c5724b3aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:33.956337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93114e5-5fe4-4bc0-b626-e8c5724b3aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:33.956337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93114e5-5fe4-4bc0-b626-e8c5724b3aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:33.959285 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93114e5-5fe4-4bc0-b626-e8c5724b3aa4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:34.000347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1053/2112] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:33 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:34.004535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93114e5-5fe4-4bc0-b626-e8c5724b3aa4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:34.006413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d93114e5-5fe4-4bc0-b626-e8c5724b3aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:34.009564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:34.021714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fde5b24f7d146fe91cf14aff53ba4f0', 'request_id': 'req-fed18dfe-d908-4408-b882-8706b6d416d4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.030857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fde5b24f7d146fe91cf14aff53ba4f0', 'request_id': 'req-fed18dfe-d908-4408-b882-8706b6d416d4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.046100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fde5b24f7d146fe91cf14aff53ba4f0', 'request_id': 'req-fed18dfe-d908-4408-b882-8706b6d416d4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.064716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] The token cache is being invalidate because project 3fde5b24f7d146fe91cf14aff53ba4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:34.065367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.066253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.068049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1060/2113] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:33 2022] DELETE /identity/v3/projects/3fde5b24f7d146fe91cf14aff53ba4f0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:34.069461 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:34.073666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:34.141870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93114e5-5fe4-4bc0-b626-e8c5724b3aa4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:34.163462 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed18dfe-d908-4408-b882-8706b6d416d4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:34.177689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd79817-1ed5-4809-9f02-4c2c29655555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:34.178486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd79817-1ed5-4809-9f02-4c2c29655555 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:34.178868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd79817-1ed5-4809-9f02-4c2c29655555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:34.179238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd79817-1ed5-4809-9f02-4c2c29655555 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:34.179984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd79817-1ed5-4809-9f02-4c2c29655555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:34.186216 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd79817-1ed5-4809-9f02-4c2c29655555 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:34.199981 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:34.228392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1061/2114] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:34 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:34.230796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20607210-805b-4ce9-8210-93eca1e8b3ad None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:34.231242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20607210-805b-4ce9-8210-93eca1e8b3ad None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:34.231661 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20607210-805b-4ce9-8210-93eca1e8b3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:34.250521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:34.252097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:34.252496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:34.252776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] PATH_INFO: `/v3/projects/0af58531223344bfbce73f02790fd30d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:34.254067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af58531223344bfbce73f02790fd30d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:34.256599 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:34.258831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-20607210-805b-4ce9-8210-93eca1e8b3ad None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:34.260273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-20607210-805b-4ce9-8210-93eca1e8b3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:34.279642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1062/2115] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:34.281234 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20607210-805b-4ce9-8210-93eca1e8b3ad None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:34.291915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20607210-805b-4ce9-8210-93eca1e8b3ad None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:34.300003 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7b42d-2eed-48df-9f96-e29c89079571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:34.300677 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7b42d-2eed-48df-9f96-e29c89079571 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:34.300956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7b42d-2eed-48df-9f96-e29c89079571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:34.301226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7b42d-2eed-48df-9f96-e29c89079571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:34.301882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7b42d-2eed-48df-9f96-e29c89079571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:34.303642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7b42d-2eed-48df-9f96-e29c89079571 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:34.321514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1063/2116] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:34.323203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdb693-43fc-4b03-8f3a-887a46461ccf None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:34.323492 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdb693-43fc-4b03-8f3a-887a46461ccf None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:34.323770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdb693-43fc-4b03-8f3a-887a46461ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:34.349971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2dcdb693-43fc-4b03-8f3a-887a46461ccf None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:34.351328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2dcdb693-43fc-4b03-8f3a-887a46461ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:34.351703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af58531223344bfbce73f02790fd30d', 'request_id': 'req-e5dab35b-6fe3-4012-990c-0f7dca45951b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.360623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af58531223344bfbce73f02790fd30d', 'request_id': 'req-e5dab35b-6fe3-4012-990c-0f7dca45951b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.389683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af58531223344bfbce73f02790fd30d', 'request_id': 'req-e5dab35b-6fe3-4012-990c-0f7dca45951b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.410164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] The token cache is being invalidate because project 0af58531223344bfbce73f02790fd30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:34.410460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.411148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.413572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1054/2117] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:34 2022] DELETE /identity/v3/projects/0af58531223344bfbce73f02790fd30d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:34.414517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:34.416750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:34.448477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1064/2118] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:34.450191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7d441-444a-4c53-bec0-db907ad39fe0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:34.450467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7d441-444a-4c53-bec0-db907ad39fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:34.450739 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7d441-444a-4c53-bec0-db907ad39fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:34.497207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-37f7d441-444a-4c53-bec0-db907ad39fe0 None None] MFA Rules not processed for user `05a9bc165e1046ebbba3ab0aa4432b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:34.499202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-37f7d441-444a-4c53-bec0-db907ad39fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:34.527296 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:34.527753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dab35b-6fe3-4012-990c-0f7dca45951b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:34.535113 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f73c8a-c1ac-47cc-b35e-4d6c4226d46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:34.535965 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f73c8a-c1ac-47cc-b35e-4d6c4226d46d admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:34.536375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f73c8a-c1ac-47cc-b35e-4d6c4226d46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:34.536754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f73c8a-c1ac-47cc-b35e-4d6c4226d46d admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:34.537653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f73c8a-c1ac-47cc-b35e-4d6c4226d46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:34.540333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f73c8a-c1ac-47cc-b35e-4d6c4226d46d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:34.554374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1055/2119] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:34.555243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f73c8a-c1ac-47cc-b35e-4d6c4226d46d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:34.557880 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d2f73c8a-c1ac-47cc-b35e-4d6c4226d46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:34.573180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f73c8a-c1ac-47cc-b35e-4d6c4226d46d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:34.579316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:34.580136 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:34.580509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:34.580887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] PATH_INFO: `/v3/users/086030a70f2644bc9c1464b62164e388` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:34.582918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=086030a70f2644bc9c1464b62164e388)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:34.585061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:34.599185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1065/2120] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:34.600168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7d441-444a-4c53-bec0-db907ad39fe0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:34.622433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7d441-444a-4c53-bec0-db907ad39fe0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:34.628527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022abb0-a705-4a2e-9b65-773710fffd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:34.629374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022abb0-a705-4a2e-9b65-773710fffd8e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:34.629797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022abb0-a705-4a2e-9b65-773710fffd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:34.631006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022abb0-a705-4a2e-9b65-773710fffd8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:34.641582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022abb0-a705-4a2e-9b65-773710fffd8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:34.642060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022abb0-a705-4a2e-9b65-773710fffd8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:34.643733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022abb0-a705-4a2e-9b65-773710fffd8e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:34.658829 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1066/2121] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:34.659736 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022abb0-a705-4a2e-9b65-773710fffd8e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:34.669827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022abb0-a705-4a2e-9b65-773710fffd8e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:34.679552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a502d8-4280-4ddb-8a2e-77183bb39d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:34.680798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a502d8-4280-4ddb-8a2e-77183bb39d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:34.680919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086030a70f2644bc9c1464b62164e388'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.681086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a502d8-4280-4ddb-8a2e-77183bb39d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:34.681356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a502d8-4280-4ddb-8a2e-77183bb39d94 admin admin] PATH_INFO: `/v3/projects/92395e7bab8a4db19635a90bbfc0fd8a/users/13aac92ac7ae4bd2a9d405f457f5af3b/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:34.682317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086030a70f2644bc9c1464b62164e388'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.692430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:34.698293 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086030a70f2644bc9c1464b62164e388'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.700604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086030a70f2644bc9c1464b62164e388'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.710703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a502d8-4280-4ddb-8a2e-77183bb39d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92395e7bab8a4db19635a90bbfc0fd8a, user_id=13aac92ac7ae4bd2a9d405f457f5af3b, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:34.714904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a502d8-4280-4ddb-8a2e-77183bb39d94 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:34.721496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086030a70f2644bc9c1464b62164e388'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:34.746370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1056/2122] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:34 2022] DELETE /identity/v3/users/086030a70f2644bc9c1464b62164e388 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:34.746370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:34.754705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1067/2123] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:34 2022] PUT /identity/v3/projects/92395e7bab8a4db19635a90bbfc0fd8a/users/13aac92ac7ae4bd2a9d405f457f5af3b/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:34.755548 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a502d8-4280-4ddb-8a2e-77183bb39d94 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:34.757467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e7a502d8-4280-4ddb-8a2e-77183bb39d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:34.761952 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:34.870242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a502d8-4280-4ddb-8a2e-77183bb39d94 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:34.878397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d8e26-c9d8-4c8e-af04-ee2974da7598 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:34.883496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde27b0-71d4-482f-8b99-90fcb20b59fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:34.885198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde27b0-71d4-482f-8b99-90fcb20b59fc service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:34.885714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde27b0-71d4-482f-8b99-90fcb20b59fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:34.886125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde27b0-71d4-482f-8b99-90fcb20b59fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:34.889709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5bde27b0-71d4-482f-8b99-90fcb20b59fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:34.977514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde27b0-71d4-482f-8b99-90fcb20b59fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:34.980896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde27b0-71d4-482f-8b99-90fcb20b59fc service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:35.033038 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1057/2124] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:35.034320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f31ed-6c99-4b46-8c3a-e2c3d52fe122 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.034619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f31ed-6c99-4b46-8c3a-e2c3d52fe122 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.034827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f31ed-6c99-4b46-8c3a-e2c3d52fe122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.036911 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22147f-6a92-4cf1-b507-db243f4006e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:35.047220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22147f-6a92-4cf1-b507-db243f4006e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.048168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22147f-6a92-4cf1-b507-db243f4006e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.048722 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22147f-6a92-4cf1-b507-db243f4006e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.049576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22147f-6a92-4cf1-b507-db243f4006e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:35.052379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22147f-6a92-4cf1-b507-db243f4006e1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:35.111084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1068/2125] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:34 2022] POST /identity/v3/projects => generated 385 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:35.117165 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22147f-6a92-4cf1-b507-db243f4006e1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:35.151729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b08f31ed-6c99-4b46-8c3a-e2c3d52fe122 None None] MFA Rules not processed for user `13aac92ac7ae4bd2a9d405f457f5af3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:35.153023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b08f31ed-6c99-4b46-8c3a-e2c3d52fe122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:35.158478 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:35.326256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22147f-6a92-4cf1-b507-db243f4006e1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:35.334482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1058/2126] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:35.341132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f31ed-6c99-4b46-8c3a-e2c3d52fe122 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:35.345301 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b08f31ed-6c99-4b46-8c3a-e2c3d52fe122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:35.351892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b17d3-7e56-4f61-9abc-a9eb331d678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:35.352559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b17d3-7e56-4f61-9abc-a9eb331d678a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.352832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b17d3-7e56-4f61-9abc-a9eb331d678a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.353093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b17d3-7e56-4f61-9abc-a9eb331d678a admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.353772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b17d3-7e56-4f61-9abc-a9eb331d678a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:35.360957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b17d3-7e56-4f61-9abc-a9eb331d678a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:35.390847 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f31ed-6c99-4b46-8c3a-e2c3d52fe122 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:35.411395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170f118-6432-4f4c-91c2-67a80c6605f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:35.412194 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170f118-6432-4f4c-91c2-67a80c6605f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.412580 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170f118-6432-4f4c-91c2-67a80c6605f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.412917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170f118-6432-4f4c-91c2-67a80c6605f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.415665 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170f118-6432-4f4c-91c2-67a80c6605f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:35.418194 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170f118-6432-4f4c-91c2-67a80c6605f6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:35.435856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1069/2127] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:35 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:35.437318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b17d3-7e56-4f61-9abc-a9eb331d678a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:35.438238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:35.440967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c00b17d3-7e56-4f61-9abc-a9eb331d678a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:35.458536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b17d3-7e56-4f61-9abc-a9eb331d678a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:35.464355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:35.465047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.465321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.465592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] PATH_INFO: `/v3/projects/224f7dc044ea452e82d9e17ff3ce9ddb` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.466995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] RBAC: Authorizing `identity:delete_project(project_id=224f7dc044ea452e82d9e17ff3ce9ddb)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:35.469456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:35.469902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1059/2128] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:35 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:35.471021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170f118-6432-4f4c-91c2-67a80c6605f6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:35.534670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224f7dc044ea452e82d9e17ff3ce9ddb', 'request_id': 'req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:35.550279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170f118-6432-4f4c-91c2-67a80c6605f6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:35.553203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224f7dc044ea452e82d9e17ff3ce9ddb', 'request_id': 'req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:35.571679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224f7dc044ea452e82d9e17ff3ce9ddb', 'request_id': 'req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:35.589994 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] The token cache is being invalidate because project 224f7dc044ea452e82d9e17ff3ce9ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:35.590363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:35.591024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:35.593534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1070/2129] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:35 2022] DELETE /identity/v3/projects/224f7dc044ea452e82d9e17ff3ce9ddb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:35.594649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:35.596092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:35.641476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbb242-30fb-443f-8eef-7b385e0bea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:35.642109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbb242-30fb-443f-8eef-7b385e0bea9d admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.642391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbb242-30fb-443f-8eef-7b385e0bea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.642660 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbb242-30fb-443f-8eef-7b385e0bea9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.643356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbb242-30fb-443f-8eef-7b385e0bea9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:35.645125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbb242-30fb-443f-8eef-7b385e0bea9d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:35.660011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1060/2130] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:35.660011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbb242-30fb-443f-8eef-7b385e0bea9d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:35.660011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-79bbb242-30fb-443f-8eef-7b385e0bea9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:35.674056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbb242-30fb-443f-8eef-7b385e0bea9d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:35.678912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfa73e-1a5a-4bc0-b4d7-cb79d252f229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:35.679525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfa73e-1a5a-4bc0-b4d7-cb79d252f229 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.679891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfa73e-1a5a-4bc0-b4d7-cb79d252f229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.680085 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfa73e-1a5a-4bc0-b4d7-cb79d252f229 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.680719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfa73e-1a5a-4bc0-b4d7-cb79d252f229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:35.682714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfa73e-1a5a-4bc0-b4d7-cb79d252f229 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:35.684668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04324ed2-0a3b-4a67-b3c6-b72543e8c19b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:35.689584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12256063-a46a-460a-966a-18e090cd150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:35.690221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12256063-a46a-460a-966a-18e090cd150e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.690491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12256063-a46a-460a-966a-18e090cd150e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.690758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12256063-a46a-460a-966a-18e090cd150e admin admin] PATH_INFO: `/v3/users/98c0fd0ea5864180b2758824270eee3f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.691921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12256063-a46a-460a-966a-18e090cd150e admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c0fd0ea5864180b2758824270eee3f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:35.694332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12256063-a46a-460a-966a-18e090cd150e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:35.707647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1061/2131] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:35 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:35.708925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca23b95-2ec8-455d-9200-6c20e6a95fde None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.709206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca23b95-2ec8-455d-9200-6c20e6a95fde None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.709484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca23b95-2ec8-455d-9200-6c20e6a95fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.728680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7ca23b95-2ec8-455d-9200-6c20e6a95fde None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:35.729841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7ca23b95-2ec8-455d-9200-6c20e6a95fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:35.735619 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:35.740539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1062/2132] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:35.741277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca23b95-2ec8-455d-9200-6c20e6a95fde None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:35.748662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7ca23b95-2ec8-455d-9200-6c20e6a95fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:35.759692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-12256063-a46a-460a-966a-18e090cd150e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c0fd0ea5864180b2758824270eee3f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:35.760508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-12256063-a46a-460a-966a-18e090cd150e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c0fd0ea5864180b2758824270eee3f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:35.766616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca23b95-2ec8-455d-9200-6c20e6a95fde None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:35.770342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-12256063-a46a-460a-966a-18e090cd150e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c0fd0ea5864180b2758824270eee3f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:35.771915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164271e4-7892-4395-900a-5908852b160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:35.772419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164271e4-7892-4395-900a-5908852b160b admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.772684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164271e4-7892-4395-900a-5908852b160b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.773309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164271e4-7892-4395-900a-5908852b160b admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.773992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164271e4-7892-4395-900a-5908852b160b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:35.775652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164271e4-7892-4395-900a-5908852b160b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:35.780117 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-12256063-a46a-460a-966a-18e090cd150e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c0fd0ea5864180b2758824270eee3f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:35.780900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-12256063-a46a-460a-966a-18e090cd150e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c0fd0ea5864180b2758824270eee3f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:35.786899 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1063/2133] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:35.787658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164271e4-7892-4395-900a-5908852b160b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:35.789377 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-164271e4-7892-4395-900a-5908852b160b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:35.803630 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1071/2134] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:35 2022] DELETE /identity/v3/users/98c0fd0ea5864180b2758824270eee3f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:35.804204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164271e4-7892-4395-900a-5908852b160b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:35.808475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1873fc-b709-455e-836c-c7b3b9f1b8fb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.808850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1873fc-b709-455e-836c-c7b3b9f1b8fb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.809241 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1873fc-b709-455e-836c-c7b3b9f1b8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.840540 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9b1873fc-b709-455e-836c-c7b3b9f1b8fb None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:35.842420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9b1873fc-b709-455e-836c-c7b3b9f1b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:35.881227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44180872-b21f-4ce5-b0d9-f68983fa7665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:35.881978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44180872-b21f-4ce5-b0d9-f68983fa7665 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.882264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44180872-b21f-4ce5-b0d9-f68983fa7665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.882539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44180872-b21f-4ce5-b0d9-f68983fa7665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.883246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44180872-b21f-4ce5-b0d9-f68983fa7665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:35.884952 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44180872-b21f-4ce5-b0d9-f68983fa7665 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:35.886451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:35.901409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1064/2135] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:35.902338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44180872-b21f-4ce5-b0d9-f68983fa7665 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:35.904271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-44180872-b21f-4ce5-b0d9-f68983fa7665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:35.911199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1072/2136] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:35.912119 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1873fc-b709-455e-836c-c7b3b9f1b8fb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:35.917042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44180872-b21f-4ce5-b0d9-f68983fa7665 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:35.922977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91533dd-ca1c-4573-bfea-7a7480e2b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:35.923242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1873fc-b709-455e-836c-c7b3b9f1b8fb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:35.923805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91533dd-ca1c-4573-bfea-7a7480e2b819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.924053 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91533dd-ca1c-4573-bfea-7a7480e2b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.924393 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91533dd-ca1c-4573-bfea-7a7480e2b819 admin admin] PATH_INFO: `/v3/projects/dec1cf02bf2b42c7a9a0f5c6f3a87e05/users/8180362b990d49dba6ae64c2d55b9015/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.927754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe7cc2-b673-49fe-8d9e-60cd1e670f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:35.928387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe7cc2-b673-49fe-8d9e-60cd1e670f3d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:35.928661 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe7cc2-b673-49fe-8d9e-60cd1e670f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:35.928938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe7cc2-b673-49fe-8d9e-60cd1e670f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:35.929581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe7cc2-b673-49fe-8d9e-60cd1e670f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:35.931228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe7cc2-b673-49fe-8d9e-60cd1e670f3d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:35.940695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91533dd-ca1c-4573-bfea-7a7480e2b819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec1cf02bf2b42c7a9a0f5c6f3a87e05, user_id=8180362b990d49dba6ae64c2d55b9015, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:35.942083 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1073/2137] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:35.942720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe7cc2-b673-49fe-8d9e-60cd1e670f3d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:35.943532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91533dd-ca1c-4573-bfea-7a7480e2b819 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:35.953104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe7cc2-b673-49fe-8d9e-60cd1e670f3d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:35.961499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1065/2138] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:35 2022] PUT /identity/v3/projects/dec1cf02bf2b42c7a9a0f5c6f3a87e05/users/8180362b990d49dba6ae64c2d55b9015/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:35.969170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91533dd-ca1c-4573-bfea-7a7480e2b819 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.026387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77da419-efaf-4179-8949-63b0e7f09449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.026904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77da419-efaf-4179-8949-63b0e7f09449 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.027305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77da419-efaf-4179-8949-63b0e7f09449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.027654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77da419-efaf-4179-8949-63b0e7f09449 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.028381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77da419-efaf-4179-8949-63b0e7f09449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:36.028879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77da419-efaf-4179-8949-63b0e7f09449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.031006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77da419-efaf-4179-8949-63b0e7f09449 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.048018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1074/2139] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:36.049389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199715f-4559-4884-9ac4-0238d7858afc None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.049679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199715f-4559-4884-9ac4-0238d7858afc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.049944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199715f-4559-4884-9ac4-0238d7858afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.055754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91533dd-ca1c-4573-bfea-7a7480e2b819 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.060466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd145e1b-a244-4447-a47c-0f9722053c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.061137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd145e1b-a244-4447-a47c-0f9722053c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.061412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd145e1b-a244-4447-a47c-0f9722053c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.061683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd145e1b-a244-4447-a47c-0f9722053c07 admin admin] PATH_INFO: `/v3/projects/ae1e40b45ab24298b455a7cc76dc3f4d/users/af54fe2df458407185ba7741e3878297/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.077779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5199715f-4559-4884-9ac4-0238d7858afc None None] MFA Rules not processed for user `8180362b990d49dba6ae64c2d55b9015`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:36.078329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd145e1b-a244-4447-a47c-0f9722053c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1e40b45ab24298b455a7cc76dc3f4d, user_id=af54fe2df458407185ba7741e3878297, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.079002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5199715f-4559-4884-9ac4-0238d7858afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:36.081284 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd145e1b-a244-4447-a47c-0f9722053c07 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.095542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1066/2140] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:35 2022] PUT /identity/v3/projects/ae1e40b45ab24298b455a7cc76dc3f4d/users/af54fe2df458407185ba7741e3878297/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:36.096613 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd145e1b-a244-4447-a47c-0f9722053c07 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.098323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fd145e1b-a244-4447-a47c-0f9722053c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:36.100396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:36.148226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1075/2141] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:36.149071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199715f-4559-4884-9ac4-0238d7858afc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.162614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199715f-4559-4884-9ac4-0238d7858afc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.178745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd145e1b-a244-4447-a47c-0f9722053c07 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.184379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.185012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.185746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.185746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] PATH_INFO: `/v3/projects/a2a900feb65448c49206a2c93f05ec9d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.186768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a900feb65448c49206a2c93f05ec9d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.188801 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.219521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa945ace-39a0-405c-913e-7081bf95c617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.220143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa945ace-39a0-405c-913e-7081bf95c617 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.220442 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa945ace-39a0-405c-913e-7081bf95c617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.220744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa945ace-39a0-405c-913e-7081bf95c617 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.221356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa945ace-39a0-405c-913e-7081bf95c617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.223304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa945ace-39a0-405c-913e-7081bf95c617 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.237426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a900feb65448c49206a2c93f05ec9d', 'request_id': 'req-c070b8fe-2509-4807-a27b-dcf9cf3103f8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:36.244120 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a900feb65448c49206a2c93f05ec9d', 'request_id': 'req-c070b8fe-2509-4807-a27b-dcf9cf3103f8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:36.246785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:36.251511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1076/2142] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:36 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:36.253074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dede2-faff-4247-8a52-1005fc58c5c4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.253360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dede2-faff-4247-8a52-1005fc58c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.253676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dede2-faff-4247-8a52-1005fc58c5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.255525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a900feb65448c49206a2c93f05ec9d', 'request_id': 'req-c070b8fe-2509-4807-a27b-dcf9cf3103f8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:36.267330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] The token cache is being invalidate because project a2a900feb65448c49206a2c93f05ec9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:36.267614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:36.268378 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:36.270106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1067/2143] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:36 2022] DELETE /identity/v3/projects/a2a900feb65448c49206a2c93f05ec9d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:36.270890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.272170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:36.284904 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e36dede2-faff-4247-8a52-1005fc58c5c4 None None] MFA Rules not processed for user `af54fe2df458407185ba7741e3878297`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:36.286041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e36dede2-faff-4247-8a52-1005fc58c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:36.331630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b8fe-2509-4807-a27b-dcf9cf3103f8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.354010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1077/2144] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:36.354840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dede2-faff-4247-8a52-1005fc58c5c4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.356228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e36dede2-faff-4247-8a52-1005fc58c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:36.382054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b934c-5a52-40fe-9820-e91c30511136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.382664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b934c-5a52-40fe-9820-e91c30511136 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.382938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b934c-5a52-40fe-9820-e91c30511136 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.383209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b934c-5a52-40fe-9820-e91c30511136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.385281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-839b934c-5a52-40fe-9820-e91c30511136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:36.401121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:36.426331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dede2-faff-4247-8a52-1005fc58c5c4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.431449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099c539-7c9b-46dd-9d8a-e0f3665a1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.432441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099c539-7c9b-46dd-9d8a-e0f3665a1bab admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.432728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099c539-7c9b-46dd-9d8a-e0f3665a1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.433270 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099c539-7c9b-46dd-9d8a-e0f3665a1bab admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.433905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099c539-7c9b-46dd-9d8a-e0f3665a1bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.436397 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099c539-7c9b-46dd-9d8a-e0f3665a1bab admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.451461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b934c-5a52-40fe-9820-e91c30511136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.453206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b934c-5a52-40fe-9820-e91c30511136 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.461697 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1078/2145] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:36 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:36.463144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1068/2146] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:36.463577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c19ef3-c119-4b21-824f-a881c37e84a3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.463988 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c19ef3-c119-4b21-824f-a881c37e84a3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.464467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c19ef3-c119-4b21-824f-a881c37e84a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.464731 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b934c-5a52-40fe-9820-e91c30511136 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.466287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-839b934c-5a52-40fe-9820-e91c30511136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:36.480155 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b934c-5a52-40fe-9820-e91c30511136 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.486933 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f2c19ef3-c119-4b21-824f-a881c37e84a3 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:36.487956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1a4bc-38ba-4ee5-8b6e-9d80203543f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.488623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1a4bc-38ba-4ee5-8b6e-9d80203543f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.488898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1a4bc-38ba-4ee5-8b6e-9d80203543f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.489165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1a4bc-38ba-4ee5-8b6e-9d80203543f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.489801 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1a4bc-38ba-4ee5-8b6e-9d80203543f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.490464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f2c19ef3-c119-4b21-824f-a881c37e84a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:36.491954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1a4bc-38ba-4ee5-8b6e-9d80203543f3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.510277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1079/2147] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:36.510277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c19ef3-c119-4b21-824f-a881c37e84a3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.521683 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c19ef3-c119-4b21-824f-a881c37e84a3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.533312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6a4b4-3fa7-40df-86b9-18bef286b239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.533965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6a4b4-3fa7-40df-86b9-18bef286b239 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.534272 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6a4b4-3fa7-40df-86b9-18bef286b239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.534537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6a4b4-3fa7-40df-86b9-18bef286b239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.535465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6a4b4-3fa7-40df-86b9-18bef286b239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.537583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6a4b4-3fa7-40df-86b9-18bef286b239 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.542124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1069/2148] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:36 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:36.542124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb4b87-18ef-47fc-b168-b0235bdff744 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.542124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb4b87-18ef-47fc-b168-b0235bdff744 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.542124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb4b87-18ef-47fc-b168-b0235bdff744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.551323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1080/2149] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:36.552377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6a4b4-3fa7-40df-86b9-18bef286b239 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.564463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6a4b4-3fa7-40df-86b9-18bef286b239 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.571659 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6afb4b87-18ef-47fc-b168-b0235bdff744 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:36.573321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6afb4b87-18ef-47fc-b168-b0235bdff744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:36.632013 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:36.637980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e0d22-3e9c-467e-b51d-66254df1cf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.638927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e0d22-3e9c-467e-b51d-66254df1cf4c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.639272 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e0d22-3e9c-467e-b51d-66254df1cf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.639648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e0d22-3e9c-467e-b51d-66254df1cf4c admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.640339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e0d22-3e9c-467e-b51d-66254df1cf4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.643116 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e0d22-3e9c-467e-b51d-66254df1cf4c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.672698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1081/2150] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:36 2022] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:36.673678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e0d22-3e9c-467e-b51d-66254df1cf4c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.676670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1070/2151] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:36.677766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb4b87-18ef-47fc-b168-b0235bdff744 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.687371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e0d22-3e9c-467e-b51d-66254df1cf4c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.691713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb4b87-18ef-47fc-b168-b0235bdff744 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.694151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a045a-caf8-4fd1-bebb-b8cfa4739fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.694909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a045a-caf8-4fd1-bebb-b8cfa4739fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.695130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a045a-caf8-4fd1-bebb-b8cfa4739fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.695529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a045a-caf8-4fd1-bebb-b8cfa4739fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.696181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a045a-caf8-4fd1-bebb-b8cfa4739fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.698415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a045a-caf8-4fd1-bebb-b8cfa4739fcb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.701403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4d360-9db1-4b96-b5b9-b70dd7ee33cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.702028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4d360-9db1-4b96-b5b9-b70dd7ee33cd admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.702306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4d360-9db1-4b96-b5b9-b70dd7ee33cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.702578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4d360-9db1-4b96-b5b9-b70dd7ee33cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.703221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4d360-9db1-4b96-b5b9-b70dd7ee33cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.708844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4d360-9db1-4b96-b5b9-b70dd7ee33cd admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.712321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1082/2152] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:36.712922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a045a-caf8-4fd1-bebb-b8cfa4739fcb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.725510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a045a-caf8-4fd1-bebb-b8cfa4739fcb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.726911 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1071/2153] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:36.728353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4d360-9db1-4b96-b5b9-b70dd7ee33cd admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.730944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555cc12-31ca-469d-a3da-b1ea507ba4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.731556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555cc12-31ca-469d-a3da-b1ea507ba4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.731831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555cc12-31ca-469d-a3da-b1ea507ba4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.732670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555cc12-31ca-469d-a3da-b1ea507ba4bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.733781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555cc12-31ca-469d-a3da-b1ea507ba4bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:36.734084 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555cc12-31ca-469d-a3da-b1ea507ba4bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.735737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555cc12-31ca-469d-a3da-b1ea507ba4bf admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.741780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4d360-9db1-4b96-b5b9-b70dd7ee33cd admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.747037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea002ce-d45b-48fe-baba-5b34b02ac8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.752356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea002ce-d45b-48fe-baba-5b34b02ac8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.752356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea002ce-d45b-48fe-baba-5b34b02ac8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.752605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1083/2154] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:36.752734 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea002ce-d45b-48fe-baba-5b34b02ac8d4 admin admin] PATH_INFO: `/v3/projects/0fd03bf46e074d56949aa64a9d9bacfc/users/fe66d91a78164d07a8ce7473c22ae4ab/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.752833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ee83e-ebc0-47b5-8e04-9bd97179a0aa None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.752833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ee83e-ebc0-47b5-8e04-9bd97179a0aa None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.752833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ee83e-ebc0-47b5-8e04-9bd97179a0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.771290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea002ce-d45b-48fe-baba-5b34b02ac8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd03bf46e074d56949aa64a9d9bacfc, user_id=fe66d91a78164d07a8ce7473c22ae4ab, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.771529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b78ee83e-ebc0-47b5-8e04-9bd97179a0aa None None] MFA Rules not processed for user `05a9bc165e1046ebbba3ab0aa4432b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:36.772676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b78ee83e-ebc0-47b5-8e04-9bd97179a0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:36.774719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea002ce-d45b-48fe-baba-5b34b02ac8d4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.789679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1072/2155] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:36 2022] PUT /identity/v3/projects/0fd03bf46e074d56949aa64a9d9bacfc/users/fe66d91a78164d07a8ce7473c22ae4ab/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:36.790649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea002ce-d45b-48fe-baba-5b34b02ac8d4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.855553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1084/2156] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:36.856995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ee83e-ebc0-47b5-8e04-9bd97179a0aa None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:36.869111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ee83e-ebc0-47b5-8e04-9bd97179a0aa None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.890650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:36.896255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea002ce-d45b-48fe-baba-5b34b02ac8d4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:36.903132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0f9a7-f713-45b7-8276-4e8e7af331b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.903815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0f9a7-f713-45b7-8276-4e8e7af331b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.904188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0f9a7-f713-45b7-8276-4e8e7af331b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.904500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0f9a7-f713-45b7-8276-4e8e7af331b0 admin admin] PATH_INFO: `/v3/projects/e16d965443584ab4ba2aa8c33706b9d4/users/2ad05a63a3494e908f9e99b70b4111be/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.937034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0f9a7-f713-45b7-8276-4e8e7af331b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16d965443584ab4ba2aa8c33706b9d4, user_id=2ad05a63a3494e908f9e99b70b4111be, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.939890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0f9a7-f713-45b7-8276-4e8e7af331b0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.959632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1073/2157] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:36 2022] PUT /identity/v3/projects/e16d965443584ab4ba2aa8c33706b9d4/users/2ad05a63a3494e908f9e99b70b4111be/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:36.959848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2c046-8b6d-4f20-9d6e-66e15b63aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:36.959848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2c046-8b6d-4f20-9d6e-66e15b63aa4e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.959848 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2c046-8b6d-4f20-9d6e-66e15b63aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.960125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949a75e-c5f3-41b8-bd04-15f714bcb87a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:36.960212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2c046-8b6d-4f20-9d6e-66e15b63aa4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.960333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949a75e-c5f3-41b8-bd04-15f714bcb87a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:36.960333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949a75e-c5f3-41b8-bd04-15f714bcb87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:36.960491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2c046-8b6d-4f20-9d6e-66e15b63aa4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:36.961876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2c046-8b6d-4f20-9d6e-66e15b63aa4e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:36.989751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9949a75e-c5f3-41b8-bd04-15f714bcb87a None None] MFA Rules not processed for user `fe66d91a78164d07a8ce7473c22ae4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:36.991129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9949a75e-c5f3-41b8-bd04-15f714bcb87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:36.997941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1085/2158] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:36 2022] POST /identity/v3/projects => generated 403 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:36.997941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2c046-8b6d-4f20-9d6e-66e15b63aa4e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.067774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2c046-8b6d-4f20-9d6e-66e15b63aa4e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.073008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d0e9b-36a3-4aba-9970-458bb1c824a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.073628 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d0e9b-36a3-4aba-9970-458bb1c824a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.073905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d0e9b-36a3-4aba-9970-458bb1c824a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.074172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d0e9b-36a3-4aba-9970-458bb1c824a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.074913 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d0e9b-36a3-4aba-9970-458bb1c824a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.077477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d0e9b-36a3-4aba-9970-458bb1c824a4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.077995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1074/2159] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:37.079020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949a75e-c5f3-41b8-bd04-15f714bcb87a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.091320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:37.097694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1086/2160] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:37.097694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d0e9b-36a3-4aba-9970-458bb1c824a4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.108606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d0e9b-36a3-4aba-9970-458bb1c824a4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.114688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a0d29-6252-453c-906c-33f00422fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.115392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a0d29-6252-453c-906c-33f00422fae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.115732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a0d29-6252-453c-906c-33f00422fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.115990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a0d29-6252-453c-906c-33f00422fae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.116661 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a0d29-6252-453c-906c-33f00422fae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.118804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a0d29-6252-453c-906c-33f00422fae2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.155275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949a75e-c5f3-41b8-bd04-15f714bcb87a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.155963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1087/2161] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:37 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:37.156832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a0d29-6252-453c-906c-33f00422fae2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.227221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259f468-1931-4127-95ce-bd5e1d2a96d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.227917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259f468-1931-4127-95ce-bd5e1d2a96d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.228324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259f468-1931-4127-95ce-bd5e1d2a96d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.228626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259f468-1931-4127-95ce-bd5e1d2a96d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.229343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259f468-1931-4127-95ce-bd5e1d2a96d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.230558 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a0d29-6252-453c-906c-33f00422fae2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.231703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259f468-1931-4127-95ce-bd5e1d2a96d7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.236093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35d2f9-4f8f-4c0a-8c6a-432c8cc7cad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.236791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35d2f9-4f8f-4c0a-8c6a-432c8cc7cad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.237112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35d2f9-4f8f-4c0a-8c6a-432c8cc7cad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.237386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35d2f9-4f8f-4c0a-8c6a-432c8cc7cad8 admin admin] PATH_INFO: `/v3/projects/e16d965443584ab4ba2aa8c33706b9d4/users/2ad05a63a3494e908f9e99b70b4111be/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.239284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35d2f9-4f8f-4c0a-8c6a-432c8cc7cad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16d965443584ab4ba2aa8c33706b9d4, user_id=2ad05a63a3494e908f9e99b70b4111be, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.242667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35d2f9-4f8f-4c0a-8c6a-432c8cc7cad8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.254607 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1088/2162] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:37 2022] PUT /identity/v3/projects/e16d965443584ab4ba2aa8c33706b9d4/users/2ad05a63a3494e908f9e99b70b4111be/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:37.255412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35d2f9-4f8f-4c0a-8c6a-432c8cc7cad8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.262517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1075/2163] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:37 2022] POST /identity/v3/users => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:37.264764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259f468-1931-4127-95ce-bd5e1d2a96d7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.274869 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259f468-1931-4127-95ce-bd5e1d2a96d7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.276589 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:37.338946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35d2f9-4f8f-4c0a-8c6a-432c8cc7cad8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.339865 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edf897-d479-4a2c-9bfe-a7777112d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.340531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edf897-d479-4a2c-9bfe-a7777112d765 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.342189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edf897-d479-4a2c-9bfe-a7777112d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.342189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edf897-d479-4a2c-9bfe-a7777112d765 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.342189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71edf897-d479-4a2c-9bfe-a7777112d765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.344224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71edf897-d479-4a2c-9bfe-a7777112d765 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.350433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849bccc-9e4d-4a8b-8bf8-eaf553fb33f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.351297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849bccc-9e4d-4a8b-8bf8-eaf553fb33f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.351681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849bccc-9e4d-4a8b-8bf8-eaf553fb33f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.352102 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849bccc-9e4d-4a8b-8bf8-eaf553fb33f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.352774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849bccc-9e4d-4a8b-8bf8-eaf553fb33f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.354810 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849bccc-9e4d-4a8b-8bf8-eaf553fb33f9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.356625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1076/2164] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:37.358426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49cfb-ec14-4aee-ac9b-4c7d7217bc95 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.358717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49cfb-ec14-4aee-ac9b-4c7d7217bc95 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.359003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49cfb-ec14-4aee-ac9b-4c7d7217bc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.384097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1089/2165] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:37 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:37.384097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849bccc-9e4d-4a8b-8bf8-eaf553fb33f9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.394498 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849bccc-9e4d-4a8b-8bf8-eaf553fb33f9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.399804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-75f49cfb-ec14-4aee-ac9b-4c7d7217bc95 None None] MFA Rules not processed for user `2ad05a63a3494e908f9e99b70b4111be`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:37.400318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33705cc8-d216-4d2c-9e6d-d1b9df4c031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.400821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33705cc8-d216-4d2c-9e6d-d1b9df4c031c admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.401218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33705cc8-d216-4d2c-9e6d-d1b9df4c031c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.401627 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33705cc8-d216-4d2c-9e6d-d1b9df4c031c admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.401867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-75f49cfb-ec14-4aee-ac9b-4c7d7217bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:37.402276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33705cc8-d216-4d2c-9e6d-d1b9df4c031c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.404188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33705cc8-d216-4d2c-9e6d-d1b9df4c031c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.421181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1090/2166] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:37.422532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33705cc8-d216-4d2c-9e6d-d1b9df4c031c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.438560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33705cc8-d216-4d2c-9e6d-d1b9df4c031c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.442336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:37.443666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f1ebf-3cbf-4578-ae67-4cf10d0c8c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.444390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1ebf-3cbf-4578-ae67-4cf10d0c8c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.444760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1ebf-3cbf-4578-ae67-4cf10d0c8c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.445216 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1ebf-3cbf-4578-ae67-4cf10d0c8c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.445940 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f1ebf-3cbf-4578-ae67-4cf10d0c8c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.448054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f1ebf-3cbf-4578-ae67-4cf10d0c8c70 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.472354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1091/2167] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:37.473431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f1ebf-3cbf-4578-ae67-4cf10d0c8c70 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.488527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f1ebf-3cbf-4578-ae67-4cf10d0c8c70 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.493512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec6fb4-6cdc-46d7-a12c-085fee2fe461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.494190 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec6fb4-6cdc-46d7-a12c-085fee2fe461 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.494468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec6fb4-6cdc-46d7-a12c-085fee2fe461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.494743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec6fb4-6cdc-46d7-a12c-085fee2fe461 admin admin] PATH_INFO: `/v3/projects/23c21edf1ac04a19b25ec9be8c436c2a/users/4b9743aad08540a0bf8dc116fd6727e8/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.501730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1077/2168] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:37.502969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f49cfb-ec14-4aee-ac9b-4c7d7217bc95 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.516757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec6fb4-6cdc-46d7-a12c-085fee2fe461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c21edf1ac04a19b25ec9be8c436c2a, user_id=4b9743aad08540a0bf8dc116fd6727e8, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.519785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec6fb4-6cdc-46d7-a12c-085fee2fe461 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.522094 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f49cfb-ec14-4aee-ac9b-4c7d7217bc95 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.527896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2dea1-a188-4415-ab9f-18fd59e8a915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.528736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2dea1-a188-4415-ab9f-18fd59e8a915 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.529183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2dea1-a188-4415-ab9f-18fd59e8a915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.529550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2dea1-a188-4415-ab9f-18fd59e8a915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.530625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2dea1-a188-4415-ab9f-18fd59e8a915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.532295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2dea1-a188-4415-ab9f-18fd59e8a915 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.544415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1092/2169] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:37 2022] PUT /identity/v3/projects/23c21edf1ac04a19b25ec9be8c436c2a/users/4b9743aad08540a0bf8dc116fd6727e8/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:37.544415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec6fb4-6cdc-46d7-a12c-085fee2fe461 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.557080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1078/2170] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:37.558594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63d3ad-6751-4837-9ce9-5fc164b35ef1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.559004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63d3ad-6751-4837-9ce9-5fc164b35ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.559411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63d3ad-6751-4837-9ce9-5fc164b35ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.591227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ba63d3ad-6751-4837-9ce9-5fc164b35ef1 None None] MFA Rules not processed for user `4b9743aad08540a0bf8dc116fd6727e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:37.592610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ba63d3ad-6751-4837-9ce9-5fc164b35ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:37.616069 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec6fb4-6cdc-46d7-a12c-085fee2fe461 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.619773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc7f4e-c436-47c3-96ac-297562554255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.620423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc7f4e-c436-47c3-96ac-297562554255 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.620699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc7f4e-c436-47c3-96ac-297562554255 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.621417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc7f4e-c436-47c3-96ac-297562554255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.622792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b4dc7f4e-c436-47c3-96ac-297562554255 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:37.690666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1079/2171] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:37.691593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63d3ad-6751-4837-9ce9-5fc164b35ef1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.693609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc7f4e-c436-47c3-96ac-297562554255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.695314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc7f4e-c436-47c3-96ac-297562554255 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.711916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1093/2172] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:37.713400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc7f4e-c436-47c3-96ac-297562554255 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.739649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:37.840803 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc7f4e-c436-47c3-96ac-297562554255 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.847639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b4817-9199-4c90-8b28-3795fe57e390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.848339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b4817-9199-4c90-8b28-3795fe57e390 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.848724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b4817-9199-4c90-8b28-3795fe57e390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.849037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b4817-9199-4c90-8b28-3795fe57e390 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.849678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63d3ad-6751-4837-9ce9-5fc164b35ef1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:37.850033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b4817-9199-4c90-8b28-3795fe57e390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.853546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b4817-9199-4c90-8b28-3795fe57e390 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.862571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ad932-1058-4da3-9236-7b2c9ed635cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:37.863265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ad932-1058-4da3-9236-7b2c9ed635cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.863543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ad932-1058-4da3-9236-7b2c9ed635cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.863813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ad932-1058-4da3-9236-7b2c9ed635cc admin admin] PATH_INFO: `/v3/projects/accc656faa084602bc63762c9b6b187f/users/c010fa3dd2c4414082033d73952cd8bf/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.892807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1094/2173] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:37 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:37.897227 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b4817-9199-4c90-8b28-3795fe57e390 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:37.897390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ad932-1058-4da3-9236-7b2c9ed635cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=accc656faa084602bc63762c9b6b187f, user_id=c010fa3dd2c4414082033d73952cd8bf, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:37.901160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ad932-1058-4da3-9236-7b2c9ed635cc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:37.932111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1080/2174] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:37 2022] PUT /identity/v3/projects/accc656faa084602bc63762c9b6b187f/users/c010fa3dd2c4414082033d73952cd8bf/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:37.934600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c26bc-5677-42bf-a272-df070fe663e2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:37.934963 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c26bc-5677-42bf-a272-df070fe663e2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:37.935497 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c26bc-5677-42bf-a272-df070fe663e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:37.977908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-750c26bc-5677-42bf-a272-df070fe663e2 None None] MFA Rules not processed for user `c010fa3dd2c4414082033d73952cd8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:37.979952 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-750c26bc-5677-42bf-a272-df070fe663e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:38.019465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b4817-9199-4c90-8b28-3795fe57e390 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.040570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:38.121711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c0658-aee4-495c-812c-63812e0efcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.123326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c0658-aee4-495c-812c-63812e0efcb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.123745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c0658-aee4-495c-812c-63812e0efcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.124031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c0658-aee4-495c-812c-63812e0efcb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.124820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c0658-aee4-495c-812c-63812e0efcb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.129428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c0658-aee4-495c-812c-63812e0efcb8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.151652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1081/2175] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:38.156721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c26bc-5677-42bf-a272-df070fe663e2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:38.173391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1095/2176] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:37 2022] POST /identity/v3/users => generated 309 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:13:38.176456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c0658-aee4-495c-812c-63812e0efcb8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:38.186351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c26bc-5677-42bf-a272-df070fe663e2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.194834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c0658-aee4-495c-812c-63812e0efcb8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.199537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb008ed-9ba0-4e00-948c-e0c047d05432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.200758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb008ed-9ba0-4e00-948c-e0c047d05432 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.201243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb008ed-9ba0-4e00-948c-e0c047d05432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.201709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb008ed-9ba0-4e00-948c-e0c047d05432 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.203023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb008ed-9ba0-4e00-948c-e0c047d05432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.205618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb008ed-9ba0-4e00-948c-e0c047d05432 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.207517 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fefcb-b921-41ec-95c3-4c83b1e25ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.208406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fefcb-b921-41ec-95c3-4c83b1e25ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.208651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fefcb-b921-41ec-95c3-4c83b1e25ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.209003 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fefcb-b921-41ec-95c3-4c83b1e25ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.209752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fefcb-b921-41ec-95c3-4c83b1e25ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.211804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fefcb-b921-41ec-95c3-4c83b1e25ce5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.247292 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1096/2177] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:38.248530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fefcb-b921-41ec-95c3-4c83b1e25ce5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:38.252758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1082/2178] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:38 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:38.255805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb008ed-9ba0-4e00-948c-e0c047d05432 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:38.259685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fefcb-b921-41ec-95c3-4c83b1e25ce5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.287530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:38.348811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb008ed-9ba0-4e00-948c-e0c047d05432 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.353000 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db1fb3-42a0-438b-971f-36771eaff007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.353789 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db1fb3-42a0-438b-971f-36771eaff007 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.354158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db1fb3-42a0-438b-971f-36771eaff007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.354503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db1fb3-42a0-438b-971f-36771eaff007 admin admin] PATH_INFO: `/v3/projects/4a3dc720231f42d29feb9a4016433698/users/b5ffa11d46b44ffe92b766f874004663/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.354879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38e58c-be36-49e3-b107-f76062793001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.355703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38e58c-be36-49e3-b107-f76062793001 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.355980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38e58c-be36-49e3-b107-f76062793001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.356259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38e58c-be36-49e3-b107-f76062793001 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.356972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38e58c-be36-49e3-b107-f76062793001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.359103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38e58c-be36-49e3-b107-f76062793001 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.380113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db1fb3-42a0-438b-971f-36771eaff007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3dc720231f42d29feb9a4016433698, user_id=b5ffa11d46b44ffe92b766f874004663, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.383739 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db1fb3-42a0-438b-971f-36771eaff007 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.385780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1083/2179] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:38 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:38.391461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38e58c-be36-49e3-b107-f76062793001 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:38.400759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1097/2180] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:38 2022] PUT /identity/v3/projects/4a3dc720231f42d29feb9a4016433698/users/b5ffa11d46b44ffe92b766f874004663/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:38.403955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38e58c-be36-49e3-b107-f76062793001 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.405203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db1fb3-42a0-438b-971f-36771eaff007 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:38.466900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ad156-f4b6-4594-b8e3-c62733609dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.467528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ad156-f4b6-4594-b8e3-c62733609dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.467807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ad156-f4b6-4594-b8e3-c62733609dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.468079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ad156-f4b6-4594-b8e3-c62733609dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.468768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ad156-f4b6-4594-b8e3-c62733609dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.470452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ad156-f4b6-4594-b8e3-c62733609dc4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.471736 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db1fb3-42a0-438b-971f-36771eaff007 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.476865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c23e15-17bc-4f6a-8a8f-f1480f3acae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.477559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c23e15-17bc-4f6a-8a8f-f1480f3acae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.477759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c23e15-17bc-4f6a-8a8f-f1480f3acae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.478029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c23e15-17bc-4f6a-8a8f-f1480f3acae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.478681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c23e15-17bc-4f6a-8a8f-f1480f3acae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.484231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c23e15-17bc-4f6a-8a8f-f1480f3acae8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.484453 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1084/2181] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:38.485646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ad156-f4b6-4594-b8e3-c62733609dc4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:38.492915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1098/2182] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:38.496957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c23e15-17bc-4f6a-8a8f-f1480f3acae8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:38.497131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ad156-f4b6-4594-b8e3-c62733609dc4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.502560 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5895e59-69b5-483f-9c4a-268973b9a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.503891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5895e59-69b5-483f-9c4a-268973b9a0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.503891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5895e59-69b5-483f-9c4a-268973b9a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.504112 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5895e59-69b5-483f-9c4a-268973b9a0b9 admin admin] PATH_INFO: `/v3/projects/7ce13c1929b044e7a28ea7ccea911fc6/users/9ae2d02123734c3d87f4080a2d6dfc0d/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.507872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c23e15-17bc-4f6a-8a8f-f1480f3acae8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.514195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fc60a-1e14-49b1-be5c-811b1202276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.515091 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fc60a-1e14-49b1-be5c-811b1202276a admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.515822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fc60a-1e14-49b1-be5c-811b1202276a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.516191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fc60a-1e14-49b1-be5c-811b1202276a admin admin] PATH_INFO: `/v3/projects/4a3dc720231f42d29feb9a4016433698/users/b5ffa11d46b44ffe92b766f874004663/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.519229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fc60a-1e14-49b1-be5c-811b1202276a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3dc720231f42d29feb9a4016433698, user_id=b5ffa11d46b44ffe92b766f874004663, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.522544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fc60a-1e14-49b1-be5c-811b1202276a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.523575 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5895e59-69b5-483f-9c4a-268973b9a0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce13c1929b044e7a28ea7ccea911fc6, user_id=9ae2d02123734c3d87f4080a2d6dfc0d, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.526375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5895e59-69b5-483f-9c4a-268973b9a0b9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.534756 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1099/2183] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:38 2022] PUT /identity/v3/projects/4a3dc720231f42d29feb9a4016433698/users/b5ffa11d46b44ffe92b766f874004663/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:38.537557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:38.545525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1085/2184] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:38 2022] PUT /identity/v3/projects/7ce13c1929b044e7a28ea7ccea911fc6/users/9ae2d02123734c3d87f4080a2d6dfc0d/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:38.549808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5895e59-69b5-483f-9c4a-268973b9a0b9 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:38.549970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614c1b-e184-40f6-bffc-a66499c340f4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.550157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614c1b-e184-40f6-bffc-a66499c340f4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.550444 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614c1b-e184-40f6-bffc-a66499c340f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.598405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c9614c1b-e184-40f6-bffc-a66499c340f4 None None] MFA Rules not processed for user `b5ffa11d46b44ffe92b766f874004663`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:38.599839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c9614c1b-e184-40f6-bffc-a66499c340f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:38.645477 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5895e59-69b5-483f-9c4a-268973b9a0b9 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.652263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8908797-409e-4f12-8f47-4030ea9bcdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.652263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8908797-409e-4f12-8f47-4030ea9bcdbe admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.652602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8908797-409e-4f12-8f47-4030ea9bcdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.652885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8908797-409e-4f12-8f47-4030ea9bcdbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.653709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8908797-409e-4f12-8f47-4030ea9bcdbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.656330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8908797-409e-4f12-8f47-4030ea9bcdbe admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.677174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1086/2185] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:38.678192 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8908797-409e-4f12-8f47-4030ea9bcdbe admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:38.689536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8908797-409e-4f12-8f47-4030ea9bcdbe admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.691923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1100/2186] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:38.694286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4b468-1aee-4ece-972c-2df689b27e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.694936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4b468-1aee-4ece-972c-2df689b27e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.695286 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4b468-1aee-4ece-972c-2df689b27e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.696663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4b468-1aee-4ece-972c-2df689b27e3d admin admin] PATH_INFO: `/v3/projects/7ce13c1929b044e7a28ea7ccea911fc6/users/9ae2d02123734c3d87f4080a2d6dfc0d/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.698723 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4b468-1aee-4ece-972c-2df689b27e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce13c1929b044e7a28ea7ccea911fc6, user_id=9ae2d02123734c3d87f4080a2d6dfc0d, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.701736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4b468-1aee-4ece-972c-2df689b27e3d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.703167 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9614c1b-e184-40f6-bffc-a66499c340f4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:38.704519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c9614c1b-e184-40f6-bffc-a66499c340f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:38.712425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1087/2187] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:38 2022] PUT /identity/v3/projects/7ce13c1929b044e7a28ea7ccea911fc6/users/9ae2d02123734c3d87f4080a2d6dfc0d/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:38.719035 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:38.723186 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec105-932a-4682-80be-378940d9e5df None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.723466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec105-932a-4682-80be-378940d9e5df None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.723740 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec105-932a-4682-80be-378940d9e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.753060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c65ec105-932a-4682-80be-378940d9e5df None None] MFA Rules not processed for user `9ae2d02123734c3d87f4080a2d6dfc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:38.754626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c65ec105-932a-4682-80be-378940d9e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:38.763816 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9614c1b-e184-40f6-bffc-a66499c340f4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.814725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64025cfb-7c4a-48c5-b0ee-0199264fff58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.815322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64025cfb-7c4a-48c5-b0ee-0199264fff58 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.815599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64025cfb-7c4a-48c5-b0ee-0199264fff58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.815903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64025cfb-7c4a-48c5-b0ee-0199264fff58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.826727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1088/2188] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:38.837890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec105-932a-4682-80be-378940d9e5df None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:38.848849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec105-932a-4682-80be-378940d9e5df None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:38.852867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14688eb3-b2fb-4048-a841-0841e04b51b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:38.853413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14688eb3-b2fb-4048-a841-0841e04b51b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:38.853685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14688eb3-b2fb-4048-a841-0841e04b51b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:38.853953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14688eb3-b2fb-4048-a841-0841e04b51b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:38.863486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14688eb3-b2fb-4048-a841-0841e04b51b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.865016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14688eb3-b2fb-4048-a841-0841e04b51b7 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.875505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1089/2189] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:13:38.887226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64025cfb-7c4a-48c5-b0ee-0199264fff58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:38.889222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64025cfb-7c4a-48c5-b0ee-0199264fff58 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:38.902439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1101/2190] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:38 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:13:39.077571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14688eb3-b2fb-4048-a841-0841e04b51b7 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:39.160016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:39.166326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14688eb3-b2fb-4048-a841-0841e04b51b7 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:39.173355 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2e66d-7709-4258-8946-1e1c3cc012cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:39.174002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2e66d-7709-4258-8946-1e1c3cc012cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:39.174277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2e66d-7709-4258-8946-1e1c3cc012cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:39.174586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2e66d-7709-4258-8946-1e1c3cc012cf admin admin] PATH_INFO: `/v3/users/4b9743aad08540a0bf8dc116fd6727e8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:39.175799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2e66d-7709-4258-8946-1e1c3cc012cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b9743aad08540a0bf8dc116fd6727e8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:39.177932 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2e66d-7709-4258-8946-1e1c3cc012cf admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:39.301282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-efd2e66d-7709-4258-8946-1e1c3cc012cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b9743aad08540a0bf8dc116fd6727e8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:39.302167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-efd2e66d-7709-4258-8946-1e1c3cc012cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b9743aad08540a0bf8dc116fd6727e8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:39.315919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-efd2e66d-7709-4258-8946-1e1c3cc012cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b9743aad08540a0bf8dc116fd6727e8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:39.322441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-efd2e66d-7709-4258-8946-1e1c3cc012cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b9743aad08540a0bf8dc116fd6727e8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:39.355647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-efd2e66d-7709-4258-8946-1e1c3cc012cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b9743aad08540a0bf8dc116fd6727e8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:39.371063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64025cfb-7c4a-48c5-b0ee-0199264fff58 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:39.372895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-64025cfb-7c4a-48c5-b0ee-0199264fff58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:39.380397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1090/2191] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:39 2022] DELETE /identity/v3/users/4b9743aad08540a0bf8dc116fd6727e8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:39.386149 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2028ac6-830e-4af2-950c-37b834955b07 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:39.386447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2028ac6-830e-4af2-950c-37b834955b07 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:39.386726 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2028ac6-830e-4af2-950c-37b834955b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:39.406659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64025cfb-7c4a-48c5-b0ee-0199264fff58 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:39.437812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c2028ac6-830e-4af2-950c-37b834955b07 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:39.441207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c2028ac6-830e-4af2-950c-37b834955b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:39.534578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:39.535760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:39.536035 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:39.536329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] PATH_INFO: `/v3/users/8180362b990d49dba6ae64c2d55b9015` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:39.537798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8180362b990d49dba6ae64c2d55b9015)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:39.540145 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:39.577519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1091/2192] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:39.579040 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2028ac6-830e-4af2-950c-37b834955b07 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:39.581031 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c2028ac6-830e-4af2-950c-37b834955b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:39.587698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:39.630055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8180362b990d49dba6ae64c2d55b9015'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:39.630788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8180362b990d49dba6ae64c2d55b9015'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:39.641678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8180362b990d49dba6ae64c2d55b9015'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:39.651412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8180362b990d49dba6ae64c2d55b9015'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:39.652406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8180362b990d49dba6ae64c2d55b9015'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:39.665665 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2028ac6-830e-4af2-950c-37b834955b07 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:39.670309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5944576-016f-4e08-8fc6-96315cd21b75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:39.670574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5944576-016f-4e08-8fc6-96315cd21b75 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:39.670856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5944576-016f-4e08-8fc6-96315cd21b75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:39.671765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5944576-016f-4e08-8fc6-96315cd21b75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:39.673670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b5944576-016f-4e08-8fc6-96315cd21b75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:39.676785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1102/2193] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:39 2022] DELETE /identity/v3/users/8180362b990d49dba6ae64c2d55b9015 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:39.680506 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:39.681862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:39.714169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:39.755490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5944576-016f-4e08-8fc6-96315cd21b75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:39.757637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5944576-016f-4e08-8fc6-96315cd21b75 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:39.762218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4a9d7-05bb-4591-a9ce-bfcc2615c853 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:39.768338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1092/2194] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:39.768338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5944576-016f-4e08-8fc6-96315cd21b75 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:39.769733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b5944576-016f-4e08-8fc6-96315cd21b75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:39.780828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f582ba-e582-4a66-ad57-420bbe9980a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:39.781473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f582ba-e582-4a66-ad57-420bbe9980a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:39.781602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5944576-016f-4e08-8fc6-96315cd21b75 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:39.781757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f582ba-e582-4a66-ad57-420bbe9980a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:39.782018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f582ba-e582-4a66-ad57-420bbe9980a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:39.783856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-65f582ba-e582-4a66-ad57-420bbe9980a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:39.870485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e4ce5-f644-4f35-a0e0-33e1ff7d3b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:39.871472 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e4ce5-f644-4f35-a0e0-33e1ff7d3b65 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:39.871940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e4ce5-f644-4f35-a0e0-33e1ff7d3b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:39.872352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e4ce5-f644-4f35-a0e0-33e1ff7d3b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:39.879019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0b4e4ce5-f644-4f35-a0e0-33e1ff7d3b65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:39.893852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f582ba-e582-4a66-ad57-420bbe9980a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:39.896532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f582ba-e582-4a66-ad57-420bbe9980a5 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:39.910250 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1103/2195] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:39.912550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5c5fd-3270-4629-8b9e-ec55ff8c5bf2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:39.913043 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5c5fd-3270-4629-8b9e-ec55ff8c5bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:39.913551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5c5fd-3270-4629-8b9e-ec55ff8c5bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:39.960509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e4ce5-f644-4f35-a0e0-33e1ff7d3b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:39.962255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e4ce5-f644-4f35-a0e0-33e1ff7d3b65 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:39.962963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-beb5c5fd-3270-4629-8b9e-ec55ff8c5bf2 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:39.964701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-beb5c5fd-3270-4629-8b9e-ec55ff8c5bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:39.976410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1093/2196] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:39.982312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1104/2197] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:40.003099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e4ce5-f644-4f35-a0e0-33e1ff7d3b65 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:40.024019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e4ce5-f644-4f35-a0e0-33e1ff7d3b65 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:40.030355 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bdaf0-c0ca-46fd-a69f-fd7e4bb114fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:40.031252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bdaf0-c0ca-46fd-a69f-fd7e4bb114fd service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:40.031808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bdaf0-c0ca-46fd-a69f-fd7e4bb114fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:40.033090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bdaf0-c0ca-46fd-a69f-fd7e4bb114fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:40.059387 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bdaf0-c0ca-46fd-a69f-fd7e4bb114fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:40.062247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bdaf0-c0ca-46fd-a69f-fd7e4bb114fd service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:40.082999 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1094/2198] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:40.455229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5c5fd-3270-4629-8b9e-ec55ff8c5bf2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:40.458817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-beb5c5fd-3270-4629-8b9e-ec55ff8c5bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:40.491259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5c5fd-3270-4629-8b9e-ec55ff8c5bf2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:40.500671 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:40.501977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:40.502921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:40.503365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] PATH_INFO: `/v3/projects/23c21edf1ac04a19b25ec9be8c436c2a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:40.515597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c21edf1ac04a19b25ec9be8c436c2a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:40.519687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:40.596101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bdaf0-c0ca-46fd-a69f-fd7e4bb114fd service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:40.599228 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9b8bdaf0-c0ca-46fd-a69f-fd7e4bb114fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:40.609913 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:40.616191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bdaf0-c0ca-46fd-a69f-fd7e4bb114fd service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:40.621421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c21edf1ac04a19b25ec9be8c436c2a', 'request_id': 'req-255ce406-e9a3-44a2-81be-b450b61e0000'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.628474 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c21edf1ac04a19b25ec9be8c436c2a', 'request_id': 'req-255ce406-e9a3-44a2-81be-b450b61e0000'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.635795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c21edf1ac04a19b25ec9be8c436c2a', 'request_id': 'req-255ce406-e9a3-44a2-81be-b450b61e0000'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.670476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] The token cache is being invalidate because project 23c21edf1ac04a19b25ec9be8c436c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:40.670841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.671770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.674669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1105/2199] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:40 2022] DELETE /identity/v3/projects/23c21edf1ac04a19b25ec9be8c436c2a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:40.680633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:40.682284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:40.725346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:40.726024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:40.726306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:40.726626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] PATH_INFO: `/v3/projects/dec1cf02bf2b42c7a9a0f5c6f3a87e05` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:40.727730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec1cf02bf2b42c7a9a0f5c6f3a87e05)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:40.729805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:40.744086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:40.774666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ce406-e9a3-44a2-81be-b450b61e0000 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:40.781767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:40.781985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:40.782256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:40.782487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] PATH_INFO: `/v3/users/b5ffa11d46b44ffe92b766f874004663` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:40.783635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ffa11d46b44ffe92b766f874004663)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:40.785685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:40.795130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec1cf02bf2b42c7a9a0f5c6f3a87e05', 'request_id': 'req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.801825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec1cf02bf2b42c7a9a0f5c6f3a87e05', 'request_id': 'req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.811797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec1cf02bf2b42c7a9a0f5c6f3a87e05', 'request_id': 'req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.824906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] The token cache is being invalidate because project dec1cf02bf2b42c7a9a0f5c6f3a87e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:40.825198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.826050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.827960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1095/2200] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:40 2022] DELETE /identity/v3/projects/dec1cf02bf2b42c7a9a0f5c6f3a87e05 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:40.828948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:40.846198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:40.874282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ffa11d46b44ffe92b766f874004663'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.875382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ffa11d46b44ffe92b766f874004663'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.894906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ffa11d46b44ffe92b766f874004663'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.913864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ffa11d46b44ffe92b766f874004663'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.914743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ffa11d46b44ffe92b766f874004663'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:40.948046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1106/2201] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:40 2022] DELETE /identity/v3/users/b5ffa11d46b44ffe92b766f874004663 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:40.966548 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd4ef9-8213-4d7d-8aaf-a7643cd79277 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:41.061351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdd361-abe9-4789-b5d2-cfed5a41d610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:41.062108 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdd361-abe9-4789-b5d2-cfed5a41d610 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:41.062391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdd361-abe9-4789-b5d2-cfed5a41d610 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:41.062662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdd361-abe9-4789-b5d2-cfed5a41d610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:41.065191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-dfcdd361-abe9-4789-b5d2-cfed5a41d610 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:41.144319 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdd361-abe9-4789-b5d2-cfed5a41d610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:41.145992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdd361-abe9-4789-b5d2-cfed5a41d610 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:41.157732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1096/2202] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:41.328415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:41.329951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:41.419695 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:41.444660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fde99-4b71-4f32-8554-5f947507562c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:41.449864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc28b70-84ff-4960-ba2d-4b45597e6861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:41.450597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28b70-84ff-4960-ba2d-4b45597e6861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:41.450934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28b70-84ff-4960-ba2d-4b45597e6861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:41.451877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28b70-84ff-4960-ba2d-4b45597e6861 admin admin] PATH_INFO: `/v3/projects/4a3dc720231f42d29feb9a4016433698` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:41.453028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28b70-84ff-4960-ba2d-4b45597e6861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a3dc720231f42d29feb9a4016433698)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:41.455008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28b70-84ff-4960-ba2d-4b45597e6861 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:41.510554 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5fc28b70-84ff-4960-ba2d-4b45597e6861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a3dc720231f42d29feb9a4016433698', 'request_id': 'req-5fc28b70-84ff-4960-ba2d-4b45597e6861'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:41.517583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5fc28b70-84ff-4960-ba2d-4b45597e6861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a3dc720231f42d29feb9a4016433698', 'request_id': 'req-5fc28b70-84ff-4960-ba2d-4b45597e6861'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:41.525025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5fc28b70-84ff-4960-ba2d-4b45597e6861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a3dc720231f42d29feb9a4016433698', 'request_id': 'req-5fc28b70-84ff-4960-ba2d-4b45597e6861'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:41.540668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5fc28b70-84ff-4960-ba2d-4b45597e6861 admin admin] The token cache is being invalidate because project 4a3dc720231f42d29feb9a4016433698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:41.541008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5fc28b70-84ff-4960-ba2d-4b45597e6861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:41.541651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5fc28b70-84ff-4960-ba2d-4b45597e6861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:41.547565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1107/2203] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:41 2022] DELETE /identity/v3/projects/4a3dc720231f42d29feb9a4016433698 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:41.549907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87d75f-f6ab-40cf-869b-fb7c3872b898 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:41.550170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87d75f-f6ab-40cf-869b-fb7c3872b898 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:41.550445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87d75f-f6ab-40cf-869b-fb7c3872b898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:41.570441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:41.578285 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7f87d75f-f6ab-40cf-869b-fb7c3872b898 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:41.582994 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7f87d75f-f6ab-40cf-869b-fb7c3872b898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:41.656140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1097/2204] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:41.664571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a0e66-01cc-41cf-ba78-c58627ef233a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:41.665543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a0e66-01cc-41cf-ba78-c58627ef233a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:41.667180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a0e66-01cc-41cf-ba78-c58627ef233a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:41.702927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-420a0e66-01cc-41cf-ba78-c58627ef233a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:41.704137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-420a0e66-01cc-41cf-ba78-c58627ef233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:41.715719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1108/2205] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:41.717122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87d75f-f6ab-40cf-869b-fb7c3872b898 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:41.727016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87d75f-f6ab-40cf-869b-fb7c3872b898 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:41.734451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0986ae-40d3-4380-8863-528817c56d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:41.735076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0986ae-40d3-4380-8863-528817c56d6d admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:41.735346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0986ae-40d3-4380-8863-528817c56d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:41.735615 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0986ae-40d3-4380-8863-528817c56d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:41.736257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0986ae-40d3-4380-8863-528817c56d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:41.736590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0986ae-40d3-4380-8863-528817c56d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:41.738229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0986ae-40d3-4380-8863-528817c56d6d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:41.755938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1098/2206] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:41.760584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a0e66-01cc-41cf-ba78-c58627ef233a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:41.772013 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a0e66-01cc-41cf-ba78-c58627ef233a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:41.777597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea97b2-58f5-4118-b587-910548d040b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:41.778432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea97b2-58f5-4118-b587-910548d040b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:41.779271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea97b2-58f5-4118-b587-910548d040b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:41.779694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea97b2-58f5-4118-b587-910548d040b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:41.780448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea97b2-58f5-4118-b587-910548d040b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:41.782835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea97b2-58f5-4118-b587-910548d040b6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:41.823262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1109/2207] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:41 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:41.825428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0986ae-40d3-4380-8863-528817c56d6d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:41.837008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0986ae-40d3-4380-8863-528817c56d6d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:41.895134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bf48a-16c1-42cf-840d-7ca806cfaa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:41.895749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bf48a-16c1-42cf-840d-7ca806cfaa4b admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:41.896029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bf48a-16c1-42cf-840d-7ca806cfaa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:41.896312 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bf48a-16c1-42cf-840d-7ca806cfaa4b admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:41.897009 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bf48a-16c1-42cf-840d-7ca806cfaa4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:41.899373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bf48a-16c1-42cf-840d-7ca806cfaa4b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:41.926756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1099/2208] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:41 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:41.928194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea97b2-58f5-4118-b587-910548d040b6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:41.939340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea97b2-58f5-4118-b587-910548d040b6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:41.948575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d33da-fd98-44a6-bc2e-0e4e1b3943d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:41.949209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d33da-fd98-44a6-bc2e-0e4e1b3943d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:41.949482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d33da-fd98-44a6-bc2e-0e4e1b3943d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:41.949747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d33da-fd98-44a6-bc2e-0e4e1b3943d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:41.950507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d33da-fd98-44a6-bc2e-0e4e1b3943d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:41.953186 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d33da-fd98-44a6-bc2e-0e4e1b3943d8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:41.964350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1110/2209] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:41.969148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bf48a-16c1-42cf-840d-7ca806cfaa4b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:41.980717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bf48a-16c1-42cf-840d-7ca806cfaa4b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:41.989080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ff60d-7285-4cda-ac86-4d5ec0365f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:41.989703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff60d-7285-4cda-ac86-4d5ec0365f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:41.990051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff60d-7285-4cda-ac86-4d5ec0365f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:41.990642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff60d-7285-4cda-ac86-4d5ec0365f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:41.991456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ff60d-7285-4cda-ac86-4d5ec0365f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:41.993145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ff60d-7285-4cda-ac86-4d5ec0365f78 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:42.004544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1100/2210] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:42.009121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d33da-fd98-44a6-bc2e-0e4e1b3943d8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:42.020015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d33da-fd98-44a6-bc2e-0e4e1b3943d8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:42.026391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4d227-5f91-467c-859c-d4729725f313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:42.027059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4d227-5f91-467c-859c-d4729725f313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:42.027331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4d227-5f91-467c-859c-d4729725f313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:42.027612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4d227-5f91-467c-859c-d4729725f313 admin admin] PATH_INFO: `/v3/projects/7de2417d136a4accbdec566a4332aa21/users/71303fabf3c342c7827ea150ed8a1cf2/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:42.044203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4d227-5f91-467c-859c-d4729725f313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de2417d136a4accbdec566a4332aa21, user_id=71303fabf3c342c7827ea150ed8a1cf2, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:42.047639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4d227-5f91-467c-859c-d4729725f313 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:42.062709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1111/2211] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:42 2022] PUT /identity/v3/projects/7de2417d136a4accbdec566a4332aa21/users/71303fabf3c342c7827ea150ed8a1cf2/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:42.073187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f8f61-271f-4771-8d26-7a3b0a341f85 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:42.073500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f8f61-271f-4771-8d26-7a3b0a341f85 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:42.073744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f8f61-271f-4771-8d26-7a3b0a341f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:42.104255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ce5f8f61-271f-4771-8d26-7a3b0a341f85 None None] MFA Rules not processed for user `71303fabf3c342c7827ea150ed8a1cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:42.105491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ce5f8f61-271f-4771-8d26-7a3b0a341f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:42.173698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1101/2212] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:42.178254 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4d227-5f91-467c-859c-d4729725f313 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:42.250642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4d227-5f91-467c-859c-d4729725f313 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:42.255845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af186f24-c874-4c8b-9273-f58a181f86b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:42.256486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af186f24-c874-4c8b-9273-f58a181f86b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:42.256763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af186f24-c874-4c8b-9273-f58a181f86b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:42.257032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af186f24-c874-4c8b-9273-f58a181f86b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:42.257678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af186f24-c874-4c8b-9273-f58a181f86b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:42.259678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af186f24-c874-4c8b-9273-f58a181f86b4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:42.276033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:42.291888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1112/2213] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:42 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:42.296364 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f8f61-271f-4771-8d26-7a3b0a341f85 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:42.302173 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:42.310944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f8f61-271f-4771-8d26-7a3b0a341f85 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:42.372265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b98da-8ef4-406a-afb8-d9552a25e3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:42.373510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b98da-8ef4-406a-afb8-d9552a25e3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:42.373792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b98da-8ef4-406a-afb8-d9552a25e3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:42.374065 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b98da-8ef4-406a-afb8-d9552a25e3c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:42.374700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b98da-8ef4-406a-afb8-d9552a25e3c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:42.376700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b98da-8ef4-406a-afb8-d9552a25e3c1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:42.405317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1102/2214] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:42 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:42.406347 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af186f24-c874-4c8b-9273-f58a181f86b4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:42.417317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af186f24-c874-4c8b-9273-f58a181f86b4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:42.423556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee74e4-663b-495b-bb78-c5d23add5a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:42.424176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee74e4-663b-495b-bb78-c5d23add5a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:42.424491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee74e4-663b-495b-bb78-c5d23add5a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:42.424757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee74e4-663b-495b-bb78-c5d23add5a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:42.425547 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee74e4-663b-495b-bb78-c5d23add5a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:42.427210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee74e4-663b-495b-bb78-c5d23add5a65 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:42.444378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1113/2215] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:42.445647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b98da-8ef4-406a-afb8-d9552a25e3c1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:42.466968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b98da-8ef4-406a-afb8-d9552a25e3c1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:42.473422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2cf71-a01c-4cac-8133-a6ff113f4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:42.474284 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2cf71-a01c-4cac-8133-a6ff113f4985 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:42.474599 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2cf71-a01c-4cac-8133-a6ff113f4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:42.474915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2cf71-a01c-4cac-8133-a6ff113f4985 admin admin] PATH_INFO: `/v3/projects/9a648c48f9ce41a2a2ae0d9611b88dc1/users/d9c64a7916ca4899878005c4ddebcfc2/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:42.496874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2cf71-a01c-4cac-8133-a6ff113f4985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a648c48f9ce41a2a2ae0d9611b88dc1, user_id=d9c64a7916ca4899878005c4ddebcfc2, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:42.500320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2cf71-a01c-4cac-8133-a6ff113f4985 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:42.521279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1103/2216] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:42 2022] PUT /identity/v3/projects/9a648c48f9ce41a2a2ae0d9611b88dc1/users/d9c64a7916ca4899878005c4ddebcfc2/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:42.526586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee74e4-663b-495b-bb78-c5d23add5a65 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:42.540553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee74e4-663b-495b-bb78-c5d23add5a65 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:42.636028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033ea46-21cd-4725-be0d-4e8e3d3c4cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:42.636683 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033ea46-21cd-4725-be0d-4e8e3d3c4cff admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:42.636968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033ea46-21cd-4725-be0d-4e8e3d3c4cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:42.637246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033ea46-21cd-4725-be0d-4e8e3d3c4cff admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:42.637902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033ea46-21cd-4725-be0d-4e8e3d3c4cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:42.639786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033ea46-21cd-4725-be0d-4e8e3d3c4cff admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:42.653881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1114/2217] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:42.655349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2cf71-a01c-4cac-8133-a6ff113f4985 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:42.666483 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2cf71-a01c-4cac-8133-a6ff113f4985 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:42.672380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e653f27-9d2e-4a55-8a03-124a720f6ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:42.673126 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e653f27-9d2e-4a55-8a03-124a720f6ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:42.673481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e653f27-9d2e-4a55-8a03-124a720f6ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:42.673818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e653f27-9d2e-4a55-8a03-124a720f6ebe admin admin] PATH_INFO: `/v3/projects/9a648c48f9ce41a2a2ae0d9611b88dc1/users/d9c64a7916ca4899878005c4ddebcfc2/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:42.676306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e653f27-9d2e-4a55-8a03-124a720f6ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a648c48f9ce41a2a2ae0d9611b88dc1, user_id=d9c64a7916ca4899878005c4ddebcfc2, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:42.679063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e653f27-9d2e-4a55-8a03-124a720f6ebe admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:42.690373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1104/2218] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:42 2022] PUT /identity/v3/projects/9a648c48f9ce41a2a2ae0d9611b88dc1/users/d9c64a7916ca4899878005c4ddebcfc2/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:42.702371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b89954-e0cb-4458-ad4b-5d4e957cd662 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:42.702656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b89954-e0cb-4458-ad4b-5d4e957cd662 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:42.703011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b89954-e0cb-4458-ad4b-5d4e957cd662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:42.744355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c3b89954-e0cb-4458-ad4b-5d4e957cd662 None None] MFA Rules not processed for user `d9c64a7916ca4899878005c4ddebcfc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:42.745648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c3b89954-e0cb-4458-ad4b-5d4e957cd662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:42.824749 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1115/2219] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:42.836473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e653f27-9d2e-4a55-8a03-124a720f6ebe admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:42.838464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5e653f27-9d2e-4a55-8a03-124a720f6ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:42.917413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e653f27-9d2e-4a55-8a03-124a720f6ebe admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:42.921151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b5a1a-9b7b-4114-a5b2-a48f1845f5fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:42.921764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5a1a-9b7b-4114-a5b2-a48f1845f5fc service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:42.922036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5a1a-9b7b-4114-a5b2-a48f1845f5fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:42.922304 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5a1a-9b7b-4114-a5b2-a48f1845f5fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:42.979153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b5a1a-9b7b-4114-a5b2-a48f1845f5fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:42.980722 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b5a1a-9b7b-4114-a5b2-a48f1845f5fc service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:42.990494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1105/2220] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:44.406365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b89954-e0cb-4458-ad4b-5d4e957cd662 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:44.407885 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c3b89954-e0cb-4458-ad4b-5d4e957cd662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:44.420543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b89954-e0cb-4458-ad4b-5d4e957cd662 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:44.424362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec850b-e129-4846-b096-be77fb151660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:44.424930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec850b-e129-4846-b096-be77fb151660 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:44.425210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec850b-e129-4846-b096-be77fb151660 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:44.425485 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec850b-e129-4846-b096-be77fb151660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:44.427316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b1ec850b-e129-4846-b096-be77fb151660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:44.488687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec850b-e129-4846-b096-be77fb151660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:44.490260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec850b-e129-4846-b096-be77fb151660 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:44.500200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1116/2221] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:45.174392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b5a1a-9b7b-4114-a5b2-a48f1845f5fc service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:45.177288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c33b5a1a-9b7b-4114-a5b2-a48f1845f5fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:45.190777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:45.264190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b5a1a-9b7b-4114-a5b2-a48f1845f5fc service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:45.268988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:45.269745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:45.270252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:45.270515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] PATH_INFO: `/v3/users/13aac92ac7ae4bd2a9d405f457f5af3b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:45.271640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=13aac92ac7ae4bd2a9d405f457f5af3b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:45.274156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:45.327130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13aac92ac7ae4bd2a9d405f457f5af3b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:45.327884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13aac92ac7ae4bd2a9d405f457f5af3b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:45.335576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13aac92ac7ae4bd2a9d405f457f5af3b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:45.336252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13aac92ac7ae4bd2a9d405f457f5af3b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:45.351008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13aac92ac7ae4bd2a9d405f457f5af3b'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:45.368415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1106/2222] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:45 2022] DELETE /identity/v3/users/13aac92ac7ae4bd2a9d405f457f5af3b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:45.373817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ec834-0c14-47a3-bc41-a6007afb788d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:45.374104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ec834-0c14-47a3-bc41-a6007afb788d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:45.374382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ec834-0c14-47a3-bc41-a6007afb788d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:45.383152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:45.395228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-003ec834-0c14-47a3-bc41-a6007afb788d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:45.396551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-003ec834-0c14-47a3-bc41-a6007afb788d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:45.458610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1117/2223] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:45.470594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:45.472057 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:45.532257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4960a-1d25-45b1-a82d-92c008ed8bdb admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:45.535924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050426bd-32f2-4387-ae75-a8ddeeedcd19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:45.536565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050426bd-32f2-4387-ae75-a8ddeeedcd19 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:45.536836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050426bd-32f2-4387-ae75-a8ddeeedcd19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:45.537087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050426bd-32f2-4387-ae75-a8ddeeedcd19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:45.547842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050426bd-32f2-4387-ae75-a8ddeeedcd19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:45.549216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050426bd-32f2-4387-ae75-a8ddeeedcd19 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:45.559340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1107/2224] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:45.608016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ec834-0c14-47a3-bc41-a6007afb788d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:45.609637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-003ec834-0c14-47a3-bc41-a6007afb788d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:45.686149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ec834-0c14-47a3-bc41-a6007afb788d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:45.690329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940701-d415-4d33-83dc-e7e50f64d0d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:45.691302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940701-d415-4d33-83dc-e7e50f64d0d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:45.691648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940701-d415-4d33-83dc-e7e50f64d0d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:45.691988 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940701-d415-4d33-83dc-e7e50f64d0d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:45.693916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8a940701-d415-4d33-83dc-e7e50f64d0d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:45.765784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940701-d415-4d33-83dc-e7e50f64d0d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:45.768754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940701-d415-4d33-83dc-e7e50f64d0d6 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:45.779804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1118/2225] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:45.854079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050426bd-32f2-4387-ae75-a8ddeeedcd19 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:45.856679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-050426bd-32f2-4387-ae75-a8ddeeedcd19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:45.880969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050426bd-32f2-4387-ae75-a8ddeeedcd19 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:45.888439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:45.889279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:45.889619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:45.889953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] PATH_INFO: `/v3/projects/92395e7bab8a4db19635a90bbfc0fd8a` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:45.891137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92395e7bab8a4db19635a90bbfc0fd8a)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:45.893382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:45.927733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:45.948536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92395e7bab8a4db19635a90bbfc0fd8a', 'request_id': 'req-0425ec43-043a-4879-b4ec-475f56a643a1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:45.955640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92395e7bab8a4db19635a90bbfc0fd8a', 'request_id': 'req-0425ec43-043a-4879-b4ec-475f56a643a1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:45.965231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92395e7bab8a4db19635a90bbfc0fd8a', 'request_id': 'req-0425ec43-043a-4879-b4ec-475f56a643a1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:45.979493 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] The token cache is being invalidate because project 92395e7bab8a4db19635a90bbfc0fd8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:45.979493 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:45.980487 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:45.986223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1108/2226] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:45 2022] DELETE /identity/v3/projects/92395e7bab8a4db19635a90bbfc0fd8a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:45.987059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940701-d415-4d33-83dc-e7e50f64d0d6 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:45.999576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940701-d415-4d33-83dc-e7e50f64d0d6 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:46.077815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:46.085745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:46.086501 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:46.086854 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:46.087249 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] PATH_INFO: `/v3/users/af54fe2df458407185ba7741e3878297` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:46.088607 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af54fe2df458407185ba7741e3878297)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:46.090684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:46.163793 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af54fe2df458407185ba7741e3878297'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.163793 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af54fe2df458407185ba7741e3878297'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.170667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af54fe2df458407185ba7741e3878297'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.178173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af54fe2df458407185ba7741e3878297'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.178839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af54fe2df458407185ba7741e3878297'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.196634 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1119/2227] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:45 2022] DELETE /identity/v3/users/af54fe2df458407185ba7741e3878297 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:46.517925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:46.519975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:46.535144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425ec43-043a-4879-b4ec-475f56a643a1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:46.601356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:46.601995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:46.602275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:46.602548 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] PATH_INFO: `/v3/projects/ae1e40b45ab24298b455a7cc76dc3f4d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:46.603671 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae1e40b45ab24298b455a7cc76dc3f4d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:46.605662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:46.655446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae1e40b45ab24298b455a7cc76dc3f4d', 'request_id': 'req-66677c0b-9d11-48de-9e81-79a7340e19f8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.663137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae1e40b45ab24298b455a7cc76dc3f4d', 'request_id': 'req-66677c0b-9d11-48de-9e81-79a7340e19f8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.672075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae1e40b45ab24298b455a7cc76dc3f4d', 'request_id': 'req-66677c0b-9d11-48de-9e81-79a7340e19f8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.687786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] The token cache is being invalidate because project ae1e40b45ab24298b455a7cc76dc3f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:46.687786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.687786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.687786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1109/2228] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:46 2022] DELETE /identity/v3/projects/ae1e40b45ab24298b455a7cc76dc3f4d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:46.691351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:46.693458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:46.706667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f0b6-f176-408d-bb82-55c9a29a9eb2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:46.739628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:46.741201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:46.769272 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24693e09-49e2-4202-9815-bc2d6453a69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:46.769823 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693e09-49e2-4202-9815-bc2d6453a69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:46.770086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693e09-49e2-4202-9815-bc2d6453a69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:46.770355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693e09-49e2-4202-9815-bc2d6453a69f admin admin] PATH_INFO: `/v3/users/2ad05a63a3494e908f9e99b70b4111be` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:46.771544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24693e09-49e2-4202-9815-bc2d6453a69f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad05a63a3494e908f9e99b70b4111be)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:46.773944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24693e09-49e2-4202-9815-bc2d6453a69f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:46.793646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:46.818291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66677c0b-9d11-48de-9e81-79a7340e19f8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:46.823287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:46.824013 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:46.824463 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:46.824747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] PATH_INFO: `/v3/users/fe66d91a78164d07a8ce7473c22ae4ab` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:46.826121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe66d91a78164d07a8ce7473c22ae4ab)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:46.828442 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:46.829636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24693e09-49e2-4202-9815-bc2d6453a69f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad05a63a3494e908f9e99b70b4111be'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.830915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24693e09-49e2-4202-9815-bc2d6453a69f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad05a63a3494e908f9e99b70b4111be'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.843026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24693e09-49e2-4202-9815-bc2d6453a69f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad05a63a3494e908f9e99b70b4111be'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.850301 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24693e09-49e2-4202-9815-bc2d6453a69f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad05a63a3494e908f9e99b70b4111be'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.851170 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24693e09-49e2-4202-9815-bc2d6453a69f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad05a63a3494e908f9e99b70b4111be'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.862379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:46.873717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1120/2229] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:46 2022] DELETE /identity/v3/users/2ad05a63a3494e908f9e99b70b4111be => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:46.880813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe66d91a78164d07a8ce7473c22ae4ab'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.881500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe66d91a78164d07a8ce7473c22ae4ab'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.888746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe66d91a78164d07a8ce7473c22ae4ab'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.889439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe66d91a78164d07a8ce7473c22ae4ab'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.902057 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe66d91a78164d07a8ce7473c22ae4ab'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:46.916670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1110/2230] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:46 2022] DELETE /identity/v3/users/fe66d91a78164d07a8ce7473c22ae4ab => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:46.921429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5875d8a-c0d8-459a-b1c9-d97da761ae94 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:46.921749 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5875d8a-c0d8-459a-b1c9-d97da761ae94 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:46.922028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5875d8a-c0d8-459a-b1c9-d97da761ae94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:46.942399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a5875d8a-c0d8-459a-b1c9-d97da761ae94 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:46.943630 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a5875d8a-c0d8-459a-b1c9-d97da761ae94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:47.004563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1121/2231] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:47.015333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:47.016987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:47.087501 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce79e58-8a2d-4f0d-a160-3c61484c5ae6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:47.091398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37654120-2b81-4ad6-9298-1d8bdfaec92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:47.092060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37654120-2b81-4ad6-9298-1d8bdfaec92c service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:47.092367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37654120-2b81-4ad6-9298-1d8bdfaec92c service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:47.092642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37654120-2b81-4ad6-9298-1d8bdfaec92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:47.102652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37654120-2b81-4ad6-9298-1d8bdfaec92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:47.104131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37654120-2b81-4ad6-9298-1d8bdfaec92c service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:47.115140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1111/2232] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:47.209767 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5875d8a-c0d8-459a-b1c9-d97da761ae94 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:47.211659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a5875d8a-c0d8-459a-b1c9-d97da761ae94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:47.241018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5875d8a-c0d8-459a-b1c9-d97da761ae94 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:47.254052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:47.254898 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:47.255353 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:47.255784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab admin admin] PATH_INFO: `/v3/projects/e16d965443584ab4ba2aa8c33706b9d4` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:47.257635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16d965443584ab4ba2aa8c33706b9d4)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:47.259727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:47.325981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16d965443584ab4ba2aa8c33706b9d4', 'request_id': 'req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.332640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16d965443584ab4ba2aa8c33706b9d4', 'request_id': 'req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.339847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16d965443584ab4ba2aa8c33706b9d4', 'request_id': 'req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.356838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab admin admin] The token cache is being invalidate because project e16d965443584ab4ba2aa8c33706b9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:47.356838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.357762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8fe8a7a2-2b02-41bb-8dcd-ceb20eed78ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.364212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1122/2233] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:47 2022] DELETE /identity/v3/projects/e16d965443584ab4ba2aa8c33706b9d4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:47.366519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e56db7-97fb-4e55-bbd1-633db51f1e94 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:47.366940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e56db7-97fb-4e55-bbd1-633db51f1e94 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:47.367059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e56db7-97fb-4e55-bbd1-633db51f1e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:47.391942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d9e56db7-97fb-4e55-bbd1-633db51f1e94 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:47.393218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d9e56db7-97fb-4e55-bbd1-633db51f1e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:47.473455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1112/2234] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:47.481825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6529b7-b0bb-46e2-b92a-340b8d4ca76c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:47.482194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6529b7-b0bb-46e2-b92a-340b8d4ca76c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:47.482472 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6529b7-b0bb-46e2-b92a-340b8d4ca76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:47.504989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0c6529b7-b0bb-46e2-b92a-340b8d4ca76c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:47.506338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0c6529b7-b0bb-46e2-b92a-340b8d4ca76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:47.515476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1123/2235] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:47.519827 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e56db7-97fb-4e55-bbd1-633db51f1e94 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:47.530980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e56db7-97fb-4e55-bbd1-633db51f1e94 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:47.536642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b07800-1895-4acf-9c78-677302ae66a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:47.537446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b07800-1895-4acf-9c78-677302ae66a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:47.537891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b07800-1895-4acf-9c78-677302ae66a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:47.538332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b07800-1895-4acf-9c78-677302ae66a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:47.538977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b07800-1895-4acf-9c78-677302ae66a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:47.539281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b07800-1895-4acf-9c78-677302ae66a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:47.541303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b07800-1895-4acf-9c78-677302ae66a2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:47.544158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:47.560615 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1113/2236] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:13:47.563737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6529b7-b0bb-46e2-b92a-340b8d4ca76c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:47.573870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6529b7-b0bb-46e2-b92a-340b8d4ca76c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:47.581129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b07800-1895-4acf-9c78-677302ae66a2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:47.582052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916d713-df5b-4058-a941-94257b6c1009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:47.582779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916d713-df5b-4058-a941-94257b6c1009 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:47.583060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916d713-df5b-4058-a941-94257b6c1009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:47.583464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916d713-df5b-4058-a941-94257b6c1009 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:47.584109 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916d713-df5b-4058-a941-94257b6c1009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:47.586202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916d713-df5b-4058-a941-94257b6c1009 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:47.586797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-89b07800-1895-4acf-9c78-677302ae66a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:47.608574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b07800-1895-4acf-9c78-677302ae66a2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:47.615902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:47.617447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:47.618067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:47.619371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] PATH_INFO: `/v3/projects/0fd03bf46e074d56949aa64a9d9bacfc` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:47.621450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd03bf46e074d56949aa64a9d9bacfc)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:47.624127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:47.642488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1124/2237] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:47 2022] POST /identity/v3/projects => generated 363 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:47.646754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916d713-df5b-4058-a941-94257b6c1009 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:47.710719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd03bf46e074d56949aa64a9d9bacfc', 'request_id': 'req-34e7b591-3bdc-484b-8112-16618f417b14'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.724191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:47.736150 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd03bf46e074d56949aa64a9d9bacfc', 'request_id': 'req-34e7b591-3bdc-484b-8112-16618f417b14'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.750892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd03bf46e074d56949aa64a9d9bacfc', 'request_id': 'req-34e7b591-3bdc-484b-8112-16618f417b14'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.761099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916d713-df5b-4058-a941-94257b6c1009 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:47.770401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] The token cache is being invalidate because project 0fd03bf46e074d56949aa64a9d9bacfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:47.770401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.770666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.772462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1114/2238] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:47 2022] DELETE /identity/v3/projects/0fd03bf46e074d56949aa64a9d9bacfc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:47.776529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:47.777903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:47.831127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607048ab-f066-428f-9bcf-ed3e9e82ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:47.831967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607048ab-f066-428f-9bcf-ed3e9e82ad1a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:47.832366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607048ab-f066-428f-9bcf-ed3e9e82ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:47.833283 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607048ab-f066-428f-9bcf-ed3e9e82ad1a admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:47.834026 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607048ab-f066-428f-9bcf-ed3e9e82ad1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:47.836946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607048ab-f066-428f-9bcf-ed3e9e82ad1a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:47.861874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7b591-3bdc-484b-8112-16618f417b14 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:47.869303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056be8b2-759f-4250-b7c3-b407ef614f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:47.869973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056be8b2-759f-4250-b7c3-b407ef614f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:47.870250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056be8b2-759f-4250-b7c3-b407ef614f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:47.870521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056be8b2-759f-4250-b7c3-b407ef614f6a admin admin] PATH_INFO: `/v3/users/c010fa3dd2c4414082033d73952cd8bf` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:47.871701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056be8b2-759f-4250-b7c3-b407ef614f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c010fa3dd2c4414082033d73952cd8bf)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:47.875055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056be8b2-759f-4250-b7c3-b407ef614f6a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:47.878253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1125/2239] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:47 2022] POST /identity/v3/users => generated 282 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:47.882093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607048ab-f066-428f-9bcf-ed3e9e82ad1a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:47.883710 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-607048ab-f066-428f-9bcf-ed3e9e82ad1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:47.897482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607048ab-f066-428f-9bcf-ed3e9e82ad1a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:47.903103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa33f26-14c6-4b2a-9001-a0877262e05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:47.904569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa33f26-14c6-4b2a-9001-a0877262e05e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:47.904867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa33f26-14c6-4b2a-9001-a0877262e05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:47.905044 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa33f26-14c6-4b2a-9001-a0877262e05e admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:47.905703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa33f26-14c6-4b2a-9001-a0877262e05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:47.907853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa33f26-14c6-4b2a-9001-a0877262e05e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:47.920328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1126/2240] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:47.924420 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa33f26-14c6-4b2a-9001-a0877262e05e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:47.935876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa33f26-14c6-4b2a-9001-a0877262e05e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:47.936194 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-056be8b2-759f-4250-b7c3-b407ef614f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c010fa3dd2c4414082033d73952cd8bf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.937418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-056be8b2-759f-4250-b7c3-b407ef614f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c010fa3dd2c4414082033d73952cd8bf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.945536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-056be8b2-759f-4250-b7c3-b407ef614f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c010fa3dd2c4414082033d73952cd8bf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.946552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-056be8b2-759f-4250-b7c3-b407ef614f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c010fa3dd2c4414082033d73952cd8bf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.948591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdba294-bf93-4017-88a9-b18449710023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:47.949484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdba294-bf93-4017-88a9-b18449710023 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:47.949976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdba294-bf93-4017-88a9-b18449710023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:47.950439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdba294-bf93-4017-88a9-b18449710023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:47.952070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdba294-bf93-4017-88a9-b18449710023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:47.955159 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdba294-bf93-4017-88a9-b18449710023 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:47.960521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-056be8b2-759f-4250-b7c3-b407ef614f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c010fa3dd2c4414082033d73952cd8bf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:47.964406 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:47.972227 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1127/2241] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:47.977197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdba294-bf93-4017-88a9-b18449710023 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:47.981388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9cdba294-bf93-4017-88a9-b18449710023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:47.985158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1115/2242] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:47 2022] DELETE /identity/v3/users/c010fa3dd2c4414082033d73952cd8bf => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:48.000280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdba294-bf93-4017-88a9-b18449710023 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:48.086329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a7d94-08af-41db-9985-a3ac111168af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:48.087104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7d94-08af-41db-9985-a3ac111168af admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:48.087437 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7d94-08af-41db-9985-a3ac111168af admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:48.087662 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7d94-08af-41db-9985-a3ac111168af admin admin] PATH_INFO: `/v3/projects/78570e9e0264436fbd98de0273e01a8a/users/c7147279bc9542968562af5d0c324104/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:48.106547 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a7d94-08af-41db-9985-a3ac111168af admin admin] RBAC: Authorizing `identity:create_grant(project_id=78570e9e0264436fbd98de0273e01a8a, user_id=c7147279bc9542968562af5d0c324104, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:48.109614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a7d94-08af-41db-9985-a3ac111168af admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:48.129399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1128/2243] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:47 2022] PUT /identity/v3/projects/78570e9e0264436fbd98de0273e01a8a/users/c7147279bc9542968562af5d0c324104/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:48.140514 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c328d6-de99-4904-8c7e-43039a4fca4c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:48.141032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c328d6-de99-4904-8c7e-43039a4fca4c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:48.141334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c328d6-de99-4904-8c7e-43039a4fca4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:48.174406 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f6c328d6-de99-4904-8c7e-43039a4fca4c None None] MFA Rules not processed for user `c7147279bc9542968562af5d0c324104`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:48.176042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f6c328d6-de99-4904-8c7e-43039a4fca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:48.260317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1116/2244] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:48.280028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a7d94-08af-41db-9985-a3ac111168af admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:48.282225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-001a7d94-08af-41db-9985-a3ac111168af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:48.347390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c328d6-de99-4904-8c7e-43039a4fca4c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:48.348977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f6c328d6-de99-4904-8c7e-43039a4fca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:48.359845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:48.378757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a7d94-08af-41db-9985-a3ac111168af admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:48.386648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2f63a-de8f-4074-9ede-7938b5e59186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:48.387283 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2f63a-de8f-4074-9ede-7938b5e59186 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:48.387565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2f63a-de8f-4074-9ede-7938b5e59186 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:48.387965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2f63a-de8f-4074-9ede-7938b5e59186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:48.399926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2f63a-de8f-4074-9ede-7938b5e59186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:48.401495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2f63a-de8f-4074-9ede-7938b5e59186 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:48.414262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1129/2245] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:48.455744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c328d6-de99-4904-8c7e-43039a4fca4c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:48.463199 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:48.464117 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:48.464618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:48.466652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] PATH_INFO: `/v3/projects/accc656faa084602bc63762c9b6b187f` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:48.468074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=accc656faa084602bc63762c9b6b187f)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:48.470891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:48.543326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accc656faa084602bc63762c9b6b187f', 'request_id': 'req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:48.551754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accc656faa084602bc63762c9b6b187f', 'request_id': 'req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:48.565196 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accc656faa084602bc63762c9b6b187f', 'request_id': 'req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:48.585753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] The token cache is being invalidate because project accc656faa084602bc63762c9b6b187f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:48.586140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:48.586794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:48.588593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1117/2246] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:48 2022] DELETE /identity/v3/projects/accc656faa084602bc63762c9b6b187f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:13:48.593157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2f63a-de8f-4074-9ede-7938b5e59186 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:48.605121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2f63a-de8f-4074-9ede-7938b5e59186 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:48.720975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedecac7-67d7-4ec5-ac17-049a16270269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:48.721626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedecac7-67d7-4ec5-ac17-049a16270269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:48.721920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedecac7-67d7-4ec5-ac17-049a16270269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:48.722178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedecac7-67d7-4ec5-ac17-049a16270269 admin admin] PATH_INFO: `/v3/users/9ae2d02123734c3d87f4080a2d6dfc0d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:48.723380 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedecac7-67d7-4ec5-ac17-049a16270269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae2d02123734c3d87f4080a2d6dfc0d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:48.725481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedecac7-67d7-4ec5-ac17-049a16270269 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:48.817825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aedecac7-67d7-4ec5-ac17-049a16270269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae2d02123734c3d87f4080a2d6dfc0d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:48.818894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aedecac7-67d7-4ec5-ac17-049a16270269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae2d02123734c3d87f4080a2d6dfc0d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:48.835389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aedecac7-67d7-4ec5-ac17-049a16270269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae2d02123734c3d87f4080a2d6dfc0d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:48.852082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aedecac7-67d7-4ec5-ac17-049a16270269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae2d02123734c3d87f4080a2d6dfc0d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:48.853056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aedecac7-67d7-4ec5-ac17-049a16270269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae2d02123734c3d87f4080a2d6dfc0d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:48.884561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1130/2247] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:48 2022] DELETE /identity/v3/users/9ae2d02123734c3d87f4080a2d6dfc0d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:49.202989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:49.204724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:49.219061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ccda3-f1a9-4d33-b2f6-d53ff53ec3b8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:49.232896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:49.285741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5a8fc-091f-407a-aa63-90d9785a7caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:49.286394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a8fc-091f-407a-aa63-90d9785a7caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:49.286700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a8fc-091f-407a-aa63-90d9785a7caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:49.286995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a8fc-091f-407a-aa63-90d9785a7caf admin admin] PATH_INFO: `/v3/projects/7ce13c1929b044e7a28ea7ccea911fc6` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:49.288172 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5a8fc-091f-407a-aa63-90d9785a7caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce13c1929b044e7a28ea7ccea911fc6)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:49.290232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5a8fc-091f-407a-aa63-90d9785a7caf admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:49.341542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ebc5a8fc-091f-407a-aa63-90d9785a7caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce13c1929b044e7a28ea7ccea911fc6', 'request_id': 'req-ebc5a8fc-091f-407a-aa63-90d9785a7caf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:49.347935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ebc5a8fc-091f-407a-aa63-90d9785a7caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce13c1929b044e7a28ea7ccea911fc6', 'request_id': 'req-ebc5a8fc-091f-407a-aa63-90d9785a7caf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:49.356994 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ebc5a8fc-091f-407a-aa63-90d9785a7caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce13c1929b044e7a28ea7ccea911fc6', 'request_id': 'req-ebc5a8fc-091f-407a-aa63-90d9785a7caf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:49.367913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ebc5a8fc-091f-407a-aa63-90d9785a7caf admin admin] The token cache is being invalidate because project 7ce13c1929b044e7a28ea7ccea911fc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:49.368136 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ebc5a8fc-091f-407a-aa63-90d9785a7caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:49.368785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ebc5a8fc-091f-407a-aa63-90d9785a7caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:49.370266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1118/2248] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:49 2022] DELETE /identity/v3/projects/7ce13c1929b044e7a28ea7ccea911fc6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:49.376499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469a971-e5b7-43aa-8e9e-fe02fb06fad9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:49.376785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469a971-e5b7-43aa-8e9e-fe02fb06fad9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:49.377060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469a971-e5b7-43aa-8e9e-fe02fb06fad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:49.397248 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5469a971-e5b7-43aa-8e9e-fe02fb06fad9 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:49.398846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5469a971-e5b7-43aa-8e9e-fe02fb06fad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:49.462640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1131/2249] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:49.473031 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6e08-ed7a-4cd0-a1fd-10d1a6c4505f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:49.473312 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6e08-ed7a-4cd0-a1fd-10d1a6c4505f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:49.473580 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6e08-ed7a-4cd0-a1fd-10d1a6c4505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:49.503905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4a6e6e08-ed7a-4cd0-a1fd-10d1a6c4505f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:49.505139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4a6e6e08-ed7a-4cd0-a1fd-10d1a6c4505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:49.514218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1119/2250] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:49.518959 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469a971-e5b7-43aa-8e9e-fe02fb06fad9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:49.531864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469a971-e5b7-43aa-8e9e-fe02fb06fad9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:49.537957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c843bfd-f0de-44e8-b0c9-6c01c40c4ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:49.538569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c843bfd-f0de-44e8-b0c9-6c01c40c4ead admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:49.538843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c843bfd-f0de-44e8-b0c9-6c01c40c4ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:49.539108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c843bfd-f0de-44e8-b0c9-6c01c40c4ead admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:49.539759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c843bfd-f0de-44e8-b0c9-6c01c40c4ead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:49.540060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c843bfd-f0de-44e8-b0c9-6c01c40c4ead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:49.541774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c843bfd-f0de-44e8-b0c9-6c01c40c4ead admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:49.544723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:49.558639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1132/2251] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:49.563345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6e08-ed7a-4cd0-a1fd-10d1a6c4505f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:49.572896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6e08-ed7a-4cd0-a1fd-10d1a6c4505f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:49.578250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b675d99-a4b1-439c-87e7-f8d2b686b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:49.578893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b675d99-a4b1-439c-87e7-f8d2b686b2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:49.579198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b675d99-a4b1-439c-87e7-f8d2b686b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:49.579468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b675d99-a4b1-439c-87e7-f8d2b686b2b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:49.580165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b675d99-a4b1-439c-87e7-f8d2b686b2b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:49.582578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b675d99-a4b1-439c-87e7-f8d2b686b2b9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:49.615817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1120/2252] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:49 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:49.620251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c843bfd-f0de-44e8-b0c9-6c01c40c4ead admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:49.632235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c843bfd-f0de-44e8-b0c9-6c01c40c4ead admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:49.701573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba9366-949a-444c-bfef-abb7091952b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:49.702195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba9366-949a-444c-bfef-abb7091952b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:49.702472 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba9366-949a-444c-bfef-abb7091952b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:49.702736 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba9366-949a-444c-bfef-abb7091952b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:49.703369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba9366-949a-444c-bfef-abb7091952b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:49.705389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba9366-949a-444c-bfef-abb7091952b1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:49.734425 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1133/2253] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:49 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:49.738621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b675d99-a4b1-439c-87e7-f8d2b686b2b9 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:49.752620 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b675d99-a4b1-439c-87e7-f8d2b686b2b9 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:49.757747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15b72b-9354-4334-8cf1-4eded5e776b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:49.758362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15b72b-9354-4334-8cf1-4eded5e776b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:49.758635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15b72b-9354-4334-8cf1-4eded5e776b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:49.758902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15b72b-9354-4334-8cf1-4eded5e776b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:49.759609 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15b72b-9354-4334-8cf1-4eded5e776b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:49.761469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15b72b-9354-4334-8cf1-4eded5e776b5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:49.773486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1121/2254] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:49.777578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba9366-949a-444c-bfef-abb7091952b1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:49.792938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba9366-949a-444c-bfef-abb7091952b1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:49.798227 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd0ba5-bc9c-49b1-b7a0-364d4301b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:49.798845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0ba5-bc9c-49b1-b7a0-364d4301b72b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:49.799160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0ba5-bc9c-49b1-b7a0-364d4301b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:49.799437 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0ba5-bc9c-49b1-b7a0-364d4301b72b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:49.800097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd0ba5-bc9c-49b1-b7a0-364d4301b72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:49.801800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd0ba5-bc9c-49b1-b7a0-364d4301b72b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:49.818496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1134/2255] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:49.822885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15b72b-9354-4334-8cf1-4eded5e776b5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:49.838404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15b72b-9354-4334-8cf1-4eded5e776b5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:49.845900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a2c06-455d-4219-87b1-40d49cd38df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:49.846584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2c06-455d-4219-87b1-40d49cd38df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:49.846858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2c06-455d-4219-87b1-40d49cd38df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:49.847164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2c06-455d-4219-87b1-40d49cd38df7 admin admin] PATH_INFO: `/v3/projects/a6fa4ec3ee324ee493712e712a9958d6/users/5dd7e714757240a19635d86cbcbba3a1/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:49.865785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a2c06-455d-4219-87b1-40d49cd38df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6fa4ec3ee324ee493712e712a9958d6, user_id=5dd7e714757240a19635d86cbcbba3a1, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:49.868600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a2c06-455d-4219-87b1-40d49cd38df7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:49.887258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1122/2256] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:49 2022] PUT /identity/v3/projects/a6fa4ec3ee324ee493712e712a9958d6/users/5dd7e714757240a19635d86cbcbba3a1/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:49.900370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd7cd-7991-4174-b13b-a9680f9be889 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:49.900370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd7cd-7991-4174-b13b-a9680f9be889 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:49.900370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd7cd-7991-4174-b13b-a9680f9be889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:49.954963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-faefd7cd-7991-4174-b13b-a9680f9be889 None None] MFA Rules not processed for user `5dd7e714757240a19635d86cbcbba3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:49.956385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-faefd7cd-7991-4174-b13b-a9680f9be889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:50.116360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1135/2257] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:13:50.125538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a2c06-455d-4219-87b1-40d49cd38df7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:50.206030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:50.248482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a2c06-455d-4219-87b1-40d49cd38df7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:50.252379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa820f-ee44-41b5-9dfd-b8184d12d16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:50.253114 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa820f-ee44-41b5-9dfd-b8184d12d16b admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:50.253470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa820f-ee44-41b5-9dfd-b8184d12d16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:50.253841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa820f-ee44-41b5-9dfd-b8184d12d16b admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:50.254582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa820f-ee44-41b5-9dfd-b8184d12d16b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:50.256689 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa820f-ee44-41b5-9dfd-b8184d12d16b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:50.285679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1123/2258] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:50 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:50.289924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefd7cd-7991-4174-b13b-a9680f9be889 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:50.301371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefd7cd-7991-4174-b13b-a9680f9be889 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:50.363272 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e81ef-7df9-497e-b92b-106775b86c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:50.363888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e81ef-7df9-497e-b92b-106775b86c74 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:50.364161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e81ef-7df9-497e-b92b-106775b86c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:50.364577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e81ef-7df9-497e-b92b-106775b86c74 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:50.365223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e81ef-7df9-497e-b92b-106775b86c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:50.367184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e81ef-7df9-497e-b92b-106775b86c74 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:50.377554 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:50.391517 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1136/2259] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:50 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:50.396438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa820f-ee44-41b5-9dfd-b8184d12d16b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:50.408787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa820f-ee44-41b5-9dfd-b8184d12d16b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:50.414127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f1e54-4cf1-4275-a56d-bcb20ef7c7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:50.414980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f1e54-4cf1-4275-a56d-bcb20ef7c7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:50.415261 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f1e54-4cf1-4275-a56d-bcb20ef7c7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:50.415531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f1e54-4cf1-4275-a56d-bcb20ef7c7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:50.416178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f1e54-4cf1-4275-a56d-bcb20ef7c7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:50.417881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f1e54-4cf1-4275-a56d-bcb20ef7c7b6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:50.430044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1124/2260] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:50.434186 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e81ef-7df9-497e-b92b-106775b86c74 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:50.444981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e81ef-7df9-497e-b92b-106775b86c74 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:50.450127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209cdd-4381-4214-af69-0103b0850913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:50.450924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209cdd-4381-4214-af69-0103b0850913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:50.451294 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209cdd-4381-4214-af69-0103b0850913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:50.451838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209cdd-4381-4214-af69-0103b0850913 admin admin] PATH_INFO: `/v3/projects/f9fbe63d319b4fc7b1c9ef1d139dd37e/users/ef4dfc90a1a942318418820b38a28922/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:50.469021 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df209cdd-4381-4214-af69-0103b0850913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9fbe63d319b4fc7b1c9ef1d139dd37e, user_id=ef4dfc90a1a942318418820b38a28922, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:50.471818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df209cdd-4381-4214-af69-0103b0850913 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:50.496424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1137/2261] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:50 2022] PUT /identity/v3/projects/f9fbe63d319b4fc7b1c9ef1d139dd37e/users/ef4dfc90a1a942318418820b38a28922/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:50.496518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f1e54-4cf1-4275-a56d-bcb20ef7c7b6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:50.507994 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f1e54-4cf1-4275-a56d-bcb20ef7c7b6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:50.573751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70eb96-765e-4156-b69a-0275bd948f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:50.574482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70eb96-765e-4156-b69a-0275bd948f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:50.574663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70eb96-765e-4156-b69a-0275bd948f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:50.574949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70eb96-765e-4156-b69a-0275bd948f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:50.575587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70eb96-765e-4156-b69a-0275bd948f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:50.577346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70eb96-765e-4156-b69a-0275bd948f3a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:50.590828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1125/2262] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:13:50.592162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209cdd-4381-4214-af69-0103b0850913 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:50.602519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209cdd-4381-4214-af69-0103b0850913 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:50.607404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71a441-f9b7-4c8f-9412-38e8c9a03ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:50.608068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71a441-f9b7-4c8f-9412-38e8c9a03ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:50.608366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71a441-f9b7-4c8f-9412-38e8c9a03ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:50.608637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71a441-f9b7-4c8f-9412-38e8c9a03ac7 admin admin] PATH_INFO: `/v3/projects/f9fbe63d319b4fc7b1c9ef1d139dd37e/users/ef4dfc90a1a942318418820b38a28922/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:50.610590 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71a441-f9b7-4c8f-9412-38e8c9a03ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9fbe63d319b4fc7b1c9ef1d139dd37e, user_id=ef4dfc90a1a942318418820b38a28922, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:50.613335 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71a441-f9b7-4c8f-9412-38e8c9a03ac7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:50.623464 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1138/2263] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:50 2022] PUT /identity/v3/projects/f9fbe63d319b4fc7b1c9ef1d139dd37e/users/ef4dfc90a1a942318418820b38a28922/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:50.634890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8713-1bdc-4b59-99bb-9bc4d410e0d5 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:50.635233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8713-1bdc-4b59-99bb-9bc4d410e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:50.635606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8713-1bdc-4b59-99bb-9bc4d410e0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:50.667273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a0be8713-1bdc-4b59-99bb-9bc4d410e0d5 None None] MFA Rules not processed for user `ef4dfc90a1a942318418820b38a28922`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:50.668471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a0be8713-1bdc-4b59-99bb-9bc4d410e0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:50.739917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1126/2264] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:50.751704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71a441-f9b7-4c8f-9412-38e8c9a03ac7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:50.753852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fa71a441-f9b7-4c8f-9412-38e8c9a03ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:50.816418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71a441-f9b7-4c8f-9412-38e8c9a03ac7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:50.820597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28057cf7-aaf9-499c-9c94-631423e4ef4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:50.821233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28057cf7-aaf9-499c-9c94-631423e4ef4d service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:50.821511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28057cf7-aaf9-499c-9c94-631423e4ef4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:50.821783 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28057cf7-aaf9-499c-9c94-631423e4ef4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:50.892930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28057cf7-aaf9-499c-9c94-631423e4ef4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:50.894426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28057cf7-aaf9-499c-9c94-631423e4ef4d service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:50.903735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1139/2265] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:53.500678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be8713-1bdc-4b59-99bb-9bc4d410e0d5 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:53.553800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:53.576211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be8713-1bdc-4b59-99bb-9bc4d410e0d5 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:53.582116 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:53.582747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:53.583019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:53.583287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] PATH_INFO: `/v3/users/5dd7e714757240a19635d86cbcbba3a1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:53.584647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd7e714757240a19635d86cbcbba3a1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:53.586640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:53.640124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd7e714757240a19635d86cbcbba3a1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:53.641015 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd7e714757240a19635d86cbcbba3a1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:53.648553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd7e714757240a19635d86cbcbba3a1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:53.649181 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd7e714757240a19635d86cbcbba3a1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:53.660820 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd7e714757240a19635d86cbcbba3a1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:53.677501 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1127/2266] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:53 2022] DELETE /identity/v3/users/5dd7e714757240a19635d86cbcbba3a1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:53.682336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf5fe1-c448-4d54-87d5-5565aec65e32 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:53.682839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf5fe1-c448-4d54-87d5-5565aec65e32 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:53.683158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf5fe1-c448-4d54-87d5-5565aec65e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:53.704006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-35bf5fe1-c448-4d54-87d5-5565aec65e32 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:53.705328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-35bf5fe1-c448-4d54-87d5-5565aec65e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:53.777873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1140/2267] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:53.789213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:53.790760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:53.852776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce3910-ebf9-4222-a3c6-619e8d9bb33d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:53.856638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c9048-d936-443e-bab1-47e6427e197d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:53.857354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c9048-d936-443e-bab1-47e6427e197d service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:53.857704 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c9048-d936-443e-bab1-47e6427e197d service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:53.858027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c9048-d936-443e-bab1-47e6427e197d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:53.867915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c9048-d936-443e-bab1-47e6427e197d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:53.869574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c9048-d936-443e-bab1-47e6427e197d service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:53.880742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1128/2268] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:54.237252 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf5fe1-c448-4d54-87d5-5565aec65e32 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:54.238733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-35bf5fe1-c448-4d54-87d5-5565aec65e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:54.265670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf5fe1-c448-4d54-87d5-5565aec65e32 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:54.271813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:54.272827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:54.273106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:54.273376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] PATH_INFO: `/v3/projects/a6fa4ec3ee324ee493712e712a9958d6` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:54.275206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6fa4ec3ee324ee493712e712a9958d6)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:54.278050 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:54.285974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:54.340484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6fa4ec3ee324ee493712e712a9958d6', 'request_id': 'req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.347448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6fa4ec3ee324ee493712e712a9958d6', 'request_id': 'req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.353883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6fa4ec3ee324ee493712e712a9958d6', 'request_id': 'req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.373294 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] The token cache is being invalidate because project a6fa4ec3ee324ee493712e712a9958d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:54.373584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.374245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.376200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1141/2269] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:54 2022] DELETE /identity/v3/projects/a6fa4ec3ee324ee493712e712a9958d6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:54.380733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c9048-d936-443e-bab1-47e6427e197d service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:54.391143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c9048-d936-443e-bab1-47e6427e197d service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:54.457586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27612545-6865-4781-94d7-86c1e00ad615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:54.458224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27612545-6865-4781-94d7-86c1e00ad615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:54.458502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27612545-6865-4781-94d7-86c1e00ad615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:54.458774 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27612545-6865-4781-94d7-86c1e00ad615 admin admin] PATH_INFO: `/v3/users/ef4dfc90a1a942318418820b38a28922` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:54.459875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27612545-6865-4781-94d7-86c1e00ad615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef4dfc90a1a942318418820b38a28922)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:54.461924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27612545-6865-4781-94d7-86c1e00ad615 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:54.463404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:54.514810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-27612545-6865-4781-94d7-86c1e00ad615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4dfc90a1a942318418820b38a28922'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.515568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-27612545-6865-4781-94d7-86c1e00ad615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4dfc90a1a942318418820b38a28922'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.523256 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-27612545-6865-4781-94d7-86c1e00ad615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4dfc90a1a942318418820b38a28922'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.523956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-27612545-6865-4781-94d7-86c1e00ad615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4dfc90a1a942318418820b38a28922'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.538485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-27612545-6865-4781-94d7-86c1e00ad615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4dfc90a1a942318418820b38a28922'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.554436 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1129/2270] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:54 2022] DELETE /identity/v3/users/ef4dfc90a1a942318418820b38a28922 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:54.835153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:54.836725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:54.850710 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fcaa8-2ed1-4669-a255-9737a78e94a3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:54.915552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8845f-d24c-40d3-986e-9f5ac532d087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:54.916220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8845f-d24c-40d3-986e-9f5ac532d087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:54.916542 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8845f-d24c-40d3-986e-9f5ac532d087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:54.916805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8845f-d24c-40d3-986e-9f5ac532d087 admin admin] PATH_INFO: `/v3/projects/f9fbe63d319b4fc7b1c9ef1d139dd37e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:54.919344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8845f-d24c-40d3-986e-9f5ac532d087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9fbe63d319b4fc7b1c9ef1d139dd37e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:54.921526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8845f-d24c-40d3-986e-9f5ac532d087 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:54.972419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9ce8845f-d24c-40d3-986e-9f5ac532d087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9fbe63d319b4fc7b1c9ef1d139dd37e', 'request_id': 'req-9ce8845f-d24c-40d3-986e-9f5ac532d087'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.977869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9ce8845f-d24c-40d3-986e-9f5ac532d087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9fbe63d319b4fc7b1c9ef1d139dd37e', 'request_id': 'req-9ce8845f-d24c-40d3-986e-9f5ac532d087'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.984087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9ce8845f-d24c-40d3-986e-9f5ac532d087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9fbe63d319b4fc7b1c9ef1d139dd37e', 'request_id': 'req-9ce8845f-d24c-40d3-986e-9f5ac532d087'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.996962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9ce8845f-d24c-40d3-986e-9f5ac532d087 admin admin] The token cache is being invalidate because project f9fbe63d319b4fc7b1c9ef1d139dd37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:54.997243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9ce8845f-d24c-40d3-986e-9f5ac532d087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.997844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9ce8845f-d24c-40d3-986e-9f5ac532d087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:54.999320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1142/2271] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:54 2022] DELETE /identity/v3/projects/f9fbe63d319b4fc7b1c9ef1d139dd37e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:55.004541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc433485-560d-4242-a62e-e7771d9fc70f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:55.004829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc433485-560d-4242-a62e-e7771d9fc70f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:55.005107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc433485-560d-4242-a62e-e7771d9fc70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:55.026504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-cc433485-560d-4242-a62e-e7771d9fc70f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:55.027729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cc433485-560d-4242-a62e-e7771d9fc70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:55.091279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1130/2272] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:55.098918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bc9da-5f77-49f3-8b12-617d942ff942 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:55.099199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bc9da-5f77-49f3-8b12-617d942ff942 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:55.099465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bc9da-5f77-49f3-8b12-617d942ff942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:55.119507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-974bc9da-5f77-49f3-8b12-617d942ff942 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:55.120805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-974bc9da-5f77-49f3-8b12-617d942ff942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:55.128605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1143/2273] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:55.133945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc433485-560d-4242-a62e-e7771d9fc70f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:55.142940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc433485-560d-4242-a62e-e7771d9fc70f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:55.148223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724710b7-b95f-4fae-8ad3-b3f3aa07c70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:55.148859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724710b7-b95f-4fae-8ad3-b3f3aa07c70d admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:55.149133 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724710b7-b95f-4fae-8ad3-b3f3aa07c70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:55.149401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724710b7-b95f-4fae-8ad3-b3f3aa07c70d admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:55.150042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724710b7-b95f-4fae-8ad3-b3f3aa07c70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:13:55.150343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724710b7-b95f-4fae-8ad3-b3f3aa07c70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:55.151973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724710b7-b95f-4fae-8ad3-b3f3aa07c70d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:55.164325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1131/2274] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:13:55.168738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bc9da-5f77-49f3-8b12-617d942ff942 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:55.178783 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bc9da-5f77-49f3-8b12-617d942ff942 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:55.183851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62656490-2123-4a08-a1e2-0e8f3d01ddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:55.184566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62656490-2123-4a08-a1e2-0e8f3d01ddfd admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:55.184894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62656490-2123-4a08-a1e2-0e8f3d01ddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:55.185239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62656490-2123-4a08-a1e2-0e8f3d01ddfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:55.185936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62656490-2123-4a08-a1e2-0e8f3d01ddfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:55.187972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62656490-2123-4a08-a1e2-0e8f3d01ddfd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:55.204186 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:55.223439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1144/2275] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:13:55 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:55.227547 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724710b7-b95f-4fae-8ad3-b3f3aa07c70d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:55.238960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724710b7-b95f-4fae-8ad3-b3f3aa07c70d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:55.300920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8a182-e50e-4806-ab96-d70f99aec9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:55.301608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a182-e50e-4806-ab96-d70f99aec9fd admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:55.301989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a182-e50e-4806-ab96-d70f99aec9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:55.302367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a182-e50e-4806-ab96-d70f99aec9fd admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:55.303318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8a182-e50e-4806-ab96-d70f99aec9fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:55.305755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8a182-e50e-4806-ab96-d70f99aec9fd admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:55.319080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:55.337581 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1132/2276] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:13:55 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:13:55.341776 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62656490-2123-4a08-a1e2-0e8f3d01ddfd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:55.354913 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62656490-2123-4a08-a1e2-0e8f3d01ddfd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:55.360741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f6433-5d46-4806-b5cb-994889d9366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:55.361531 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f6433-5d46-4806-b5cb-994889d9366f admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:55.361869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f6433-5d46-4806-b5cb-994889d9366f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:55.362205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f6433-5d46-4806-b5cb-994889d9366f admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:55.362921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f6433-5d46-4806-b5cb-994889d9366f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:55.364686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f6433-5d46-4806-b5cb-994889d9366f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:55.389389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1145/2277] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:55.393989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8a182-e50e-4806-ab96-d70f99aec9fd admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:55.407265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8a182-e50e-4806-ab96-d70f99aec9fd admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:55.412134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a76bc8-3a60-418f-b526-eec36ea1edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:55.412791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a76bc8-3a60-418f-b526-eec36ea1edcb admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:55.413067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a76bc8-3a60-418f-b526-eec36ea1edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:55.413340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a76bc8-3a60-418f-b526-eec36ea1edcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:55.413987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a76bc8-3a60-418f-b526-eec36ea1edcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:55.415867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a76bc8-3a60-418f-b526-eec36ea1edcb admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:55.427157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1133/2278] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:13:55.431539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f6433-5d46-4806-b5cb-994889d9366f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:55.442486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f6433-5d46-4806-b5cb-994889d9366f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:55.447788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad3409-5e17-4fb0-bdb8-224304d953c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:55.448500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3409-5e17-4fb0-bdb8-224304d953c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:55.448777 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3409-5e17-4fb0-bdb8-224304d953c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:55.449050 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3409-5e17-4fb0-bdb8-224304d953c0 admin admin] PATH_INFO: `/v3/projects/a7418dda4b174ab5808ba40ac19c4a79/users/3c501059b7884b1b8d89c195ebb32a36/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:55.465971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad3409-5e17-4fb0-bdb8-224304d953c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7418dda4b174ab5808ba40ac19c4a79, user_id=3c501059b7884b1b8d89c195ebb32a36, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:55.469011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad3409-5e17-4fb0-bdb8-224304d953c0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:55.487635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1146/2279] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:13:55 2022] PUT /identity/v3/projects/a7418dda4b174ab5808ba40ac19c4a79/users/3c501059b7884b1b8d89c195ebb32a36/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:55.498560 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96380b37-9766-41a7-902d-f54f2a481912 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:55.498984 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96380b37-9766-41a7-902d-f54f2a481912 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:55.499318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96380b37-9766-41a7-902d-f54f2a481912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:55.528186 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-96380b37-9766-41a7-902d-f54f2a481912 None None] MFA Rules not processed for user `3c501059b7884b1b8d89c195ebb32a36`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:55.529430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-96380b37-9766-41a7-902d-f54f2a481912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:55.597239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1134/2280] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:55.608981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad3409-5e17-4fb0-bdb8-224304d953c0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:55.611258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-86ad3409-5e17-4fb0-bdb8-224304d953c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:55.674636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad3409-5e17-4fb0-bdb8-224304d953c0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:55.678438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af4902-047c-4334-822f-de83044b90e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:55.679126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af4902-047c-4334-822f-de83044b90e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:55.679469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af4902-047c-4334-822f-de83044b90e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:55.679835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af4902-047c-4334-822f-de83044b90e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:55.688801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af4902-047c-4334-822f-de83044b90e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:55.690384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af4902-047c-4334-822f-de83044b90e4 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:55.703743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1147/2281] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:58.963223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96380b37-9766-41a7-902d-f54f2a481912 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:58.964785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-96380b37-9766-41a7-902d-f54f2a481912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:58.986016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b539cf-681b-4e63-ad78-d6d729865f6c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:58.986550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b539cf-681b-4e63-ad78-d6d729865f6c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:58.986550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b539cf-681b-4e63-ad78-d6d729865f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:59.013502 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-90b539cf-681b-4e63-ad78-d6d729865f6c None None] MFA Rules not processed for user `05a9bc165e1046ebbba3ab0aa4432b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:59.014688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-90b539cf-681b-4e63-ad78-d6d729865f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:59.078587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96380b37-9766-41a7-902d-f54f2a481912 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:59.083826 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:59.085279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:59.085558 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:59.086002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] PATH_INFO: `/v3/users/71303fabf3c342c7827ea150ed8a1cf2` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:59.087740 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] RBAC: Authorizing `identity:delete_user(user_id=71303fabf3c342c7827ea150ed8a1cf2)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:59.090634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:59.104033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1148/2282] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:59.159140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71303fabf3c342c7827ea150ed8a1cf2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:59.159943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71303fabf3c342c7827ea150ed8a1cf2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:59.179155 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71303fabf3c342c7827ea150ed8a1cf2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:59.179971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71303fabf3c342c7827ea150ed8a1cf2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:59.194465 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71303fabf3c342c7827ea150ed8a1cf2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:59.197137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:59.210964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1135/2283] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:58 2022] DELETE /identity/v3/users/71303fabf3c342c7827ea150ed8a1cf2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:59.215508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c5f4e-3142-4dfd-bc0b-ffab187593bf None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:59.215788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c5f4e-3142-4dfd-bc0b-ffab187593bf None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:59.216060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c5f4e-3142-4dfd-bc0b-ffab187593bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:59.236557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c66c5f4e-3142-4dfd-bc0b-ffab187593bf None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:13:59.237786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c66c5f4e-3142-4dfd-bc0b-ffab187593bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:59.301642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1149/2284] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:13:59.311765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:59.313343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:59.377581 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779ee10-b866-419e-a753-d0d9ee5d446b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:59.381237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4f3fb-228b-441b-951d-89136dd222b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:59.381881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4f3fb-228b-441b-951d-89136dd222b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:59.382156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4f3fb-228b-441b-951d-89136dd222b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:59.382394 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4f3fb-228b-441b-951d-89136dd222b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:59.391421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4f3fb-228b-441b-951d-89136dd222b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:59.392997 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4f3fb-228b-441b-951d-89136dd222b8 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:59.403441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1136/2285] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:13:59.732313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c5f4e-3142-4dfd-bc0b-ffab187593bf None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:59.734112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c66c5f4e-3142-4dfd-bc0b-ffab187593bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:13:59.761624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c5f4e-3142-4dfd-bc0b-ffab187593bf None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:59.770615 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:59.771744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:59.771744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:59.771944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] PATH_INFO: `/v3/projects/7de2417d136a4accbdec566a4332aa21` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:59.773893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de2417d136a4accbdec566a4332aa21)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:59.780000 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:13:59.784500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:59.856017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de2417d136a4accbdec566a4332aa21', 'request_id': 'req-c0d46a67-5f1c-4356-b6e1-05b5def179af'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:59.862339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de2417d136a4accbdec566a4332aa21', 'request_id': 'req-c0d46a67-5f1c-4356-b6e1-05b5def179af'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:59.868947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de2417d136a4accbdec566a4332aa21', 'request_id': 'req-c0d46a67-5f1c-4356-b6e1-05b5def179af'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:59.888692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] The token cache is being invalidate because project 7de2417d136a4accbdec566a4332aa21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:13:59.888982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:59.889620 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:13:59.892586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1150/2286] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:13:59 2022] DELETE /identity/v3/projects/7de2417d136a4accbdec566a4332aa21 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:13:59.896897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4f3fb-228b-441b-951d-89136dd222b8 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:13:59.907280 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4f3fb-228b-441b-951d-89136dd222b8 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:13:59.988359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f2c7f-7bfb-43d0-a6b3-5958e5ec70d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:13:59.990140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f2c7f-7bfb-43d0-a6b3-5958e5ec70d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:13:59.990641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f2c7f-7bfb-43d0-a6b3-5958e5ec70d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:13:59.991105 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f2c7f-7bfb-43d0-a6b3-5958e5ec70d3 admin admin] PATH_INFO: `/v3/users/d9c64a7916ca4899878005c4ddebcfc2` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:13:59.992320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f2c7f-7bfb-43d0-a6b3-5958e5ec70d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c64a7916ca4899878005c4ddebcfc2)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:13:59.994338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f2c7f-7bfb-43d0-a6b3-5958e5ec70d3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:00.059249 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-219f2c7f-7bfb-43d0-a6b3-5958e5ec70d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c64a7916ca4899878005c4ddebcfc2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:00.060050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-219f2c7f-7bfb-43d0-a6b3-5958e5ec70d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c64a7916ca4899878005c4ddebcfc2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:00.068546 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-219f2c7f-7bfb-43d0-a6b3-5958e5ec70d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c64a7916ca4899878005c4ddebcfc2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:00.069243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-219f2c7f-7bfb-43d0-a6b3-5958e5ec70d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c64a7916ca4899878005c4ddebcfc2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:00.084262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-219f2c7f-7bfb-43d0-a6b3-5958e5ec70d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c64a7916ca4899878005c4ddebcfc2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:00.102454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1137/2287] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:13:59 2022] DELETE /identity/v3/users/d9c64a7916ca4899878005c4ddebcfc2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:00.402724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:00.404323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:00.442327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d46a67-5f1c-4356-b6e1-05b5def179af admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:00.525738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:00.526432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:00.526715 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:00.526994 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb admin admin] PATH_INFO: `/v3/projects/9a648c48f9ce41a2a2ae0d9611b88dc1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:00.528964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a648c48f9ce41a2a2ae0d9611b88dc1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:00.530974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:00.596010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a648c48f9ce41a2a2ae0d9611b88dc1', 'request_id': 'req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:00.603153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a648c48f9ce41a2a2ae0d9611b88dc1', 'request_id': 'req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:00.610111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a648c48f9ce41a2a2ae0d9611b88dc1', 'request_id': 'req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:00.626056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb admin admin] The token cache is being invalidate because project 9a648c48f9ce41a2a2ae0d9611b88dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:00.626516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:00.627108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2a7172d6-1a82-44ec-b3e7-46fa697cb5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:00.629100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1151/2288] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:00 2022] DELETE /identity/v3/projects/9a648c48f9ce41a2a2ae0d9611b88dc1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:00.634005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27144dbd-8ff5-475c-b132-9067e360e57c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:00.634288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27144dbd-8ff5-475c-b132-9067e360e57c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:00.634560 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27144dbd-8ff5-475c-b132-9067e360e57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:00.666425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-27144dbd-8ff5-475c-b132-9067e360e57c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:00.667772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-27144dbd-8ff5-475c-b132-9067e360e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:00.681390 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:00.740712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1138/2289] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:00.749147 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969fb8a-8ccf-48be-afbb-18580b8c898b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:00.749413 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969fb8a-8ccf-48be-afbb-18580b8c898b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:00.749687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969fb8a-8ccf-48be-afbb-18580b8c898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:00.771221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6969fb8a-8ccf-48be-afbb-18580b8c898b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:00.773118 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6969fb8a-8ccf-48be-afbb-18580b8c898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:00.786323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1152/2290] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:00.787518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27144dbd-8ff5-475c-b132-9067e360e57c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:00.800451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27144dbd-8ff5-475c-b132-9067e360e57c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:00.805926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5a1a3-315f-4a27-a089-9d01df9b541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:00.806540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5a1a3-315f-4a27-a089-9d01df9b541c admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:00.806812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5a1a3-315f-4a27-a089-9d01df9b541c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:00.807236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5a1a3-315f-4a27-a089-9d01df9b541c admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:00.807888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5a1a3-315f-4a27-a089-9d01df9b541c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:14:00.808194 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5a1a3-315f-4a27-a089-9d01df9b541c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:00.810115 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5a1a3-315f-4a27-a089-9d01df9b541c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:00.827782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1139/2291] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:14:00.829139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969fb8a-8ccf-48be-afbb-18580b8c898b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:00.845824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969fb8a-8ccf-48be-afbb-18580b8c898b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:00.852328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc854ed-e650-46e5-88da-778fd358f98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:00.853251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc854ed-e650-46e5-88da-778fd358f98a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:00.853531 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc854ed-e650-46e5-88da-778fd358f98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:00.853847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc854ed-e650-46e5-88da-778fd358f98a admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:00.854554 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc854ed-e650-46e5-88da-778fd358f98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:00.856583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc854ed-e650-46e5-88da-778fd358f98a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:00.874154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:00.901941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1153/2292] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:14:00 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:14:00.906704 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5a1a3-315f-4a27-a089-9d01df9b541c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:00.917608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5a1a3-315f-4a27-a089-9d01df9b541c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:00.978034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadab7eb-a468-4e63-807f-61915115e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:00.978758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadab7eb-a468-4e63-807f-61915115e252 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:00.979091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadab7eb-a468-4e63-807f-61915115e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:00.979364 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadab7eb-a468-4e63-807f-61915115e252 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:00.980007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadab7eb-a468-4e63-807f-61915115e252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:00.982010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadab7eb-a468-4e63-807f-61915115e252 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:01.011959 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1140/2293] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:14:00 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:01.013262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc854ed-e650-46e5-88da-778fd358f98a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:01.025894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc854ed-e650-46e5-88da-778fd358f98a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:01.030611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba131b0-eed1-4a32-9385-8c5581899880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:01.031223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba131b0-eed1-4a32-9385-8c5581899880 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:01.031603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba131b0-eed1-4a32-9385-8c5581899880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:01.031916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba131b0-eed1-4a32-9385-8c5581899880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:01.032677 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba131b0-eed1-4a32-9385-8c5581899880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:01.034317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba131b0-eed1-4a32-9385-8c5581899880 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:01.057569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1154/2294] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:14:01.058762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadab7eb-a468-4e63-807f-61915115e252 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:01.074859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadab7eb-a468-4e63-807f-61915115e252 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:01.082488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1ee7c-8e68-46cb-8648-b972134a5465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:01.083329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1ee7c-8e68-46cb-8648-b972134a5465 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:01.083756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1ee7c-8e68-46cb-8648-b972134a5465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:01.084207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1ee7c-8e68-46cb-8648-b972134a5465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:01.085034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1ee7c-8e68-46cb-8648-b972134a5465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:01.086831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1ee7c-8e68-46cb-8648-b972134a5465 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:01.101443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1141/2295] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:01.105883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba131b0-eed1-4a32-9385-8c5581899880 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:01.119236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba131b0-eed1-4a32-9385-8c5581899880 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:01.124760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c25c7-19cf-479c-8437-1c45643a794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:01.125924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c25c7-19cf-479c-8437-1c45643a794b admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:01.126214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c25c7-19cf-479c-8437-1c45643a794b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:01.126471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c25c7-19cf-479c-8437-1c45643a794b admin admin] PATH_INFO: `/v3/projects/00ec3b3901724a519407ac343d47160c/users/b3201609cdf840a7ab6b34412dde7782/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:01.144843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c25c7-19cf-479c-8437-1c45643a794b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ec3b3901724a519407ac343d47160c, user_id=b3201609cdf840a7ab6b34412dde7782, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:01.148339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c25c7-19cf-479c-8437-1c45643a794b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:01.180349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1155/2296] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:14:01 2022] PUT /identity/v3/projects/00ec3b3901724a519407ac343d47160c/users/b3201609cdf840a7ab6b34412dde7782/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:14:01.182972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b015d00-357b-4764-9cb5-3b183751b2ac None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:01.183614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b015d00-357b-4764-9cb5-3b183751b2ac None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:01.183922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b015d00-357b-4764-9cb5-3b183751b2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:01.233098 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4b015d00-357b-4764-9cb5-3b183751b2ac None None] MFA Rules not processed for user `b3201609cdf840a7ab6b34412dde7782`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:01.234901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4b015d00-357b-4764-9cb5-3b183751b2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:01.349453 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1142/2297] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:01.350282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c25c7-19cf-479c-8437-1c45643a794b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:01.428202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c25c7-19cf-479c-8437-1c45643a794b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:01.442342 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eaf07-3de9-4909-9db7-3187eb8ff3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:01.443099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eaf07-3de9-4909-9db7-3187eb8ff3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:01.444023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eaf07-3de9-4909-9db7-3187eb8ff3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:01.444432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eaf07-3de9-4909-9db7-3187eb8ff3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:01.445345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6eaf07-3de9-4909-9db7-3187eb8ff3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:01.448129 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6eaf07-3de9-4909-9db7-3187eb8ff3f3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:01.489349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1156/2298] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:14:01 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:14:01.491337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b015d00-357b-4764-9cb5-3b183751b2ac None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:01.505609 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b015d00-357b-4764-9cb5-3b183751b2ac None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:01.520225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:01.587236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc8ffa-e9b3-4948-9ad3-995625ff7e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:01.588078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc8ffa-e9b3-4948-9ad3-995625ff7e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:01.588411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc8ffa-e9b3-4948-9ad3-995625ff7e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:01.589800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc8ffa-e9b3-4948-9ad3-995625ff7e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:01.590591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc8ffa-e9b3-4948-9ad3-995625ff7e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:01.592772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc8ffa-e9b3-4948-9ad3-995625ff7e67 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:01.617301 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1143/2299] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:14:01 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:01.621579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eaf07-3de9-4909-9db7-3187eb8ff3f3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:01.633067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eaf07-3de9-4909-9db7-3187eb8ff3f3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:01.639466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d12ded-b96a-4db1-947f-98dfd55ebdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:01.640127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d12ded-b96a-4db1-947f-98dfd55ebdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:01.640449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d12ded-b96a-4db1-947f-98dfd55ebdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:01.640722 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d12ded-b96a-4db1-947f-98dfd55ebdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:01.641525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d12ded-b96a-4db1-947f-98dfd55ebdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:01.643201 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d12ded-b96a-4db1-947f-98dfd55ebdd7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:01.655029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1157/2300] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:01.659942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc8ffa-e9b3-4948-9ad3-995625ff7e67 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:01.672329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc8ffa-e9b3-4948-9ad3-995625ff7e67 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:01.678518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee0b4f-e63d-4c6f-820a-9a35d929e351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:01.679435 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee0b4f-e63d-4c6f-820a-9a35d929e351 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:01.679789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee0b4f-e63d-4c6f-820a-9a35d929e351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:01.680227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee0b4f-e63d-4c6f-820a-9a35d929e351 admin admin] PATH_INFO: `/v3/projects/9067d2efa224438db1f69cb04aa68769/users/c7d2f5faca834683b93cb4c6c379741e/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:01.698445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee0b4f-e63d-4c6f-820a-9a35d929e351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9067d2efa224438db1f69cb04aa68769, user_id=c7d2f5faca834683b93cb4c6c379741e, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:01.701499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee0b4f-e63d-4c6f-820a-9a35d929e351 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:01.721157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1144/2301] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:14:01 2022] PUT /identity/v3/projects/9067d2efa224438db1f69cb04aa68769/users/c7d2f5faca834683b93cb4c6c379741e/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:14:01.725181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d12ded-b96a-4db1-947f-98dfd55ebdd7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:01.738651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d12ded-b96a-4db1-947f-98dfd55ebdd7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:01.815900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c829b1-94d1-493c-9d98-355bee4d7ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:01.816677 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c829b1-94d1-493c-9d98-355bee4d7ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:01.817023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c829b1-94d1-493c-9d98-355bee4d7ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:01.817367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c829b1-94d1-493c-9d98-355bee4d7ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:01.818098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c829b1-94d1-493c-9d98-355bee4d7ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:01.819866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c829b1-94d1-493c-9d98-355bee4d7ae2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:01.831452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1158/2302] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:01.836353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee0b4f-e63d-4c6f-820a-9a35d929e351 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:01.854398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee0b4f-e63d-4c6f-820a-9a35d929e351 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:01.860696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927c611-44ed-4740-bcfa-fd880eb21560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:01.861481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927c611-44ed-4740-bcfa-fd880eb21560 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:01.861769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927c611-44ed-4740-bcfa-fd880eb21560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:01.862049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927c611-44ed-4740-bcfa-fd880eb21560 admin admin] PATH_INFO: `/v3/projects/9067d2efa224438db1f69cb04aa68769/users/c7d2f5faca834683b93cb4c6c379741e/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:01.864077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927c611-44ed-4740-bcfa-fd880eb21560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9067d2efa224438db1f69cb04aa68769, user_id=c7d2f5faca834683b93cb4c6c379741e, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:01.867415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927c611-44ed-4740-bcfa-fd880eb21560 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:01.880204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1145/2303] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:14:01 2022] PUT /identity/v3/projects/9067d2efa224438db1f69cb04aa68769/users/c7d2f5faca834683b93cb4c6c379741e/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:01.890966 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dbdcf-f59a-4f87-93d5-d6c5dc7ee818 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:01.891296 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dbdcf-f59a-4f87-93d5-d6c5dc7ee818 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:01.891707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dbdcf-f59a-4f87-93d5-d6c5dc7ee818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:01.932763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-886dbdcf-f59a-4f87-93d5-d6c5dc7ee818 None None] MFA Rules not processed for user `c7d2f5faca834683b93cb4c6c379741e`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:01.934197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-886dbdcf-f59a-4f87-93d5-d6c5dc7ee818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:01.973678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:02.063728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1159/2304] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:02.072053 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927c611-44ed-4740-bcfa-fd880eb21560 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:02.074004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7927c611-44ed-4740-bcfa-fd880eb21560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:02.143880 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927c611-44ed-4740-bcfa-fd880eb21560 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:02.148469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3bcf5-37f5-4d80-b9e4-dd053da9370a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:02.149296 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3bcf5-37f5-4d80-b9e4-dd053da9370a service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:02.149734 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3bcf5-37f5-4d80-b9e4-dd053da9370a service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:02.150008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3bcf5-37f5-4d80-b9e4-dd053da9370a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:02.160020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3bcf5-37f5-4d80-b9e4-dd053da9370a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:02.161596 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3bcf5-37f5-4d80-b9e4-dd053da9370a service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:02.171653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1146/2305] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:02.389443 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dbdcf-f59a-4f87-93d5-d6c5dc7ee818 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:02.497635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dbdcf-f59a-4f87-93d5-d6c5dc7ee818 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:02.503411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:02.504228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:02.504534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:02.504807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] PATH_INFO: `/v3/users/b3201609cdf840a7ab6b34412dde7782` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:02.505993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3201609cdf840a7ab6b34412dde7782)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:02.508025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:02.571540 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3201609cdf840a7ab6b34412dde7782'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:02.572321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3201609cdf840a7ab6b34412dde7782'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:02.582096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3201609cdf840a7ab6b34412dde7782'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:02.590117 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3201609cdf840a7ab6b34412dde7782'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:02.590932 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3201609cdf840a7ab6b34412dde7782'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:02.611146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1160/2306] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:14:02 2022] DELETE /identity/v3/users/b3201609cdf840a7ab6b34412dde7782 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:02.615444 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd19a6-21fa-42c2-8019-c52bb79e2eb6 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:02.615724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd19a6-21fa-42c2-8019-c52bb79e2eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:02.615994 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd19a6-21fa-42c2-8019-c52bb79e2eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:02.635895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6ecd19a6-21fa-42c2-8019-c52bb79e2eb6 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:02.637156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6ecd19a6-21fa-42c2-8019-c52bb79e2eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:02.703396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1147/2307] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:14:02.714755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:02.716345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:02.758434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:02.789436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cf207-21fb-45ec-9dfe-bc9b5dc4cb9a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:02.793942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9169c-1816-4334-aaf5-d480ccbbaa23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:02.794654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9169c-1816-4334-aaf5-d480ccbbaa23 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:02.794932 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9169c-1816-4334-aaf5-d480ccbbaa23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:02.795200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9169c-1816-4334-aaf5-d480ccbbaa23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:02.805312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9169c-1816-4334-aaf5-d480ccbbaa23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:02.807128 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9169c-1816-4334-aaf5-d480ccbbaa23 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:02.818111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1161/2308] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:03.280999 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd19a6-21fa-42c2-8019-c52bb79e2eb6 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:03.282565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6ecd19a6-21fa-42c2-8019-c52bb79e2eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:03.296221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd19a6-21fa-42c2-8019-c52bb79e2eb6 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:03.302116 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:03.303069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:03.303343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:03.303791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] PATH_INFO: `/v3/projects/00ec3b3901724a519407ac343d47160c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:03.305273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ec3b3901724a519407ac343d47160c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:03.307276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:03.309078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:03.362917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ec3b3901724a519407ac343d47160c', 'request_id': 'req-01c923d0-0ff5-4945-8348-6e151a02df4d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:03.369887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ec3b3901724a519407ac343d47160c', 'request_id': 'req-01c923d0-0ff5-4945-8348-6e151a02df4d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:03.384095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ec3b3901724a519407ac343d47160c', 'request_id': 'req-01c923d0-0ff5-4945-8348-6e151a02df4d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:03.396028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] The token cache is being invalidate because project 00ec3b3901724a519407ac343d47160c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:03.396332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:03.396992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:03.398896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1148/2309] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:03 2022] DELETE /identity/v3/projects/00ec3b3901724a519407ac343d47160c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:03.403293 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9169c-1816-4334-aaf5-d480ccbbaa23 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:03.414003 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9169c-1816-4334-aaf5-d480ccbbaa23 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:03.471256 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f8af5-1207-4d40-b1dd-f260dca0ffcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:03.471917 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f8af5-1207-4d40-b1dd-f260dca0ffcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:03.472169 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f8af5-1207-4d40-b1dd-f260dca0ffcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:03.472472 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f8af5-1207-4d40-b1dd-f260dca0ffcc admin admin] PATH_INFO: `/v3/users/c7d2f5faca834683b93cb4c6c379741e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:03.473630 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f8af5-1207-4d40-b1dd-f260dca0ffcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d2f5faca834683b93cb4c6c379741e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:03.475596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f8af5-1207-4d40-b1dd-f260dca0ffcc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:03.540622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d99f8af5-1207-4d40-b1dd-f260dca0ffcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d2f5faca834683b93cb4c6c379741e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:03.541753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d99f8af5-1207-4d40-b1dd-f260dca0ffcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d2f5faca834683b93cb4c6c379741e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:03.553100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d99f8af5-1207-4d40-b1dd-f260dca0ffcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d2f5faca834683b93cb4c6c379741e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:03.566644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d99f8af5-1207-4d40-b1dd-f260dca0ffcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d2f5faca834683b93cb4c6c379741e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:03.568181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d99f8af5-1207-4d40-b1dd-f260dca0ffcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d2f5faca834683b93cb4c6c379741e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:03.591163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1162/2310] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:14:03 2022] DELETE /identity/v3/users/c7d2f5faca834683b93cb4c6c379741e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:03.914147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:03.916150 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:03.930906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c923d0-0ff5-4945-8348-6e151a02df4d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:04.010316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54622c74-f57a-4ffb-857e-70239ab73db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:04.011177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54622c74-f57a-4ffb-857e-70239ab73db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.011554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54622c74-f57a-4ffb-857e-70239ab73db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.011927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54622c74-f57a-4ffb-857e-70239ab73db6 admin admin] PATH_INFO: `/v3/projects/9067d2efa224438db1f69cb04aa68769` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.015492 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54622c74-f57a-4ffb-857e-70239ab73db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9067d2efa224438db1f69cb04aa68769)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:04.018018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54622c74-f57a-4ffb-857e-70239ab73db6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:04.073960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-54622c74-f57a-4ffb-857e-70239ab73db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9067d2efa224438db1f69cb04aa68769', 'request_id': 'req-54622c74-f57a-4ffb-857e-70239ab73db6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:04.080320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-54622c74-f57a-4ffb-857e-70239ab73db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9067d2efa224438db1f69cb04aa68769', 'request_id': 'req-54622c74-f57a-4ffb-857e-70239ab73db6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:04.090554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-54622c74-f57a-4ffb-857e-70239ab73db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9067d2efa224438db1f69cb04aa68769', 'request_id': 'req-54622c74-f57a-4ffb-857e-70239ab73db6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:04.104410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-54622c74-f57a-4ffb-857e-70239ab73db6 admin admin] The token cache is being invalidate because project 9067d2efa224438db1f69cb04aa68769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:04.104799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-54622c74-f57a-4ffb-857e-70239ab73db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:04.105383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-54622c74-f57a-4ffb-857e-70239ab73db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:04.107016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1149/2311] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:03 2022] DELETE /identity/v3/projects/9067d2efa224438db1f69cb04aa68769 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:04.112083 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03174c-b188-4e58-9f2e-165fdbeff95d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.112474 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03174c-b188-4e58-9f2e-165fdbeff95d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.112840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03174c-b188-4e58-9f2e-165fdbeff95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.133549 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9d03174c-b188-4e58-9f2e-165fdbeff95d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:04.134856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9d03174c-b188-4e58-9f2e-165fdbeff95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:04.185530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:04.198460 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1163/2312] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:04.206309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cdd9d-bf1d-463a-b186-f2783dd07db1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.206590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cdd9d-bf1d-463a-b186-f2783dd07db1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.206868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cdd9d-bf1d-463a-b186-f2783dd07db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.230360 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b98cdd9d-bf1d-463a-b186-f2783dd07db1 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:04.231577 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b98cdd9d-bf1d-463a-b186-f2783dd07db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:04.239605 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1150/2313] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:04.244032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03174c-b188-4e58-9f2e-165fdbeff95d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:04.254188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03174c-b188-4e58-9f2e-165fdbeff95d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:04.259796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c48c74-40f3-40a0-bb74-c3f0705b74d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:04.260557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c48c74-40f3-40a0-bb74-c3f0705b74d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.260943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c48c74-40f3-40a0-bb74-c3f0705b74d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.261306 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c48c74-40f3-40a0-bb74-c3f0705b74d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.262033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c48c74-40f3-40a0-bb74-c3f0705b74d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:14:04.262414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c48c74-40f3-40a0-bb74-c3f0705b74d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:04.264178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c48c74-40f3-40a0-bb74-c3f0705b74d5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:04.277703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1164/2314] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:14:04.282240 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cdd9d-bf1d-463a-b186-f2783dd07db1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:04.292519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cdd9d-bf1d-463a-b186-f2783dd07db1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:04.297339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71549a-1f30-40ff-9f98-afc2f1f8bf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:04.298063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71549a-1f30-40ff-9f98-afc2f1f8bf8a admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.298325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71549a-1f30-40ff-9f98-afc2f1f8bf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.298595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71549a-1f30-40ff-9f98-afc2f1f8bf8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.299243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71549a-1f30-40ff-9f98-afc2f1f8bf8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:04.301273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71549a-1f30-40ff-9f98-afc2f1f8bf8a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:04.312838 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:04.341174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1151/2315] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:14:04 2022] POST /identity/v3/projects => generated 407 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:04.342658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c48c74-40f3-40a0-bb74-c3f0705b74d5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:04.355018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c48c74-40f3-40a0-bb74-c3f0705b74d5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:04.415896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6200a1-6893-46ac-ac3a-647312759ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:04.416658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6200a1-6893-46ac-ac3a-647312759ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.416979 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6200a1-6893-46ac-ac3a-647312759ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.417309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6200a1-6893-46ac-ac3a-647312759ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.418160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6200a1-6893-46ac-ac3a-647312759ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:04.420760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6200a1-6893-46ac-ac3a-647312759ef6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:04.449757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1165/2316] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:14:04 2022] POST /identity/v3/users => generated 304 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:04.455062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71549a-1f30-40ff-9f98-afc2f1f8bf8a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:04.470485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71549a-1f30-40ff-9f98-afc2f1f8bf8a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:04.476254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b90a38-14d8-4b96-9721-711d094666b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:04.476887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b90a38-14d8-4b96-9721-711d094666b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.477162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b90a38-14d8-4b96-9721-711d094666b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.477438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b90a38-14d8-4b96-9721-711d094666b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.478077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b90a38-14d8-4b96-9721-711d094666b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:04.479757 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b90a38-14d8-4b96-9721-711d094666b5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:04.490592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1152/2317] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:04.494699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6200a1-6893-46ac-ac3a-647312759ef6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:04.506300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6200a1-6893-46ac-ac3a-647312759ef6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:04.511518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a07541-e9d8-452e-8240-99e9b2d4aaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:04.512133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a07541-e9d8-452e-8240-99e9b2d4aaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.512457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a07541-e9d8-452e-8240-99e9b2d4aaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.512729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a07541-e9d8-452e-8240-99e9b2d4aaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.513382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a07541-e9d8-452e-8240-99e9b2d4aaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:04.515066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a07541-e9d8-452e-8240-99e9b2d4aaa3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:04.526246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1166/2318] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:04.530646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b90a38-14d8-4b96-9721-711d094666b5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:04.540798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b90a38-14d8-4b96-9721-711d094666b5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:04.548152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b978139-6020-4e12-9e51-8478f7c171ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:04.548996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b978139-6020-4e12-9e51-8478f7c171ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.549295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b978139-6020-4e12-9e51-8478f7c171ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.549873 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b978139-6020-4e12-9e51-8478f7c171ad admin admin] PATH_INFO: `/v3/projects/82a255a7fcc147f89b7302e246ae562f/users/06788afdc12848158be32a076e841c4e/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.569258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b978139-6020-4e12-9e51-8478f7c171ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a255a7fcc147f89b7302e246ae562f, user_id=06788afdc12848158be32a076e841c4e, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:04.572021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b978139-6020-4e12-9e51-8478f7c171ad admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:04.587314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1153/2319] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:14:04 2022] PUT /identity/v3/projects/82a255a7fcc147f89b7302e246ae562f/users/06788afdc12848158be32a076e841c4e/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:04.599581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030afbe-e2a4-4825-b2fc-5be145d8db25 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.600154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030afbe-e2a4-4825-b2fc-5be145d8db25 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.600154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030afbe-e2a4-4825-b2fc-5be145d8db25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.629739 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c030afbe-e2a4-4825-b2fc-5be145d8db25 None None] MFA Rules not processed for user `06788afdc12848158be32a076e841c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:04.630962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c030afbe-e2a4-4825-b2fc-5be145d8db25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:04.706790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1167/2320] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:04.711906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b978139-6020-4e12-9e51-8478f7c171ad admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:04.790403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b978139-6020-4e12-9e51-8478f7c171ad admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:04.795099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b10d0a-c748-4262-9d0f-a51684c75ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:04.795941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b10d0a-c748-4262-9d0f-a51684c75ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.796282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b10d0a-c748-4262-9d0f-a51684c75ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.796644 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b10d0a-c748-4262-9d0f-a51684c75ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.797339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b10d0a-c748-4262-9d0f-a51684c75ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:04.799577 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b10d0a-c748-4262-9d0f-a51684c75ab7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:04.832583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1154/2321] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:14:04 2022] POST /identity/v3/projects => generated 407 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:04.836442 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030afbe-e2a4-4825-b2fc-5be145d8db25 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:04.848063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030afbe-e2a4-4825-b2fc-5be145d8db25 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:04.906507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:04.944122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985f4c8-fdfd-4bc3-ac6f-1860cd98b83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:04.944975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985f4c8-fdfd-4bc3-ac6f-1860cd98b83e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.945340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985f4c8-fdfd-4bc3-ac6f-1860cd98b83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.945669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985f4c8-fdfd-4bc3-ac6f-1860cd98b83e admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.946398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985f4c8-fdfd-4bc3-ac6f-1860cd98b83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:04.948572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985f4c8-fdfd-4bc3-ac6f-1860cd98b83e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:04.975369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1168/2322] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:14:04 2022] POST /identity/v3/users => generated 310 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:14:04.979633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b10d0a-c748-4262-9d0f-a51684c75ab7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:04.990920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b10d0a-c748-4262-9d0f-a51684c75ab7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:04.995610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4762f47-3436-4ff6-a4a3-b902f2afcf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:04.996413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4762f47-3436-4ff6-a4a3-b902f2afcf88 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:04.997002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4762f47-3436-4ff6-a4a3-b902f2afcf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:04.997002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4762f47-3436-4ff6-a4a3-b902f2afcf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:04.997767 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4762f47-3436-4ff6-a4a3-b902f2afcf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:04.999648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4762f47-3436-4ff6-a4a3-b902f2afcf88 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:05.015916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1155/2323] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:05.019847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985f4c8-fdfd-4bc3-ac6f-1860cd98b83e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:05.030495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985f4c8-fdfd-4bc3-ac6f-1860cd98b83e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:05.035754 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4881a2-829e-439e-a1b2-25c3c7e2c913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:05.036454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4881a2-829e-439e-a1b2-25c3c7e2c913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:05.036731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4881a2-829e-439e-a1b2-25c3c7e2c913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:05.037003 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4881a2-829e-439e-a1b2-25c3c7e2c913 admin admin] PATH_INFO: `/v3/projects/97d1f2beecd242b4bb1f5aaa586cef37/users/3190248dbe3f48918846bc6a58254b74/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:05.061343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4881a2-829e-439e-a1b2-25c3c7e2c913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d1f2beecd242b4bb1f5aaa586cef37, user_id=3190248dbe3f48918846bc6a58254b74, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:05.064127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4881a2-829e-439e-a1b2-25c3c7e2c913 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:05.089988 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1169/2324] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:14:05 2022] PUT /identity/v3/projects/97d1f2beecd242b4bb1f5aaa586cef37/users/3190248dbe3f48918846bc6a58254b74/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:05.093565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4762f47-3436-4ff6-a4a3-b902f2afcf88 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:05.104129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4762f47-3436-4ff6-a4a3-b902f2afcf88 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:05.168370 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923ff0d-c498-491d-8271-bbd385e1072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:05.168979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923ff0d-c498-491d-8271-bbd385e1072c admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:05.169259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923ff0d-c498-491d-8271-bbd385e1072c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:05.169531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923ff0d-c498-491d-8271-bbd385e1072c admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:05.170174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923ff0d-c498-491d-8271-bbd385e1072c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:05.171826 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923ff0d-c498-491d-8271-bbd385e1072c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:05.183347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1156/2325] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:14:05.188047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4881a2-829e-439e-a1b2-25c3c7e2c913 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:05.198597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4881a2-829e-439e-a1b2-25c3c7e2c913 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:05.203932 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26af7f-8dd0-4a9b-9be8-74c26e24b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:05.204621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26af7f-8dd0-4a9b-9be8-74c26e24b445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:05.204893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26af7f-8dd0-4a9b-9be8-74c26e24b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:05.205161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26af7f-8dd0-4a9b-9be8-74c26e24b445 admin admin] PATH_INFO: `/v3/projects/97d1f2beecd242b4bb1f5aaa586cef37/users/3190248dbe3f48918846bc6a58254b74/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:05.207313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26af7f-8dd0-4a9b-9be8-74c26e24b445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d1f2beecd242b4bb1f5aaa586cef37, user_id=3190248dbe3f48918846bc6a58254b74, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:05.210609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26af7f-8dd0-4a9b-9be8-74c26e24b445 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:05.220760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1170/2326] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:14:05 2022] PUT /identity/v3/projects/97d1f2beecd242b4bb1f5aaa586cef37/users/3190248dbe3f48918846bc6a58254b74/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:05.231201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa0b5b-5226-42fd-84f5-da54486e5101 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:05.231513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa0b5b-5226-42fd-84f5-da54486e5101 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:05.231788 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa0b5b-5226-42fd-84f5-da54486e5101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:05.260418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-19aa0b5b-5226-42fd-84f5-da54486e5101 None None] MFA Rules not processed for user `3190248dbe3f48918846bc6a58254b74`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:05.261634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-19aa0b5b-5226-42fd-84f5-da54486e5101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:05.275716 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:05.342877 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1157/2327] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:05.354354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26af7f-8dd0-4a9b-9be8-74c26e24b445 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:05.356275 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ab26af7f-8dd0-4a9b-9be8-74c26e24b445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:05.418702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26af7f-8dd0-4a9b-9be8-74c26e24b445 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:05.423407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caac1cb-428e-4135-b0e4-deb2c2c251a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:05.423407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac1cb-428e-4135-b0e4-deb2c2c251a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:05.423792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac1cb-428e-4135-b0e4-deb2c2c251a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:05.423950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac1cb-428e-4135-b0e4-deb2c2c251a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:05.433261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caac1cb-428e-4135-b0e4-deb2c2c251a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:05.434750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caac1cb-428e-4135-b0e4-deb2c2c251a4 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:05.445258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1171/2328] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:05 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:05.606742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa0b5b-5226-42fd-84f5-da54486e5101 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:05.616867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa0b5b-5226-42fd-84f5-da54486e5101 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:05.620401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad7843-f0f0-48b8-bc4f-b8f23eb23b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:05.621012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad7843-f0f0-48b8-bc4f-b8f23eb23b54 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:05.621291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad7843-f0f0-48b8-bc4f-b8f23eb23b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:05.621564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad7843-f0f0-48b8-bc4f-b8f23eb23b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:05.684319 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad7843-f0f0-48b8-bc4f-b8f23eb23b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:05.685693 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad7843-f0f0-48b8-bc4f-b8f23eb23b54 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:05.695764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1158/2329] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:05 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:10.955052 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caac1cb-428e-4135-b0e4-deb2c2c251a4 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:10.956686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6caac1cb-428e-4135-b0e4-deb2c2c251a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:11.042613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caac1cb-428e-4135-b0e4-deb2c2c251a4 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:11.048974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:11.049634 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:11.049911 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:11.050180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] PATH_INFO: `/v3/users/3c501059b7884b1b8d89c195ebb32a36` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:11.051314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c501059b7884b1b8d89c195ebb32a36)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:11.054234 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:11.120668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c501059b7884b1b8d89c195ebb32a36'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.121601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c501059b7884b1b8d89c195ebb32a36'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.124058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:11.131899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c501059b7884b1b8d89c195ebb32a36'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.140107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c501059b7884b1b8d89c195ebb32a36'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.140796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c501059b7884b1b8d89c195ebb32a36'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.166188 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1172/2330] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:14:10 2022] DELETE /identity/v3/users/3c501059b7884b1b8d89c195ebb32a36 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:11.170730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b8bd3-21b3-4f53-a20c-0df8ea238bf5 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:11.171232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b8bd3-21b3-4f53-a20c-0df8ea238bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:11.171413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b8bd3-21b3-4f53-a20c-0df8ea238bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:11.185445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:11.186943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:11.190842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a46b8bd3-21b3-4f53-a20c-0df8ea238bf5 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:11.192003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a46b8bd3-21b3-4f53-a20c-0df8ea238bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:11.252316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1159/2331] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:11.257343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f029a-2d57-4ad1-8802-5f2b2841259a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:11.261393 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab852f-a588-4132-9e58-71cc33eced96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:11.262029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b8bd3-21b3-4f53-a20c-0df8ea238bf5 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:11.262267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab852f-a588-4132-9e58-71cc33eced96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:11.262267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab852f-a588-4132-9e58-71cc33eced96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:11.267749 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab852f-a588-4132-9e58-71cc33eced96 admin admin] PATH_INFO: `/v3/users/06788afdc12848158be32a076e841c4e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:11.267749 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab852f-a588-4132-9e58-71cc33eced96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06788afdc12848158be32a076e841c4e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:11.268084 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a46b8bd3-21b3-4f53-a20c-0df8ea238bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:11.268180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab852f-a588-4132-9e58-71cc33eced96 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:11.316212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-50ab852f-a588-4132-9e58-71cc33eced96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06788afdc12848158be32a076e841c4e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.316910 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-50ab852f-a588-4132-9e58-71cc33eced96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06788afdc12848158be32a076e841c4e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.326028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-50ab852f-a588-4132-9e58-71cc33eced96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06788afdc12848158be32a076e841c4e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.326742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b8bd3-21b3-4f53-a20c-0df8ea238bf5 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:11.330663 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4871905-71d5-4cf7-a161-8be6f59896d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:11.331277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4871905-71d5-4cf7-a161-8be6f59896d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:11.331570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4871905-71d5-4cf7-a161-8be6f59896d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:11.331975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4871905-71d5-4cf7-a161-8be6f59896d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:11.333800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b4871905-71d5-4cf7-a161-8be6f59896d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:11.335872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-50ab852f-a588-4132-9e58-71cc33eced96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06788afdc12848158be32a076e841c4e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.336686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-50ab852f-a588-4132-9e58-71cc33eced96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06788afdc12848158be32a076e841c4e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.343037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:11.347020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4871905-71d5-4cf7-a161-8be6f59896d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:11.349419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4871905-71d5-4cf7-a161-8be6f59896d4 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:11.355386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1173/2332] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:14:11 2022] DELETE /identity/v3/users/06788afdc12848158be32a076e841c4e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:11.359883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecebd2-15b5-4fec-a8de-d12bbe787434 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:11.360166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecebd2-15b5-4fec-a8de-d12bbe787434 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:11.360489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecebd2-15b5-4fec-a8de-d12bbe787434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:11.360889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1160/2333] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:14:11.382806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d5ecebd2-15b5-4fec-a8de-d12bbe787434 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:11.384033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d5ecebd2-15b5-4fec-a8de-d12bbe787434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:11.446455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:11.476324 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1174/2334] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:14:11.495614 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4871905-71d5-4cf7-a161-8be6f59896d4 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:11.497323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b4871905-71d5-4cf7-a161-8be6f59896d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:11.509887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4871905-71d5-4cf7-a161-8be6f59896d4 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:11.583950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83345b-82e7-4842-9520-ccf3eaf78a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:11.585161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83345b-82e7-4842-9520-ccf3eaf78a8b service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:11.585443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83345b-82e7-4842-9520-ccf3eaf78a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:11.585726 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83345b-82e7-4842-9520-ccf3eaf78a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:11.595196 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83345b-82e7-4842-9520-ccf3eaf78a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:11.596711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83345b-82e7-4842-9520-ccf3eaf78a8b service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:11.607233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1161/2335] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:14:11.703699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecebd2-15b5-4fec-a8de-d12bbe787434 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:11.705423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d5ecebd2-15b5-4fec-a8de-d12bbe787434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:11.725305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecebd2-15b5-4fec-a8de-d12bbe787434 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:11.732883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978a104-a5da-45e7-bbef-c80c69b462c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:11.733549 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978a104-a5da-45e7-bbef-c80c69b462c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:11.733822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978a104-a5da-45e7-bbef-c80c69b462c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:11.734071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978a104-a5da-45e7-bbef-c80c69b462c5 admin admin] PATH_INFO: `/v3/projects/a7418dda4b174ab5808ba40ac19c4a79` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:11.738775 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978a104-a5da-45e7-bbef-c80c69b462c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7418dda4b174ab5808ba40ac19c4a79)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:11.741304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978a104-a5da-45e7-bbef-c80c69b462c5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:11.801430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7978a104-a5da-45e7-bbef-c80c69b462c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7418dda4b174ab5808ba40ac19c4a79', 'request_id': 'req-7978a104-a5da-45e7-bbef-c80c69b462c5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.808616 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7978a104-a5da-45e7-bbef-c80c69b462c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7418dda4b174ab5808ba40ac19c4a79', 'request_id': 'req-7978a104-a5da-45e7-bbef-c80c69b462c5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.816062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7978a104-a5da-45e7-bbef-c80c69b462c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7418dda4b174ab5808ba40ac19c4a79', 'request_id': 'req-7978a104-a5da-45e7-bbef-c80c69b462c5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.832980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7978a104-a5da-45e7-bbef-c80c69b462c5 admin admin] The token cache is being invalidate because project a7418dda4b174ab5808ba40ac19c4a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:11.833368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7978a104-a5da-45e7-bbef-c80c69b462c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.834339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7978a104-a5da-45e7-bbef-c80c69b462c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:11.836037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1175/2336] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:11 2022] DELETE /identity/v3/projects/a7418dda4b174ab5808ba40ac19c4a79 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:14:11.841121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe409a4-9605-4579-8d22-56022903b268 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:11.841509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe409a4-9605-4579-8d22-56022903b268 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:11.841870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe409a4-9605-4579-8d22-56022903b268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:11.862603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2fe409a4-9605-4579-8d22-56022903b268 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:11.863859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2fe409a4-9605-4579-8d22-56022903b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:11.932670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1162/2337] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:11.942080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5b50b-aadd-4882-b71c-95e4ef0314ed None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:11.942368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5b50b-aadd-4882-b71c-95e4ef0314ed None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:11.942875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5b50b-aadd-4882-b71c-95e4ef0314ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:11.945076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe409a4-9605-4579-8d22-56022903b268 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:11.946627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2fe409a4-9605-4579-8d22-56022903b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:11.968643 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b1d5b50b-aadd-4882-b71c-95e4ef0314ed None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:11.969978 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b1d5b50b-aadd-4882-b71c-95e4ef0314ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:11.970343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe409a4-9605-4579-8d22-56022903b268 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:11.983070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1176/2338] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:11.987408 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5b50b-aadd-4882-b71c-95e4ef0314ed None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:11.990230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:11.991235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:11.991711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:11.992182 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] PATH_INFO: `/v3/projects/82a255a7fcc147f89b7302e246ae562f` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:11.994055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a255a7fcc147f89b7302e246ae562f)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:11.996125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:12.008065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5b50b-aadd-4882-b71c-95e4ef0314ed None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:12.013612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cf86d-b47c-4dea-aa05-647264202fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:12.014214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cf86d-b47c-4dea-aa05-647264202fea admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:12.014522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cf86d-b47c-4dea-aa05-647264202fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:12.014857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cf86d-b47c-4dea-aa05-647264202fea admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:12.015584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cf86d-b47c-4dea-aa05-647264202fea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:14:12.015926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cf86d-b47c-4dea-aa05-647264202fea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:12.017798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cf86d-b47c-4dea-aa05-647264202fea admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:12.040349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1177/2339] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:14:12.044856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cf86d-b47c-4dea-aa05-647264202fea admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:12.056593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cf86d-b47c-4dea-aa05-647264202fea admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:12.070750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a255a7fcc147f89b7302e246ae562f', 'request_id': 'req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.079035 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a255a7fcc147f89b7302e246ae562f', 'request_id': 'req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.088493 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a255a7fcc147f89b7302e246ae562f', 'request_id': 'req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.117896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] The token cache is being invalidate because project 82a255a7fcc147f89b7302e246ae562f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:12.118123 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.118989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.120958 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1163/2340] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:11 2022] DELETE /identity/v3/projects/82a255a7fcc147f89b7302e246ae562f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:12.125604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:12.128142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:12.134844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2592f9-57dd-4527-a893-d554d12bbdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:12.135894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2592f9-57dd-4527-a893-d554d12bbdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:12.136847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2592f9-57dd-4527-a893-d554d12bbdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:12.150975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2592f9-57dd-4527-a893-d554d12bbdb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:12.150975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2592f9-57dd-4527-a893-d554d12bbdb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:12.150975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2592f9-57dd-4527-a893-d554d12bbdb9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:12.151573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36a0c2-e977-4e4e-9fdb-36df7eb9c760 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:12.151573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:12.151573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:12.151573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:12.151908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] PATH_INFO: `/v3/users/3190248dbe3f48918846bc6a58254b74` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:12.152790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3190248dbe3f48918846bc6a58254b74)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:12.155375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:12.174385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:12.175713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1178/2341] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:14:12 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:12.180336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2592f9-57dd-4527-a893-d554d12bbdb9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:12.182535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4a2592f9-57dd-4527-a893-d554d12bbdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:12.230537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:12.246397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3190248dbe3f48918846bc6a58254b74'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.247345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3190248dbe3f48918846bc6a58254b74'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.259093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3190248dbe3f48918846bc6a58254b74'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.260361 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3190248dbe3f48918846bc6a58254b74'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.272601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2592f9-57dd-4527-a893-d554d12bbdb9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:12.275532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3190248dbe3f48918846bc6a58254b74'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.278451 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4247e1-d6d5-4e78-b4b9-904fb9b297ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:12.279075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4247e1-d6d5-4e78-b4b9-904fb9b297ee admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:12.279626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4247e1-d6d5-4e78-b4b9-904fb9b297ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:12.279626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4247e1-d6d5-4e78-b4b9-904fb9b297ee admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:12.280486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4247e1-d6d5-4e78-b4b9-904fb9b297ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:12.282815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4247e1-d6d5-4e78-b4b9-904fb9b297ee admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:12.291452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1164/2342] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:14:12 2022] DELETE /identity/v3/users/3190248dbe3f48918846bc6a58254b74 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:12.309914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1179/2343] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:14:12 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:12.314183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:12.315709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:12.388118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4276e-f548-4151-83be-18e18bc55d6b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:12.393055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d559b58-bd5b-44e1-8476-e4a19de981f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:12.393678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559b58-bd5b-44e1-8476-e4a19de981f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:12.393956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559b58-bd5b-44e1-8476-e4a19de981f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:12.394238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559b58-bd5b-44e1-8476-e4a19de981f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:12.394885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d559b58-bd5b-44e1-8476-e4a19de981f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:12.396694 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d559b58-bd5b-44e1-8476-e4a19de981f7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:12.408174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1165/2344] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:12.412445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4247e1-d6d5-4e78-b4b9-904fb9b297ee admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:12.424231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4247e1-d6d5-4e78-b4b9-904fb9b297ee admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:12.429984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc0e67-9d5a-41b6-acca-d1d6c83002e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:12.430792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc0e67-9d5a-41b6-acca-d1d6c83002e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:12.431155 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc0e67-9d5a-41b6-acca-d1d6c83002e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:12.431488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc0e67-9d5a-41b6-acca-d1d6c83002e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:12.432717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc0e67-9d5a-41b6-acca-d1d6c83002e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:12.434390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc0e67-9d5a-41b6-acca-d1d6c83002e1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:12.450403 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1180/2345] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:12.454904 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d559b58-bd5b-44e1-8476-e4a19de981f7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:12.466090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d559b58-bd5b-44e1-8476-e4a19de981f7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:12.471049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e555b5-ea95-4d04-aa85-2fe0d4d5c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:12.471848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e555b5-ea95-4d04-aa85-2fe0d4d5c60c admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:12.472126 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e555b5-ea95-4d04-aa85-2fe0d4d5c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:12.472425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e555b5-ea95-4d04-aa85-2fe0d4d5c60c admin admin] PATH_INFO: `/v3/projects/8015234b441445d597324c119498a604/users/4a197e61ac5f49e8afae5b7dd07419c0/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:12.498907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e555b5-ea95-4d04-aa85-2fe0d4d5c60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8015234b441445d597324c119498a604, user_id=4a197e61ac5f49e8afae5b7dd07419c0, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:12.501932 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e555b5-ea95-4d04-aa85-2fe0d4d5c60c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:12.524941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1166/2346] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:14:12 2022] PUT /identity/v3/projects/8015234b441445d597324c119498a604/users/4a197e61ac5f49e8afae5b7dd07419c0/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:14:12.535067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45014fbb-1ad2-4ff0-9426-e5c2f9c16429 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:12.535421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45014fbb-1ad2-4ff0-9426-e5c2f9c16429 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:12.535757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45014fbb-1ad2-4ff0-9426-e5c2f9c16429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:12.574281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-45014fbb-1ad2-4ff0-9426-e5c2f9c16429 None None] MFA Rules not processed for user `4a197e61ac5f49e8afae5b7dd07419c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:12.575622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-45014fbb-1ad2-4ff0-9426-e5c2f9c16429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:12.637409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e555b5-ea95-4d04-aa85-2fe0d4d5c60c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:12.640164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c6e555b5-ea95-4d04-aa85-2fe0d4d5c60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:12.684177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1181/2347] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:12.696899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45014fbb-1ad2-4ff0-9426-e5c2f9c16429 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:12.699039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-45014fbb-1ad2-4ff0-9426-e5c2f9c16429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:12.754338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e555b5-ea95-4d04-aa85-2fe0d4d5c60c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:12.762365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cb51f-ffe4-4a9c-a5f1-235499b00776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:12.763931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cb51f-ffe4-4a9c-a5f1-235499b00776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:12.763931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cb51f-ffe4-4a9c-a5f1-235499b00776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:12.763931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cb51f-ffe4-4a9c-a5f1-235499b00776 admin admin] PATH_INFO: `/v3/projects/97d1f2beecd242b4bb1f5aaa586cef37` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:12.765650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cb51f-ffe4-4a9c-a5f1-235499b00776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d1f2beecd242b4bb1f5aaa586cef37)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:12.767936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cb51f-ffe4-4a9c-a5f1-235499b00776 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:12.789000 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45014fbb-1ad2-4ff0-9426-e5c2f9c16429 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:12.790809 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:12.812752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041ff8a-6fbb-4d41-a011-9cc6f02f0c7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31ebbadd69da4bc6ad25b5c882962ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:12.812752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041ff8a-6fbb-4d41-a011-9cc6f02f0c7c service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:12.812752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041ff8a-6fbb-4d41-a011-9cc6f02f0c7c service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:12.812752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041ff8a-6fbb-4d41-a011-9cc6f02f0c7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:12.829400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041ff8a-6fbb-4d41-a011-9cc6f02f0c7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:12.831707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041ff8a-6fbb-4d41-a011-9cc6f02f0c7c service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:12.860224 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1182/2348] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:12.883718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-239cb51f-ffe4-4a9c-a5f1-235499b00776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d1f2beecd242b4bb1f5aaa586cef37', 'request_id': 'req-239cb51f-ffe4-4a9c-a5f1-235499b00776'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.890716 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-239cb51f-ffe4-4a9c-a5f1-235499b00776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d1f2beecd242b4bb1f5aaa586cef37', 'request_id': 'req-239cb51f-ffe4-4a9c-a5f1-235499b00776'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.901592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-239cb51f-ffe4-4a9c-a5f1-235499b00776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d1f2beecd242b4bb1f5aaa586cef37', 'request_id': 'req-239cb51f-ffe4-4a9c-a5f1-235499b00776'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.918161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-239cb51f-ffe4-4a9c-a5f1-235499b00776 admin admin] The token cache is being invalidate because project 97d1f2beecd242b4bb1f5aaa586cef37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:12.918488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-239cb51f-ffe4-4a9c-a5f1-235499b00776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.919216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-239cb51f-ffe4-4a9c-a5f1-235499b00776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:12.922150 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1167/2349] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:12 2022] DELETE /identity/v3/projects/97d1f2beecd242b4bb1f5aaa586cef37 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:12.929191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81f08f-90ff-4ef5-ac04-5643b5898f98 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:12.929539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81f08f-90ff-4ef5-ac04-5643b5898f98 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:12.929866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81f08f-90ff-4ef5-ac04-5643b5898f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:12.958186 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3f81f08f-90ff-4ef5-ac04-5643b5898f98 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:12.959881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3f81f08f-90ff-4ef5-ac04-5643b5898f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:13.010361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:13.041245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1183/2350] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:13.042940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06ca67-c65d-410f-b634-f74c6bcca66f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:13.045727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06ca67-c65d-410f-b634-f74c6bcca66f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:13.045727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06ca67-c65d-410f-b634-f74c6bcca66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:13.068421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4f06ca67-c65d-410f-b634-f74c6bcca66f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:13.068421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4f06ca67-c65d-410f-b634-f74c6bcca66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:13.081932 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1168/2351] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:13.087212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81f08f-90ff-4ef5-ac04-5643b5898f98 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:13.097839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81f08f-90ff-4ef5-ac04-5643b5898f98 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:13.104809 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb9891-298c-4214-a34b-8c9e579bcd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:13.105405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb9891-298c-4214-a34b-8c9e579bcd38 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:13.105736 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb9891-298c-4214-a34b-8c9e579bcd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:13.106087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb9891-298c-4214-a34b-8c9e579bcd38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:13.106810 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb9891-298c-4214-a34b-8c9e579bcd38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:14:13.107115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb9891-298c-4214-a34b-8c9e579bcd38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:13.108913 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb9891-298c-4214-a34b-8c9e579bcd38 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:13.122673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1184/2352] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:14:13.127093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06ca67-c65d-410f-b634-f74c6bcca66f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:13.143896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06ca67-c65d-410f-b634-f74c6bcca66f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:13.150189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9006a82-3348-49da-8cb4-b7fd3df2098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:13.150803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9006a82-3348-49da-8cb4-b7fd3df2098d admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:13.151071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9006a82-3348-49da-8cb4-b7fd3df2098d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:13.151331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9006a82-3348-49da-8cb4-b7fd3df2098d admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:13.152458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9006a82-3348-49da-8cb4-b7fd3df2098d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:13.154442 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9006a82-3348-49da-8cb4-b7fd3df2098d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:13.192681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1169/2353] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:14:13 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:13.199246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb9891-298c-4214-a34b-8c9e579bcd38 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:13.216741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb9891-298c-4214-a34b-8c9e579bcd38 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:13.281871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8266a69-ca71-4835-b9fe-1dcf6696516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:13.282487 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8266a69-ca71-4835-b9fe-1dcf6696516e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:13.282712 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8266a69-ca71-4835-b9fe-1dcf6696516e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:13.282983 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8266a69-ca71-4835-b9fe-1dcf6696516e admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:13.283653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8266a69-ca71-4835-b9fe-1dcf6696516e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:13.285840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8266a69-ca71-4835-b9fe-1dcf6696516e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:13.309863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1185/2354] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:14:13 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:13.314796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9006a82-3348-49da-8cb4-b7fd3df2098d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:13.330332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9006a82-3348-49da-8cb4-b7fd3df2098d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:13.337103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81edd8-10fa-4a41-9479-5f1140f4e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:13.337812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81edd8-10fa-4a41-9479-5f1140f4e2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:13.338193 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81edd8-10fa-4a41-9479-5f1140f4e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:13.338437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81edd8-10fa-4a41-9479-5f1140f4e2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:13.339170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81edd8-10fa-4a41-9479-5f1140f4e2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:13.341977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81edd8-10fa-4a41-9479-5f1140f4e2e7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:13.375490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1170/2355] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:13.384017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8266a69-ca71-4835-b9fe-1dcf6696516e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:13.394996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8266a69-ca71-4835-b9fe-1dcf6696516e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:13.400879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a9c25-443b-49f4-a047-0538f78e5e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:13.401490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a9c25-443b-49f4-a047-0538f78e5e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:13.402009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a9c25-443b-49f4-a047-0538f78e5e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:13.402396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a9c25-443b-49f4-a047-0538f78e5e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:13.403222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a9c25-443b-49f4-a047-0538f78e5e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:13.405284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a9c25-443b-49f4-a047-0538f78e5e20 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:13.420879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1186/2356] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:13.424932 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81edd8-10fa-4a41-9479-5f1140f4e2e7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:13.435160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81edd8-10fa-4a41-9479-5f1140f4e2e7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:13.440598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f05770-4b9d-47b2-86bd-837c9d88ba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:13.441384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f05770-4b9d-47b2-86bd-837c9d88ba1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:13.441669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f05770-4b9d-47b2-86bd-837c9d88ba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:13.441945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f05770-4b9d-47b2-86bd-837c9d88ba1f admin admin] PATH_INFO: `/v3/projects/aa18ae12de4b423a8e5b40526d53da54/users/dedcb85258e6438ea78e4e4e58f7cc3a/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:13.457224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f05770-4b9d-47b2-86bd-837c9d88ba1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa18ae12de4b423a8e5b40526d53da54, user_id=dedcb85258e6438ea78e4e4e58f7cc3a, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:13.460175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f05770-4b9d-47b2-86bd-837c9d88ba1f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:13.473123 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1171/2357] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:14:13 2022] PUT /identity/v3/projects/aa18ae12de4b423a8e5b40526d53da54/users/dedcb85258e6438ea78e4e4e58f7cc3a/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:14:13.483861 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b37e20-b179-4925-9bde-269ad946c246 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:13.484150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b37e20-b179-4925-9bde-269ad946c246 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:13.484453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b37e20-b179-4925-9bde-269ad946c246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:13.513236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-94b37e20-b179-4925-9bde-269ad946c246 None None] MFA Rules not processed for user `dedcb85258e6438ea78e4e4e58f7cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:13.514562 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-94b37e20-b179-4925-9bde-269ad946c246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:13.584709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1187/2358] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:14:13.598799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f05770-4b9d-47b2-86bd-837c9d88ba1f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:13.601158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-05f05770-4b9d-47b2-86bd-837c9d88ba1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:13.659754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f05770-4b9d-47b2-86bd-837c9d88ba1f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:13.663495 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df818fd-6503-42c2-82a8-07b6625888e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:13.664089 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df818fd-6503-42c2-82a8-07b6625888e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:13.664395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df818fd-6503-42c2-82a8-07b6625888e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:13.664665 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df818fd-6503-42c2-82a8-07b6625888e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:13.673681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df818fd-6503-42c2-82a8-07b6625888e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:13.675205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df818fd-6503-42c2-82a8-07b6625888e4 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:13.684736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1172/2359] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:13.713393 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b37e20-b179-4925-9bde-269ad946c246 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:13.760679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:13.783393 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b37e20-b179-4925-9bde-269ad946c246 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:13.788532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:13.789168 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:13.789439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:13.789702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] PATH_INFO: `/v3/users/dedcb85258e6438ea78e4e4e58f7cc3a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:13.790945 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dedcb85258e6438ea78e4e4e58f7cc3a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:13.793010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:13.848536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dedcb85258e6438ea78e4e4e58f7cc3a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:13.849247 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dedcb85258e6438ea78e4e4e58f7cc3a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:13.858726 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dedcb85258e6438ea78e4e4e58f7cc3a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:13.866313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dedcb85258e6438ea78e4e4e58f7cc3a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:13.867024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dedcb85258e6438ea78e4e4e58f7cc3a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:13.887095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1188/2360] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:14:13 2022] DELETE /identity/v3/users/dedcb85258e6438ea78e4e4e58f7cc3a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:13.891630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa016f-ad74-42ad-b9bf-2b8566400201 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:13.891916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa016f-ad74-42ad-b9bf-2b8566400201 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:13.892646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa016f-ad74-42ad-b9bf-2b8566400201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:13.915433 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-27aa016f-ad74-42ad-b9bf-2b8566400201 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:13.916655 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-27aa016f-ad74-42ad-b9bf-2b8566400201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:13.948690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:13.982797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1173/2361] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:13.993322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:13.995038 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:14.064192 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b669d-518b-44c4-bc5f-d93568136e41 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:14.067989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e67f87-619a-436e-b052-34ef7e576213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:14.069446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e67f87-619a-436e-b052-34ef7e576213 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:14.069724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e67f87-619a-436e-b052-34ef7e576213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:14.069998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e67f87-619a-436e-b052-34ef7e576213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:14.079546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e67f87-619a-436e-b052-34ef7e576213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:14.081051 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e67f87-619a-436e-b052-34ef7e576213 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:14.091090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1189/2362] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:14.485640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa016f-ad74-42ad-b9bf-2b8566400201 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:14.487084 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-27aa016f-ad74-42ad-b9bf-2b8566400201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:14.498987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa016f-ad74-42ad-b9bf-2b8566400201 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:14.503471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f799226-0f4c-4979-b293-c1db362db28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:14.504102 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799226-0f4c-4979-b293-c1db362db28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:14.504406 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799226-0f4c-4979-b293-c1db362db28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:14.504677 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799226-0f4c-4979-b293-c1db362db28e admin admin] PATH_INFO: `/v3/projects/aa18ae12de4b423a8e5b40526d53da54` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:14.505836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f799226-0f4c-4979-b293-c1db362db28e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa18ae12de4b423a8e5b40526d53da54)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:14.507787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f799226-0f4c-4979-b293-c1db362db28e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:14.566809 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2f799226-0f4c-4979-b293-c1db362db28e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa18ae12de4b423a8e5b40526d53da54', 'request_id': 'req-2f799226-0f4c-4979-b293-c1db362db28e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:14.573900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2f799226-0f4c-4979-b293-c1db362db28e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa18ae12de4b423a8e5b40526d53da54', 'request_id': 'req-2f799226-0f4c-4979-b293-c1db362db28e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:14.587306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2f799226-0f4c-4979-b293-c1db362db28e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa18ae12de4b423a8e5b40526d53da54', 'request_id': 'req-2f799226-0f4c-4979-b293-c1db362db28e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:14.600239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2f799226-0f4c-4979-b293-c1db362db28e admin admin] The token cache is being invalidate because project aa18ae12de4b423a8e5b40526d53da54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:14.600565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2f799226-0f4c-4979-b293-c1db362db28e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:14.601208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2f799226-0f4c-4979-b293-c1db362db28e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:14.603016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1174/2363] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:14 2022] DELETE /identity/v3/projects/aa18ae12de4b423a8e5b40526d53da54 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:14.608105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7f9b-896f-4b9f-867f-43afd960f5b2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:14.608421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7f9b-896f-4b9f-867f-43afd960f5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:14.608748 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7f9b-896f-4b9f-867f-43afd960f5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:14.629843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-cbcf7f9b-896f-4b9f-867f-43afd960f5b2 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:14.631843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cbcf7f9b-896f-4b9f-867f-43afd960f5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:14.695094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1190/2364] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:14.702960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ffdcb-e176-4f4c-96b0-9d059240eeb8 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:14.703236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ffdcb-e176-4f4c-96b0-9d059240eeb8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:14.703504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ffdcb-e176-4f4c-96b0-9d059240eeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:14.724428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e23ffdcb-e176-4f4c-96b0-9d059240eeb8 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:14.725623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e23ffdcb-e176-4f4c-96b0-9d059240eeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:14.733718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1175/2365] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:14.738371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf7f9b-896f-4b9f-867f-43afd960f5b2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:14.744037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:14.751114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf7f9b-896f-4b9f-867f-43afd960f5b2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:14.759114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c3208-879c-4fb3-a879-53506ffe14b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:14.760543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c3208-879c-4fb3-a879-53506ffe14b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:14.760824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c3208-879c-4fb3-a879-53506ffe14b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:14.761092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c3208-879c-4fb3-a879-53506ffe14b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:14.761752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c3208-879c-4fb3-a879-53506ffe14b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:14:14.762054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c3208-879c-4fb3-a879-53506ffe14b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:14.763777 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c3208-879c-4fb3-a879-53506ffe14b2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:14.777259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1191/2366] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:14:14.781688 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ffdcb-e176-4f4c-96b0-9d059240eeb8 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:14.793792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ffdcb-e176-4f4c-96b0-9d059240eeb8 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:14.798895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce030f-3599-475c-a3e6-c5b1da7b46c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:14.799521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce030f-3599-475c-a3e6-c5b1da7b46c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:14.799791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce030f-3599-475c-a3e6-c5b1da7b46c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:14.800058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce030f-3599-475c-a3e6-c5b1da7b46c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:14.800754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce030f-3599-475c-a3e6-c5b1da7b46c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:14.802764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce030f-3599-475c-a3e6-c5b1da7b46c1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:14.836335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1176/2367] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:14:14 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:14.840467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c3208-879c-4fb3-a879-53506ffe14b2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:14.851115 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c3208-879c-4fb3-a879-53506ffe14b2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:14.915850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d340ae5-391f-4dd5-a0d4-2be7a0895ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:14.916657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d340ae5-391f-4dd5-a0d4-2be7a0895ecb admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:14.916974 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d340ae5-391f-4dd5-a0d4-2be7a0895ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:14.917223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d340ae5-391f-4dd5-a0d4-2be7a0895ecb admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:14.918364 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d340ae5-391f-4dd5-a0d4-2be7a0895ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:14.920468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d340ae5-391f-4dd5-a0d4-2be7a0895ecb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:14.949616 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1192/2368] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:14:14 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:14.953856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce030f-3599-475c-a3e6-c5b1da7b46c1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:14.965543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce030f-3599-475c-a3e6-c5b1da7b46c1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:14.971606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46856ac-9e88-42ea-b310-35ed02172533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:14.972245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46856ac-9e88-42ea-b310-35ed02172533 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:14.972550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46856ac-9e88-42ea-b310-35ed02172533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:14.972823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46856ac-9e88-42ea-b310-35ed02172533 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:14.973474 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46856ac-9e88-42ea-b310-35ed02172533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:14.975203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46856ac-9e88-42ea-b310-35ed02172533 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:14.986925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1177/2369] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:14.991678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d340ae5-391f-4dd5-a0d4-2be7a0895ecb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:15.002782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d340ae5-391f-4dd5-a0d4-2be7a0895ecb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:15.010877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5a669-55ee-4e15-9c2a-a6747adfe746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:15.010877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5a669-55ee-4e15-9c2a-a6747adfe746 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:15.010877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5a669-55ee-4e15-9c2a-a6747adfe746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:15.010877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5a669-55ee-4e15-9c2a-a6747adfe746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:15.011345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5a669-55ee-4e15-9c2a-a6747adfe746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:15.012468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5a669-55ee-4e15-9c2a-a6747adfe746 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:15.026128 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1193/2370] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:15.030484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46856ac-9e88-42ea-b310-35ed02172533 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:15.044990 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46856ac-9e88-42ea-b310-35ed02172533 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:15.050291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975e583-ab4e-4756-b06b-e317f4a67b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:15.050976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975e583-ab4e-4756-b06b-e317f4a67b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:15.051277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975e583-ab4e-4756-b06b-e317f4a67b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:15.051550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975e583-ab4e-4756-b06b-e317f4a67b89 admin admin] PATH_INFO: `/v3/projects/339efde4833f44ddbcd7bcf6efdfb837/users/15ff6d88ced0416490039a9dd348432f/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:15.068329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975e583-ab4e-4756-b06b-e317f4a67b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339efde4833f44ddbcd7bcf6efdfb837, user_id=15ff6d88ced0416490039a9dd348432f, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:15.071227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975e583-ab4e-4756-b06b-e317f4a67b89 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:15.088426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1178/2371] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:14:15 2022] PUT /identity/v3/projects/339efde4833f44ddbcd7bcf6efdfb837/users/15ff6d88ced0416490039a9dd348432f/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:15.099912 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73a815-6049-4bbe-b971-e4d7e7aee8a4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:15.100421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73a815-6049-4bbe-b971-e4d7e7aee8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:15.100564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73a815-6049-4bbe-b971-e4d7e7aee8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:15.133495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8a73a815-6049-4bbe-b971-e4d7e7aee8a4 None None] MFA Rules not processed for user `15ff6d88ced0416490039a9dd348432f`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:15.134733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8a73a815-6049-4bbe-b971-e4d7e7aee8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:15.204067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1194/2372] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:15.215158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975e583-ab4e-4756-b06b-e317f4a67b89 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:15.217268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5975e583-ab4e-4756-b06b-e317f4a67b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:15.280319 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975e583-ab4e-4756-b06b-e317f4a67b89 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:15.284327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e9d7d-29c2-45ce-9762-7d639ef6a0f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:15.284967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e9d7d-29c2-45ce-9762-7d639ef6a0f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:15.285242 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e9d7d-29c2-45ce-9762-7d639ef6a0f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:15.285513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e9d7d-29c2-45ce-9762-7d639ef6a0f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:15.293074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:15.295646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e9d7d-29c2-45ce-9762-7d639ef6a0f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:15.297161 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e9d7d-29c2-45ce-9762-7d639ef6a0f8 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:15.307114 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1179/2373] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:18.464504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73a815-6049-4bbe-b971-e4d7e7aee8a4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:18.527263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:18.531720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73a815-6049-4bbe-b971-e4d7e7aee8a4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:18.538564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:18.539205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:18.539484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:18.539762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] PATH_INFO: `/v3/users/15ff6d88ced0416490039a9dd348432f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:18.541077 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ff6d88ced0416490039a9dd348432f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:18.543140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:18.598637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ff6d88ced0416490039a9dd348432f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:18.599311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ff6d88ced0416490039a9dd348432f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:18.610614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ff6d88ced0416490039a9dd348432f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:18.618871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ff6d88ced0416490039a9dd348432f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:18.619645 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ff6d88ced0416490039a9dd348432f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:18.639082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1195/2374] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:14:18 2022] DELETE /identity/v3/users/15ff6d88ced0416490039a9dd348432f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:18.643862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8565-7c15-4185-8acb-8493fbbdc063 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:18.644375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8565-7c15-4185-8acb-8493fbbdc063 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:18.644517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8565-7c15-4185-8acb-8493fbbdc063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:18.668697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-245d8565-7c15-4185-8acb-8493fbbdc063 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:18.669938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-245d8565-7c15-4185-8acb-8493fbbdc063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:18.743598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1180/2375] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:18.754352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:18.755976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:18.818528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4fa20-e700-4c63-ae5e-473e5114e1ab admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:18.822693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388b941-a113-49e0-965b-b661c92f68a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:18.823429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388b941-a113-49e0-965b-b661c92f68a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:18.823845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388b941-a113-49e0-965b-b661c92f68a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:18.824225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388b941-a113-49e0-965b-b661c92f68a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:18.835029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388b941-a113-49e0-965b-b661c92f68a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:18.836656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388b941-a113-49e0-965b-b661c92f68a9 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:18.846213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1196/2376] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:19.153499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d8565-7c15-4185-8acb-8493fbbdc063 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:19.155026 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-245d8565-7c15-4185-8acb-8493fbbdc063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:19.170256 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d8565-7c15-4185-8acb-8493fbbdc063 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:19.176164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8c962-0eba-426a-9f50-971e463c5be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:19.177215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8c962-0eba-426a-9f50-971e463c5be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:19.178171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8c962-0eba-426a-9f50-971e463c5be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:19.178171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8c962-0eba-426a-9f50-971e463c5be7 admin admin] PATH_INFO: `/v3/projects/339efde4833f44ddbcd7bcf6efdfb837` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:19.184644 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8c962-0eba-426a-9f50-971e463c5be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=339efde4833f44ddbcd7bcf6efdfb837)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:19.187421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8c962-0eba-426a-9f50-971e463c5be7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:19.247400 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fea8c962-0eba-426a-9f50-971e463c5be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339efde4833f44ddbcd7bcf6efdfb837', 'request_id': 'req-fea8c962-0eba-426a-9f50-971e463c5be7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:19.257222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fea8c962-0eba-426a-9f50-971e463c5be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339efde4833f44ddbcd7bcf6efdfb837', 'request_id': 'req-fea8c962-0eba-426a-9f50-971e463c5be7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:19.269928 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fea8c962-0eba-426a-9f50-971e463c5be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339efde4833f44ddbcd7bcf6efdfb837', 'request_id': 'req-fea8c962-0eba-426a-9f50-971e463c5be7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:19.283543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fea8c962-0eba-426a-9f50-971e463c5be7 admin admin] The token cache is being invalidate because project 339efde4833f44ddbcd7bcf6efdfb837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:19.283999 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fea8c962-0eba-426a-9f50-971e463c5be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:19.284572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fea8c962-0eba-426a-9f50-971e463c5be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:19.286148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1181/2377] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:19 2022] DELETE /identity/v3/projects/339efde4833f44ddbcd7bcf6efdfb837 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:19.291622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab5407-eb6a-4fe8-81f5-eef97adceec4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:19.291931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab5407-eb6a-4fe8-81f5-eef97adceec4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:19.292201 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab5407-eb6a-4fe8-81f5-eef97adceec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:19.312894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5eab5407-eb6a-4fe8-81f5-eef97adceec4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:19.314114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5eab5407-eb6a-4fe8-81f5-eef97adceec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:19.377594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1197/2378] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:19.386137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537a4b7-28f4-457e-97d4-a69329702bda None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:19.386422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537a4b7-28f4-457e-97d4-a69329702bda None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:19.386697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537a4b7-28f4-457e-97d4-a69329702bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:19.408488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c537a4b7-28f4-457e-97d4-a69329702bda None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:19.409943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c537a4b7-28f4-457e-97d4-a69329702bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:19.418559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1182/2379] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:19.422851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab5407-eb6a-4fe8-81f5-eef97adceec4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:19.432808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab5407-eb6a-4fe8-81f5-eef97adceec4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:19.437966 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b1cd8-508d-44ad-803c-55d128660bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:19.438586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1cd8-508d-44ad-803c-55d128660bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:19.438865 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1cd8-508d-44ad-803c-55d128660bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:19.439214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1cd8-508d-44ad-803c-55d128660bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:19.439960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b1cd8-508d-44ad-803c-55d128660bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:14:19.440261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b1cd8-508d-44ad-803c-55d128660bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:19.442032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b1cd8-508d-44ad-803c-55d128660bcb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:19.454566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1198/2380] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:14:19.459055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537a4b7-28f4-457e-97d4-a69329702bda None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:19.469989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537a4b7-28f4-457e-97d4-a69329702bda None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:19.474445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17d8fb-8e7b-4406-992a-c006ce47b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:19.475068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17d8fb-8e7b-4406-992a-c006ce47b7da admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:19.475344 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17d8fb-8e7b-4406-992a-c006ce47b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:19.475617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17d8fb-8e7b-4406-992a-c006ce47b7da admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:19.476274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17d8fb-8e7b-4406-992a-c006ce47b7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:19.478369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17d8fb-8e7b-4406-992a-c006ce47b7da admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:19.507935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1183/2381] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:14:19 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:19.512137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b1cd8-508d-44ad-803c-55d128660bcb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:19.522955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b1cd8-508d-44ad-803c-55d128660bcb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:19.527205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:19.588423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6f566-72f6-4cc3-af58-e88cca425acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:19.589048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6f566-72f6-4cc3-af58-e88cca425acd admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:19.589325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6f566-72f6-4cc3-af58-e88cca425acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:19.589596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6f566-72f6-4cc3-af58-e88cca425acd admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:19.590257 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6f566-72f6-4cc3-af58-e88cca425acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:19.592237 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6f566-72f6-4cc3-af58-e88cca425acd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:19.616827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1199/2382] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:14:19 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:19.621148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17d8fb-8e7b-4406-992a-c006ce47b7da admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:19.632319 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17d8fb-8e7b-4406-992a-c006ce47b7da admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:19.637634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc52654-c56c-476a-acbd-6b8b7d140f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:19.638259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc52654-c56c-476a-acbd-6b8b7d140f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:19.638537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc52654-c56c-476a-acbd-6b8b7d140f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:19.638809 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc52654-c56c-476a-acbd-6b8b7d140f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:19.639461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc52654-c56c-476a-acbd-6b8b7d140f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:19.641150 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc52654-c56c-476a-acbd-6b8b7d140f2e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:19.653362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1184/2383] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:19.657559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6f566-72f6-4cc3-af58-e88cca425acd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:19.669664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6f566-72f6-4cc3-af58-e88cca425acd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:19.675672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc077b-26b3-409f-9359-72fe064eb862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:19.676278 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc077b-26b3-409f-9359-72fe064eb862 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:19.676580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc077b-26b3-409f-9359-72fe064eb862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:19.676850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc077b-26b3-409f-9359-72fe064eb862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:19.677490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc077b-26b3-409f-9359-72fe064eb862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:19.679136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc077b-26b3-409f-9359-72fe064eb862 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:19.690424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1200/2384] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:19.694705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc52654-c56c-476a-acbd-6b8b7d140f2e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:19.706413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc52654-c56c-476a-acbd-6b8b7d140f2e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:19.712051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de323b6-2d41-4803-aff9-347024c36400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:19.712780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de323b6-2d41-4803-aff9-347024c36400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:19.713061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de323b6-2d41-4803-aff9-347024c36400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:19.713341 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de323b6-2d41-4803-aff9-347024c36400 admin admin] PATH_INFO: `/v3/projects/0304731f1da04412ad65cd5ad0b4a280/users/0fd343e0b33144919aec9bf66102ef14/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:19.729674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de323b6-2d41-4803-aff9-347024c36400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0304731f1da04412ad65cd5ad0b4a280, user_id=0fd343e0b33144919aec9bf66102ef14, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:19.732458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de323b6-2d41-4803-aff9-347024c36400 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:19.759728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1185/2385] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:14:19 2022] PUT /identity/v3/projects/0304731f1da04412ad65cd5ad0b4a280/users/0fd343e0b33144919aec9bf66102ef14/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:19.761046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb469c-9173-4b20-876c-ba1b5855a88a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:19.761329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb469c-9173-4b20-876c-ba1b5855a88a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:19.761598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb469c-9173-4b20-876c-ba1b5855a88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:19.800490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ceeb469c-9173-4b20-876c-ba1b5855a88a None None] MFA Rules not processed for user `0fd343e0b33144919aec9bf66102ef14`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:19.800490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ceeb469c-9173-4b20-876c-ba1b5855a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:19.867684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1201/2386] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:19.878940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de323b6-2d41-4803-aff9-347024c36400 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:19.881026 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7de323b6-2d41-4803-aff9-347024c36400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:19.903670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:19.959252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de323b6-2d41-4803-aff9-347024c36400 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:19.964042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d17d7-678a-4867-83b2-4b77a8e7efb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:19.964705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d17d7-678a-4867-83b2-4b77a8e7efb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:19.964984 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d17d7-678a-4867-83b2-4b77a8e7efb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:19.965257 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d17d7-678a-4867-83b2-4b77a8e7efb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:19.974404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d17d7-678a-4867-83b2-4b77a8e7efb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:19.975889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d17d7-678a-4867-83b2-4b77a8e7efb9 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:19.985520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1186/2387] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:23.303740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f9b30-106e-4b7e-8865-fdf379766405 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:23.304246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f9b30-106e-4b7e-8865-fdf379766405 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:23.304401 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f9b30-106e-4b7e-8865-fdf379766405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:23.329527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bf7f9b30-106e-4b7e-8865-fdf379766405 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:23.330853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bf7f9b30-106e-4b7e-8865-fdf379766405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:23.338730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1789-1907-48a8-b740-33202a8ab41a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:23.339253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1789-1907-48a8-b740-33202a8ab41a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:23.339338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1789-1907-48a8-b740-33202a8ab41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:23.358440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1b8d1789-1907-48a8-b740-33202a8ab41a None None] MFA Rules not processed for user `d1dd5768f5c640ac9302d0250f76f5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:23.359664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1b8d1789-1907-48a8-b740-33202a8ab41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:23.390195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1202/2388] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:23.416537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1187/2389] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:23.434681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f9b30-106e-4b7e-8865-fdf379766405 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:23.436210 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bf7f9b30-106e-4b7e-8865-fdf379766405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:23.457980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:23.508480 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f9b30-106e-4b7e-8865-fdf379766405 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:23.514512 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1cc8a-727a-4e07-b7a2-9c13229c58c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:23.515132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1cc8a-727a-4e07-b7a2-9c13229c58c0 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:23.515409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1cc8a-727a-4e07-b7a2-9c13229c58c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:23.515677 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1cc8a-727a-4e07-b7a2-9c13229c58c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:23.524313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1cc8a-727a-4e07-b7a2-9c13229c58c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:23.526190 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1cc8a-727a-4e07-b7a2-9c13229c58c0 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:23.534096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1203/2390] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:14:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:14:30.477608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1789-1907-48a8-b740-33202a8ab41a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:30.479625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1b8d1789-1907-48a8-b740-33202a8ab41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:30.565902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1789-1907-48a8-b740-33202a8ab41a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:30.571455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:30.572808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:30.573189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:30.573625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] PATH_INFO: `/v3/users/c7147279bc9542968562af5d0c324104` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:30.575026 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7147279bc9542968562af5d0c324104)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:30.577368 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:30.654273 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7147279bc9542968562af5d0c324104'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:30.655458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7147279bc9542968562af5d0c324104'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:30.664097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7147279bc9542968562af5d0c324104'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:30.664989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7147279bc9542968562af5d0c324104'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:30.673166 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:30.680570 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7147279bc9542968562af5d0c324104'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:30.700618 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1188/2391] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:14:30 2022] DELETE /identity/v3/users/c7147279bc9542968562af5d0c324104 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:30.705899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795711a6-ac7d-4e01-81f8-9794f275874e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:30.706432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795711a6-ac7d-4e01-81f8-9794f275874e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:30.706432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795711a6-ac7d-4e01-81f8-9794f275874e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:30.725818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-795711a6-ac7d-4e01-81f8-9794f275874e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:30.727163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-795711a6-ac7d-4e01-81f8-9794f275874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:30.768224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:30.770384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:30.849903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1204/2392] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:30.862078 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795711a6-ac7d-4e01-81f8-9794f275874e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:30.864331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-795711a6-ac7d-4e01-81f8-9794f275874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:30.884241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309ffa-9c35-46fa-bce9-74d874fd6eb4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:30.890640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:30.891418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:30.891796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:30.892169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] PATH_INFO: `/v3/users/0fd343e0b33144919aec9bf66102ef14` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:30.893736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd343e0b33144919aec9bf66102ef14)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:30.896022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:30.947583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795711a6-ac7d-4e01-81f8-9794f275874e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:30.953338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a932c-2ec9-4dd2-a0bd-44018b57e4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:30.954174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a932c-2ec9-4dd2-a0bd-44018b57e4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:30.954477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a932c-2ec9-4dd2-a0bd-44018b57e4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:30.954844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a932c-2ec9-4dd2-a0bd-44018b57e4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:30.972331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a932c-2ec9-4dd2-a0bd-44018b57e4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:30.974118 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a932c-2ec9-4dd2-a0bd-44018b57e4b6 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:30.987979 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1205/2393] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:31.001901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd343e0b33144919aec9bf66102ef14'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:31.002622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd343e0b33144919aec9bf66102ef14'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:31.017005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd343e0b33144919aec9bf66102ef14'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:31.021030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd343e0b33144919aec9bf66102ef14'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:31.046900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd343e0b33144919aec9bf66102ef14'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:31.086507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1189/2394] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:14:30 2022] DELETE /identity/v3/users/0fd343e0b33144919aec9bf66102ef14 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:14:31.088986 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dbf48-7117-4c8f-aa23-42a00307eb69 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:31.089710 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dbf48-7117-4c8f-aa23-42a00307eb69 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:31.089908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dbf48-7117-4c8f-aa23-42a00307eb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:31.129141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b25dbf48-7117-4c8f-aa23-42a00307eb69 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:31.132806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b25dbf48-7117-4c8f-aa23-42a00307eb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:31.311463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:31.347792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1206/2395] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:14:31.366470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:31.368774 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:31.464540 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dbf48-7117-4c8f-aa23-42a00307eb69 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:31.467952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b25dbf48-7117-4c8f-aa23-42a00307eb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:31.488353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ec5c8-d0ba-4251-b1b9-0814b4a0e6b6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:31.493311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dbf48-7117-4c8f-aa23-42a00307eb69 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:31.493540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828a5c6-c977-414b-a620-0ec915380d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:31.494190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828a5c6-c977-414b-a620-0ec915380d21 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:31.494464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828a5c6-c977-414b-a620-0ec915380d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:31.494833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828a5c6-c977-414b-a620-0ec915380d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:31.507364 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3090da-a41b-4c22-8a16-27408e3e87a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:31.509504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3090da-a41b-4c22-8a16-27408e3e87a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:31.510328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3090da-a41b-4c22-8a16-27408e3e87a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:31.511790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3090da-a41b-4c22-8a16-27408e3e87a8 admin admin] PATH_INFO: `/v3/projects/78570e9e0264436fbd98de0273e01a8a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:31.512992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828a5c6-c977-414b-a620-0ec915380d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:31.515077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828a5c6-c977-414b-a620-0ec915380d21 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:31.515594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3090da-a41b-4c22-8a16-27408e3e87a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78570e9e0264436fbd98de0273e01a8a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:31.519351 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3090da-a41b-4c22-8a16-27408e3e87a8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:31.530191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1190/2396] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:14:31.638488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0b3090da-a41b-4c22-8a16-27408e3e87a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78570e9e0264436fbd98de0273e01a8a', 'request_id': 'req-0b3090da-a41b-4c22-8a16-27408e3e87a8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:31.650501 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0b3090da-a41b-4c22-8a16-27408e3e87a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78570e9e0264436fbd98de0273e01a8a', 'request_id': 'req-0b3090da-a41b-4c22-8a16-27408e3e87a8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:31.667828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0b3090da-a41b-4c22-8a16-27408e3e87a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78570e9e0264436fbd98de0273e01a8a', 'request_id': 'req-0b3090da-a41b-4c22-8a16-27408e3e87a8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:31.697621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0b3090da-a41b-4c22-8a16-27408e3e87a8 admin admin] The token cache is being invalidate because project 78570e9e0264436fbd98de0273e01a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:31.698169 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0b3090da-a41b-4c22-8a16-27408e3e87a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:31.699057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0b3090da-a41b-4c22-8a16-27408e3e87a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:31.701174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1207/2397] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:31 2022] DELETE /identity/v3/projects/78570e9e0264436fbd98de0273e01a8a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:14:31.707781 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64a71e-22a0-4a05-a60e-c3cd07bb9341 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:31.707967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64a71e-22a0-4a05-a60e-c3cd07bb9341 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:31.708106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64a71e-22a0-4a05-a60e-c3cd07bb9341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:31.719931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:31.732842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-fe64a71e-22a0-4a05-a60e-c3cd07bb9341 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:31.734810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fe64a71e-22a0-4a05-a60e-c3cd07bb9341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:31.856313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1191/2398] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:31.856817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce62e4d-5d2c-4f67-8303-459d40147a09 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:31.857310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce62e4d-5d2c-4f67-8303-459d40147a09 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:31.857417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce62e4d-5d2c-4f67-8303-459d40147a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:31.911276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5ce62e4d-5d2c-4f67-8303-459d40147a09 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:31.915445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5ce62e4d-5d2c-4f67-8303-459d40147a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:31.937660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1208/2399] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:14:31.939204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64a71e-22a0-4a05-a60e-c3cd07bb9341 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:31.954699 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64a71e-22a0-4a05-a60e-c3cd07bb9341 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:31.968995 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575d738-b0b8-4eae-af4d-a42ed413f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:31.969445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575d738-b0b8-4eae-af4d-a42ed413f187 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:31.969718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575d738-b0b8-4eae-af4d-a42ed413f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:31.970003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575d738-b0b8-4eae-af4d-a42ed413f187 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:31.971966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575d738-b0b8-4eae-af4d-a42ed413f187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:14:31.971966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575d738-b0b8-4eae-af4d-a42ed413f187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:31.984592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575d738-b0b8-4eae-af4d-a42ed413f187 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:32.027368 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1192/2400] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:14:32.029054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce62e4d-5d2c-4f67-8303-459d40147a09 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:32.051265 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce62e4d-5d2c-4f67-8303-459d40147a09 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:32.058529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a04969-7346-4860-8a45-bcd82368fbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:32.059287 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a04969-7346-4860-8a45-bcd82368fbbc admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:32.059688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a04969-7346-4860-8a45-bcd82368fbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:32.060049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a04969-7346-4860-8a45-bcd82368fbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:32.060852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a04969-7346-4860-8a45-bcd82368fbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:32.065359 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a04969-7346-4860-8a45-bcd82368fbbc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:32.118284 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575d738-b0b8-4eae-af4d-a42ed413f187 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:32.120502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2575d738-b0b8-4eae-af4d-a42ed413f187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:32.150939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1209/2401] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:14:32 2022] POST /identity/v3/projects => generated 399 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:32.152906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a04969-7346-4860-8a45-bcd82368fbbc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:32.160538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575d738-b0b8-4eae-af4d-a42ed413f187 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:32.234271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a04969-7346-4860-8a45-bcd82368fbbc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:32.239692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f82984-c5a7-4d33-aec9-2abf4bc620ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:32.240673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f82984-c5a7-4d33-aec9-2abf4bc620ee admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:32.241053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f82984-c5a7-4d33-aec9-2abf4bc620ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:32.241427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f82984-c5a7-4d33-aec9-2abf4bc620ee admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:32.242186 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f82984-c5a7-4d33-aec9-2abf4bc620ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:32.244590 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f82984-c5a7-4d33-aec9-2abf4bc620ee admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:32.278082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1210/2402] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:14:32 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:32.286610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f82984-c5a7-4d33-aec9-2abf4bc620ee admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:32.288179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea51fb-7a68-45e1-a781-67a8795a90a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:32.289720 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea51fb-7a68-45e1-a781-67a8795a90a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:32.290582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea51fb-7a68-45e1-a781-67a8795a90a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:32.291136 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea51fb-7a68-45e1-a781-67a8795a90a2 admin admin] PATH_INFO: `/v3/projects/0304731f1da04412ad65cd5ad0b4a280` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:32.292866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea51fb-7a68-45e1-a781-67a8795a90a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0304731f1da04412ad65cd5ad0b4a280)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:32.297537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea51fb-7a68-45e1-a781-67a8795a90a2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:32.299781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f82984-c5a7-4d33-aec9-2abf4bc620ee admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:32.305165 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540672d-eb07-40b0-acdd-0ea0d7bbce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:32.305866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540672d-eb07-40b0-acdd-0ea0d7bbce16 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:32.306211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540672d-eb07-40b0-acdd-0ea0d7bbce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:32.306548 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540672d-eb07-40b0-acdd-0ea0d7bbce16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:32.307322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540672d-eb07-40b0-acdd-0ea0d7bbce16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:32.309677 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540672d-eb07-40b0-acdd-0ea0d7bbce16 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:32.328075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1211/2403] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:32.332941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540672d-eb07-40b0-acdd-0ea0d7bbce16 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:32.345311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540672d-eb07-40b0-acdd-0ea0d7bbce16 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:32.353910 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e3184-da2f-4a3d-800d-3b090d6a2ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:32.354894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e3184-da2f-4a3d-800d-3b090d6a2ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:32.355249 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e3184-da2f-4a3d-800d-3b090d6a2ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:32.355717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e3184-da2f-4a3d-800d-3b090d6a2ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:32.357322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e3184-da2f-4a3d-800d-3b090d6a2ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:32.359455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e3184-da2f-4a3d-800d-3b090d6a2ab8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:32.371717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4dea51fb-7a68-45e1-a781-67a8795a90a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0304731f1da04412ad65cd5ad0b4a280', 'request_id': 'req-4dea51fb-7a68-45e1-a781-67a8795a90a2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:32.372900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1212/2404] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:32.378895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e3184-da2f-4a3d-800d-3b090d6a2ab8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:32.382028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4dea51fb-7a68-45e1-a781-67a8795a90a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0304731f1da04412ad65cd5ad0b4a280', 'request_id': 'req-4dea51fb-7a68-45e1-a781-67a8795a90a2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:32.390325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e3184-da2f-4a3d-800d-3b090d6a2ab8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:32.405014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:32.410460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4dea51fb-7a68-45e1-a781-67a8795a90a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0304731f1da04412ad65cd5ad0b4a280', 'request_id': 'req-4dea51fb-7a68-45e1-a781-67a8795a90a2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:32.443549 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4dea51fb-7a68-45e1-a781-67a8795a90a2 admin admin] The token cache is being invalidate because project 0304731f1da04412ad65cd5ad0b4a280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:32.445680 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4dea51fb-7a68-45e1-a781-67a8795a90a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:32.448709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4dea51fb-7a68-45e1-a781-67a8795a90a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:32.452709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1193/2405] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:32 2022] DELETE /identity/v3/projects/0304731f1da04412ad65cd5ad0b4a280 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:32.492915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0118f-f8bf-48d4-9c57-92b79f668e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:32.493700 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0118f-f8bf-48d4-9c57-92b79f668e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:32.494080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0118f-f8bf-48d4-9c57-92b79f668e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:32.494453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0118f-f8bf-48d4-9c57-92b79f668e9e admin admin] PATH_INFO: `/v3/projects/ebe3ddb10d7944cba13bc7f6fd89a723/users/88911fb2a70c405eadeae43b18c97545/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:32.515874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0118f-f8bf-48d4-9c57-92b79f668e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe3ddb10d7944cba13bc7f6fd89a723, user_id=88911fb2a70c405eadeae43b18c97545, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:32.520260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0118f-f8bf-48d4-9c57-92b79f668e9e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:32.559033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1213/2406] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:14:32 2022] PUT /identity/v3/projects/ebe3ddb10d7944cba13bc7f6fd89a723/users/88911fb2a70c405eadeae43b18c97545/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:32.562648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c240f8-e24b-44b1-8d48-e48403ac51cd None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:32.563655 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c240f8-e24b-44b1-8d48-e48403ac51cd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:32.564125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c240f8-e24b-44b1-8d48-e48403ac51cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:32.680812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a8c240f8-e24b-44b1-8d48-e48403ac51cd None None] MFA Rules not processed for user `88911fb2a70c405eadeae43b18c97545`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:32.682604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a8c240f8-e24b-44b1-8d48-e48403ac51cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:32.723764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:32.893038 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1194/2407] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:32.906345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0118f-f8bf-48d4-9c57-92b79f668e9e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:32.908581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-28a0118f-f8bf-48d4-9c57-92b79f668e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:32.988627 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0118f-f8bf-48d4-9c57-92b79f668e9e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:32.992787 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ed486-8f8f-4632-8aa6-2b02e50b9788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:32.993522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed486-8f8f-4632-8aa6-2b02e50b9788 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:32.993928 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed486-8f8f-4632-8aa6-2b02e50b9788 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:32.994287 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed486-8f8f-4632-8aa6-2b02e50b9788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:33.023732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ed486-8f8f-4632-8aa6-2b02e50b9788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:33.025361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ed486-8f8f-4632-8aa6-2b02e50b9788 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:33.054190 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1214/2408] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:40.504736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c240f8-e24b-44b1-8d48-e48403ac51cd None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:40.507140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a8c240f8-e24b-44b1-8d48-e48403ac51cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:40.592762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c240f8-e24b-44b1-8d48-e48403ac51cd None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:40.598443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:40.599090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:40.599371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:40.599926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] PATH_INFO: `/v3/users/88911fb2a70c405eadeae43b18c97545` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:40.601341 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88911fb2a70c405eadeae43b18c97545)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:40.603365 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:40.680369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88911fb2a70c405eadeae43b18c97545'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:40.681857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88911fb2a70c405eadeae43b18c97545'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:40.694632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88911fb2a70c405eadeae43b18c97545'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:40.696187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88911fb2a70c405eadeae43b18c97545'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:40.717448 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88911fb2a70c405eadeae43b18c97545'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:40.746809 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1195/2409] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:14:40 2022] DELETE /identity/v3/users/88911fb2a70c405eadeae43b18c97545 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:40.751710 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee93fe8-6fba-42ce-9de7-8fd2c61e1b61 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:40.752456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee93fe8-6fba-42ce-9de7-8fd2c61e1b61 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:40.752456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee93fe8-6fba-42ce-9de7-8fd2c61e1b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:40.804311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5ee93fe8-6fba-42ce-9de7-8fd2c61e1b61 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:40.805645 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5ee93fe8-6fba-42ce-9de7-8fd2c61e1b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:40.904825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1215/2410] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:40.916369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:40.918411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:40.964084 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:41.000367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4e575-7366-4afa-8f47-7013903f9423 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:41.004639 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc902cb-b1a5-4063-9fc8-7b3af8f42a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:41.005438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc902cb-b1a5-4063-9fc8-7b3af8f42a46 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:41.005720 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc902cb-b1a5-4063-9fc8-7b3af8f42a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:41.005985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc902cb-b1a5-4063-9fc8-7b3af8f42a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:41.018405 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc902cb-b1a5-4063-9fc8-7b3af8f42a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:41.020079 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc902cb-b1a5-4063-9fc8-7b3af8f42a46 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:41.036329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1196/2411] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:41.388259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee93fe8-6fba-42ce-9de7-8fd2c61e1b61 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:41.390504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5ee93fe8-6fba-42ce-9de7-8fd2c61e1b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:41.407475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee93fe8-6fba-42ce-9de7-8fd2c61e1b61 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:41.413704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:41.414521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:41.414751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:41.415066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] PATH_INFO: `/v3/projects/ebe3ddb10d7944cba13bc7f6fd89a723` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:41.417349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe3ddb10d7944cba13bc7f6fd89a723)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:41.422368 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:41.478826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:41.500450 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe3ddb10d7944cba13bc7f6fd89a723', 'request_id': 'req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:41.508396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe3ddb10d7944cba13bc7f6fd89a723', 'request_id': 'req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:41.515598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe3ddb10d7944cba13bc7f6fd89a723', 'request_id': 'req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:41.531580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] The token cache is being invalidate because project ebe3ddb10d7944cba13bc7f6fd89a723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:41.531991 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:41.533407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:41.544338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1216/2412] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:41 2022] DELETE /identity/v3/projects/ebe3ddb10d7944cba13bc7f6fd89a723 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:44.430347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec36321-7a3f-4d10-b0ca-0f1a9ac5b7a6 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:44.430840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec36321-7a3f-4d10-b0ca-0f1a9ac5b7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:44.430946 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec36321-7a3f-4d10-b0ca-0f1a9ac5b7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:44.451089 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9ec36321-7a3f-4d10-b0ca-0f1a9ac5b7a6 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:44.452885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9ec36321-7a3f-4d10-b0ca-0f1a9ac5b7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:44.515469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1197/2413] 10.222.0.25 () {58 vars in 967 bytes} [Tue Sep 6 01:14:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:44.528682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:44.530322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:44.604457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5e28a-0971-4ad9-9e6d-cdcff2ffb6d2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:44.610662 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bccb3-e318-4eba-aaae-d7db6056af41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:44.611277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bccb3-e318-4eba-aaae-d7db6056af41 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:44.611551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bccb3-e318-4eba-aaae-d7db6056af41 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:44.611821 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bccb3-e318-4eba-aaae-d7db6056af41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:44.621102 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bccb3-e318-4eba-aaae-d7db6056af41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:44.622798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bccb3-e318-4eba-aaae-d7db6056af41 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:44.631348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1217/2414] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:14:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:14:46.673721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391e275-186c-40de-af73-0cf8bd73ed83 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:46.674291 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391e275-186c-40de-af73-0cf8bd73ed83 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:46.674498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391e275-186c-40de-af73-0cf8bd73ed83 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:46.675897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1198/2415] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 6 01:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:14:46.692410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadebdcd-c5fc-4b1c-8592-edfbc2c1c5f3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:46.692916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadebdcd-c5fc-4b1c-8592-edfbc2c1c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:46.692916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadebdcd-c5fc-4b1c-8592-edfbc2c1c5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:46.714976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-dadebdcd-c5fc-4b1c-8592-edfbc2c1c5f3 None None] MFA Rules not processed for user `1823402195ab4e89aa865967afc62b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:46.716216 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dadebdcd-c5fc-4b1c-8592-edfbc2c1c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:46.788309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1218/2416] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 6 01:14:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:46.792598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391e275-186c-40de-af73-0cf8bd73ed83 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:46.794292 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3391e275-186c-40de-af73-0cf8bd73ed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:46.816798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadebdcd-c5fc-4b1c-8592-edfbc2c1c5f3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:46.818419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dadebdcd-c5fc-4b1c-8592-edfbc2c1c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:46.842328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadebdcd-c5fc-4b1c-8592-edfbc2c1c5f3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:46.850931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35cde9-6590-44d9-a1fa-1bd095322cea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:46.851559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35cde9-6590-44d9-a1fa-1bd095322cea service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:46.851831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35cde9-6590-44d9-a1fa-1bd095322cea service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:46.852110 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35cde9-6590-44d9-a1fa-1bd095322cea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:46.862834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35cde9-6590-44d9-a1fa-1bd095322cea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:46.864894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35cde9-6590-44d9-a1fa-1bd095322cea service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:46.870116 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391e275-186c-40de-af73-0cf8bd73ed83 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:46.875880 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1219/2417] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:46.878533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:46.879159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:46.879437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:46.879712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] PATH_INFO: `/v3/users/05a9bc165e1046ebbba3ab0aa4432b3d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:46.881609 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a9bc165e1046ebbba3ab0aa4432b3d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:46.883180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:46.956616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a9bc165e1046ebbba3ab0aa4432b3d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:46.956616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a9bc165e1046ebbba3ab0aa4432b3d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:46.961406 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a9bc165e1046ebbba3ab0aa4432b3d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:46.962076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a9bc165e1046ebbba3ab0aa4432b3d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:46.976657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a9bc165e1046ebbba3ab0aa4432b3d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:46.987526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:46.997233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1199/2418] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:14:46 2022] DELETE /identity/v3/users/05a9bc165e1046ebbba3ab0aa4432b3d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:47.201960 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35cde9-6590-44d9-a1fa-1bd095322cea service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:47.216623 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35cde9-6590-44d9-a1fa-1bd095322cea service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:47.263012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:47.288695 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:47.289494 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:47.289771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:47.290044 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690 admin admin] PATH_INFO: `/v3/projects/aa66e7a7731d4f1aaedd2822204b0bff` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:47.291187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa66e7a7731d4f1aaedd2822204b0bff)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:47.293241 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:47.342479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa66e7a7731d4f1aaedd2822204b0bff', 'request_id': 'req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:47.348389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa66e7a7731d4f1aaedd2822204b0bff', 'request_id': 'req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:47.354927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa66e7a7731d4f1aaedd2822204b0bff', 'request_id': 'req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:47.369876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690 admin admin] The token cache is being invalidate because project aa66e7a7731d4f1aaedd2822204b0bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:47.370177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:47.370805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4b9d2a92-edf3-4bcd-9876-dcaa6b533690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:47.372386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1220/2419] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:47 2022] DELETE /identity/v3/projects/aa66e7a7731d4f1aaedd2822204b0bff => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:49.239908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:49.241648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:49.261596 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e24bf-6225-4b48-8e2b-7f9a35f777ba admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:49.341407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:49.341964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:49.342283 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:49.342630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] PATH_INFO: `/v3/users/4a197e61ac5f49e8afae5b7dd07419c0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:49.344320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a197e61ac5f49e8afae5b7dd07419c0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:49.346343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:49.410032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a197e61ac5f49e8afae5b7dd07419c0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:49.410694 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a197e61ac5f49e8afae5b7dd07419c0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:49.417632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a197e61ac5f49e8afae5b7dd07419c0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:49.418366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a197e61ac5f49e8afae5b7dd07419c0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:49.431062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a197e61ac5f49e8afae5b7dd07419c0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:49.448867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1200/2420] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:14:49 2022] DELETE /identity/v3/users/4a197e61ac5f49e8afae5b7dd07419c0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:49.453876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195bf3-c9ee-4cb0-9ed7-c90c8230de79 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:49.454448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195bf3-c9ee-4cb0-9ed7-c90c8230de79 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:49.454448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195bf3-c9ee-4cb0-9ed7-c90c8230de79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:49.479513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2d195bf3-c9ee-4cb0-9ed7-c90c8230de79 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:49.480770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2d195bf3-c9ee-4cb0-9ed7-c90c8230de79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:49.574511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1221/2421] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:49.587244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:49.588797 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:49.661833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d9429-b865-435d-984f-31ed0d17c34d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:49.665805 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5a9fc-f502-4198-a5fa-da64241491f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:49.666413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5a9fc-f502-4198-a5fa-da64241491f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:49.666682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5a9fc-f502-4198-a5fa-da64241491f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:49.667215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5a9fc-f502-4198-a5fa-da64241491f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:49.679002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5a9fc-f502-4198-a5fa-da64241491f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:49.680818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5a9fc-f502-4198-a5fa-da64241491f8 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:49.694208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1201/2422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:14:49.999990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d195bf3-c9ee-4cb0-9ed7-c90c8230de79 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:50.001741 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2d195bf3-c9ee-4cb0-9ed7-c90c8230de79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:50.022467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d195bf3-c9ee-4cb0-9ed7-c90c8230de79 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:50.027422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477831fd-8037-40ce-ab7e-ddb4207eeb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:50.028093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477831fd-8037-40ce-ab7e-ddb4207eeb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:50.028636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477831fd-8037-40ce-ab7e-ddb4207eeb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:50.028915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477831fd-8037-40ce-ab7e-ddb4207eeb41 admin admin] PATH_INFO: `/v3/projects/8015234b441445d597324c119498a604` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:50.030049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477831fd-8037-40ce-ab7e-ddb4207eeb41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8015234b441445d597324c119498a604)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:50.032883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477831fd-8037-40ce-ab7e-ddb4207eeb41 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:50.092999 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-477831fd-8037-40ce-ab7e-ddb4207eeb41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8015234b441445d597324c119498a604', 'request_id': 'req-477831fd-8037-40ce-ab7e-ddb4207eeb41'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:50.098656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-477831fd-8037-40ce-ab7e-ddb4207eeb41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8015234b441445d597324c119498a604', 'request_id': 'req-477831fd-8037-40ce-ab7e-ddb4207eeb41'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:50.104967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-477831fd-8037-40ce-ab7e-ddb4207eeb41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8015234b441445d597324c119498a604', 'request_id': 'req-477831fd-8037-40ce-ab7e-ddb4207eeb41'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:50.106794 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:50.119643 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-477831fd-8037-40ce-ab7e-ddb4207eeb41 admin admin] The token cache is being invalidate because project 8015234b441445d597324c119498a604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:14:50.119923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-477831fd-8037-40ce-ab7e-ddb4207eeb41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:50.120587 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-477831fd-8037-40ce-ab7e-ddb4207eeb41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:14:50.122105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1222/2423] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:14:49 2022] DELETE /identity/v3/projects/8015234b441445d597324c119498a604 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:50.127407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8ba18-aadf-4a7f-b8b8-37ba5fce90d1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:50.127685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8ba18-aadf-4a7f-b8b8-37ba5fce90d1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:50.127959 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8ba18-aadf-4a7f-b8b8-37ba5fce90d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:50.148114 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-40b8ba18-aadf-4a7f-b8b8-37ba5fce90d1 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:50.149352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-40b8ba18-aadf-4a7f-b8b8-37ba5fce90d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:50.163632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:50.220894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1202/2424] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:50.230198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dc549-df76-496b-b35c-601a03fc315d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:50.230479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dc549-df76-496b-b35c-601a03fc315d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:50.230753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dc549-df76-496b-b35c-601a03fc315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:50.251421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ba7dc549-df76-496b-b35c-601a03fc315d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:50.252729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ba7dc549-df76-496b-b35c-601a03fc315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:50.265603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1223/2425] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:14:50.272022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8ba18-aadf-4a7f-b8b8-37ba5fce90d1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:50.282505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8ba18-aadf-4a7f-b8b8-37ba5fce90d1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:50.288179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533dc5d-f318-4fee-9c37-fb53f8c21f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:50.288820 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533dc5d-f318-4fee-9c37-fb53f8c21f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:50.289098 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533dc5d-f318-4fee-9c37-fb53f8c21f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:50.289343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533dc5d-f318-4fee-9c37-fb53f8c21f83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:50.290008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533dc5d-f318-4fee-9c37-fb53f8c21f83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:14:50.290280 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533dc5d-f318-4fee-9c37-fb53f8c21f83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:50.291967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533dc5d-f318-4fee-9c37-fb53f8c21f83 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:50.304359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1203/2426] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:14:50.308820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dc549-df76-496b-b35c-601a03fc315d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:50.318964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dc549-df76-496b-b35c-601a03fc315d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:50.325003 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff1347-3b6b-4ec6-9f68-9e9c2df7914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:50.325636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff1347-3b6b-4ec6-9f68-9e9c2df7914c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:50.325908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff1347-3b6b-4ec6-9f68-9e9c2df7914c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:50.326174 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff1347-3b6b-4ec6-9f68-9e9c2df7914c admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:50.326806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff1347-3b6b-4ec6-9f68-9e9c2df7914c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:50.329113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff1347-3b6b-4ec6-9f68-9e9c2df7914c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:50.367528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1224/2427] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:14:50 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:50.371586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533dc5d-f318-4fee-9c37-fb53f8c21f83 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:50.382632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533dc5d-f318-4fee-9c37-fb53f8c21f83 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:50.444923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9631a-960b-4497-a4bb-9c40ff95f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:50.445541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9631a-960b-4497-a4bb-9c40ff95f09d admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:50.445819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9631a-960b-4497-a4bb-9c40ff95f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:50.446090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9631a-960b-4497-a4bb-9c40ff95f09d admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:50.446713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9631a-960b-4497-a4bb-9c40ff95f09d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:50.448725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9631a-960b-4497-a4bb-9c40ff95f09d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:50.472484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1204/2428] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:14:50 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:14:50.478339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff1347-3b6b-4ec6-9f68-9e9c2df7914c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:50.490063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff1347-3b6b-4ec6-9f68-9e9c2df7914c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:50.495763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f0c35-cd96-45c4-9308-b48693a83d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:50.496399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f0c35-cd96-45c4-9308-b48693a83d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:50.496672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f0c35-cd96-45c4-9308-b48693a83d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:50.496936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f0c35-cd96-45c4-9308-b48693a83d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:50.497572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f0c35-cd96-45c4-9308-b48693a83d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:50.499233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f0c35-cd96-45c4-9308-b48693a83d5b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:50.510266 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1225/2429] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:14:50.515294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9631a-960b-4497-a4bb-9c40ff95f09d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:50.532682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9631a-960b-4497-a4bb-9c40ff95f09d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:50.538986 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b836e-9c5d-4a6c-b198-13f64e7173a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:50.539593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b836e-9c5d-4a6c-b198-13f64e7173a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:50.539869 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b836e-9c5d-4a6c-b198-13f64e7173a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:50.540169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b836e-9c5d-4a6c-b198-13f64e7173a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:50.540862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b836e-9c5d-4a6c-b198-13f64e7173a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:50.542577 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b836e-9c5d-4a6c-b198-13f64e7173a5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:50.555333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1205/2430] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:14:50.559817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f0c35-cd96-45c4-9308-b48693a83d5b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:50.570987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f0c35-cd96-45c4-9308-b48693a83d5b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:50.576802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20fa96-2d5b-4ad8-b691-79e38a0154e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:50.577494 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20fa96-2d5b-4ad8-b691-79e38a0154e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:50.578331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20fa96-2d5b-4ad8-b691-79e38a0154e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:50.578605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20fa96-2d5b-4ad8-b691-79e38a0154e7 admin admin] PATH_INFO: `/v3/projects/1dcf39723f564681baaa80f5e0544458/users/8109bda5ae794f94af7e6a412c04d66f/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:50.596114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20fa96-2d5b-4ad8-b691-79e38a0154e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dcf39723f564681baaa80f5e0544458, user_id=8109bda5ae794f94af7e6a412c04d66f, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:50.598889 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20fa96-2d5b-4ad8-b691-79e38a0154e7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:50.615229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1226/2431] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:14:50 2022] PUT /identity/v3/projects/1dcf39723f564681baaa80f5e0544458/users/8109bda5ae794f94af7e6a412c04d66f/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:14:50.686093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569b058-241f-4475-884e-ec4e776fdbc8 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:50.686298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569b058-241f-4475-884e-ec4e776fdbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:50.686508 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569b058-241f-4475-884e-ec4e776fdbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:50.720518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9569b058-241f-4475-884e-ec4e776fdbc8 None None] MFA Rules not processed for user `8109bda5ae794f94af7e6a412c04d66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:14:50.721745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9569b058-241f-4475-884e-ec4e776fdbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:50.803103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1206/2432] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:14:50.815142 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20fa96-2d5b-4ad8-b691-79e38a0154e7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:14:50.818140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fb20fa96-2d5b-4ad8-b691-79e38a0154e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:14:50.892251 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20fa96-2d5b-4ad8-b691-79e38a0154e7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:14:50.897320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5b056-8cfb-41a7-a351-9000ac0c496d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:14:50.898795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5b056-8cfb-41a7-a351-9000ac0c496d service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:14:50.898795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5b056-8cfb-41a7-a351-9000ac0c496d service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:14:50.898795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5b056-8cfb-41a7-a351-9000ac0c496d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:14:50.911394 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5b056-8cfb-41a7-a351-9000ac0c496d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:14:50.913773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5b056-8cfb-41a7-a351-9000ac0c496d service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:14:50.927882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1227/2433] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:14:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:15:00.800154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:00.921419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=55 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:01.227329 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569b058-241f-4475-884e-ec4e776fdbc8 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:15:01.301206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569b058-241f-4475-884e-ec4e776fdbc8 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:15:01.306841 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:15:01.307452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:15:01.307727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:15:01.308000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] PATH_INFO: `/v3/users/8109bda5ae794f94af7e6a412c04d66f` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:15:01.309214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8109bda5ae794f94af7e6a412c04d66f)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:15:01.311216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:15:01.363742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8109bda5ae794f94af7e6a412c04d66f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:15:01.364443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8109bda5ae794f94af7e6a412c04d66f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:15:01.371249 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8109bda5ae794f94af7e6a412c04d66f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:15:01.371952 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8109bda5ae794f94af7e6a412c04d66f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:15:01.384022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8109bda5ae794f94af7e6a412c04d66f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:15:01.400605 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1207/2434] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:15:01 2022] DELETE /identity/v3/users/8109bda5ae794f94af7e6a412c04d66f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:15:01.405327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2737585-e38b-4564-b2b4-2966254121cf None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:15:01.405638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2737585-e38b-4564-b2b4-2966254121cf None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:15:01.405908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2737585-e38b-4564-b2b4-2966254121cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:15:01.426454 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f2737585-e38b-4564-b2b4-2966254121cf None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:15:01.427832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f2737585-e38b-4564-b2b4-2966254121cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:15:01.491242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1228/2435] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:15:01.501302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:15:01.502865 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:15:01.566369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d2556-cd5b-429c-9c95-6e4373b175ec admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:15:01.570359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933def1-c2b6-400f-af01-04a53fe4d833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:15:01.570958 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933def1-c2b6-400f-af01-04a53fe4d833 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:15:01.571237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933def1-c2b6-400f-af01-04a53fe4d833 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:15:01.571506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933def1-c2b6-400f-af01-04a53fe4d833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:15:01.581836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933def1-c2b6-400f-af01-04a53fe4d833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:15:01.583387 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933def1-c2b6-400f-af01-04a53fe4d833 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:15:01.593252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1208/2436] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:15:01.878890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2737585-e38b-4564-b2b4-2966254121cf None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:15:01.880698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f2737585-e38b-4564-b2b4-2966254121cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:15:01.893453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2737585-e38b-4564-b2b4-2966254121cf None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:15:01.899543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:15:01.901215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:15:01.901499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:15:01.901766 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] PATH_INFO: `/v3/projects/1dcf39723f564681baaa80f5e0544458` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:15:01.903072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dcf39723f564681baaa80f5e0544458)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:15:01.905076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:15:01.952422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dcf39723f564681baaa80f5e0544458', 'request_id': 'req-34720b6d-02f8-40d1-b592-d7f8fce8491c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:15:01.958252 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dcf39723f564681baaa80f5e0544458', 'request_id': 'req-34720b6d-02f8-40d1-b592-d7f8fce8491c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:15:01.964832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dcf39723f564681baaa80f5e0544458', 'request_id': 'req-34720b6d-02f8-40d1-b592-d7f8fce8491c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:15:01.980465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] The token cache is being invalidate because project 1dcf39723f564681baaa80f5e0544458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:15:01.980765 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:15:01.981385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:15:01.982907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1229/2437] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:15:01 2022] DELETE /identity/v3/projects/1dcf39723f564681baaa80f5e0544458 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:15:11.588973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:11.977625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:46.093271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef0a6-f713-427b-9543-9966f3da7074 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:15:46.093796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef0a6-f713-427b-9543-9966f3da7074 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:15:46.093899 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef0a6-f713-427b-9543-9966f3da7074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:15:46.115666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2e3ef0a6-f713-427b-9543-9966f3da7074 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:15:46.117047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2e3ef0a6-f713-427b-9543-9966f3da7074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:15:46.177692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1209/2438] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:15:46.235661 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:15:46.237576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:15:46.311050 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34720b6d-02f8-40d1-b592-d7f8fce8491c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:15:46.316790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493d3d7-201b-4b30-ac93-ff251d814693 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:15:46.317398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493d3d7-201b-4b30-ac93-ff251d814693 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:15:46.317669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493d3d7-201b-4b30-ac93-ff251d814693 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:15:46.317937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493d3d7-201b-4b30-ac93-ff251d814693 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:15:46.326460 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493d3d7-201b-4b30-ac93-ff251d814693 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:15:46.328088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493d3d7-201b-4b30-ac93-ff251d814693 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:15:46.336071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1230/2439] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:15:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:15:56.170307 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=25 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:56.333014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=32 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:59.470000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ef0a6-f713-427b-9543-9966f3da7074 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:15:59.471542 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2e3ef0a6-f713-427b-9543-9966f3da7074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:15:59.546641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ef0a6-f713-427b-9543-9966f3da7074 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:15:59.552734 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e1cde-047f-4075-b6df-9c9039db2f56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:15:59.553349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1cde-047f-4075-b6df-9c9039db2f56 service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:15:59.553628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1cde-047f-4075-b6df-9c9039db2f56 service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:15:59.553902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1cde-047f-4075-b6df-9c9039db2f56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:15:59.555820 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8d3e1cde-047f-4075-b6df-9c9039db2f56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:15:59.570587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e1cde-047f-4075-b6df-9c9039db2f56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:15:59.573298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e1cde-047f-4075-b6df-9c9039db2f56 service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:15:59.583321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1210/2440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:15:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:16:01.355676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dbba0-900c-4f3d-a39e-cde817da6287 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:01.356365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dbba0-900c-4f3d-a39e-cde817da6287 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:01.356365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dbba0-900c-4f3d-a39e-cde817da6287 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:01.357605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1231/2441] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 6 01:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:16:01.363884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dd3ec-fa35-4e55-84aa-848be50056b3 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:01.364392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dd3ec-fa35-4e55-84aa-848be50056b3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:01.364495 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dd3ec-fa35-4e55-84aa-848be50056b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:01.385224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-de6dd3ec-fa35-4e55-84aa-848be50056b3 None None] MFA Rules not processed for user `42b9c25e98fe4b1bbc33a601d4150071`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:16:01.386427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-de6dd3ec-fa35-4e55-84aa-848be50056b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:16:01.455201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1211/2442] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 6 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:16:01.466801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dbba0-900c-4f3d-a39e-cde817da6287 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:16:01.468906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1d0dbba0-900c-4f3d-a39e-cde817da6287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:16:01.531820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dbba0-900c-4f3d-a39e-cde817da6287 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:16:01.537474 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2e740-058d-45e7-8a0c-4c084bef8cda service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31ebbadd69da4bc6ad25b5c882962ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:16:01.538169 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2e740-058d-45e7-8a0c-4c084bef8cda service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:01.538449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2e740-058d-45e7-8a0c-4c084bef8cda service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:01.539067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2e740-058d-45e7-8a0c-4c084bef8cda service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:01.553077 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2e740-058d-45e7-8a0c-4c084bef8cda service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:16:01.555259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2e740-058d-45e7-8a0c-4c084bef8cda service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:16:01.574278 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1232/2443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:16:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:16:01.646673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1565fcf-5925-4afd-845c-d6870a6e350f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:01.646946 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1565fcf-5925-4afd-845c-d6870a6e350f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:01.647250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1565fcf-5925-4afd-845c-d6870a6e350f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:01.648676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1212/2444] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 6 01:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:16:01.654305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4c107-ea39-46e4-96c6-ef95ad926cd0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:01.654669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4c107-ea39-46e4-96c6-ef95ad926cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:01.655067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4c107-ea39-46e4-96c6-ef95ad926cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:01.680480 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c2f4c107-ea39-46e4-96c6-ef95ad926cd0 None None] MFA Rules not processed for user `2fc30f3a335f428082e9178227dcb4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:16:01.681684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c2f4c107-ea39-46e4-96c6-ef95ad926cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:16:01.734671 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1233/2445] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 6 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:16:01.747521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1565fcf-5925-4afd-845c-d6870a6e350f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:16:01.749293 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c1565fcf-5925-4afd-845c-d6870a6e350f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:16:01.762572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1565fcf-5925-4afd-845c-d6870a6e350f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:16:01.766159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48c56c-277d-45ad-bff3-f9c30e2d0e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:16:01.766747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48c56c-277d-45ad-bff3-f9c30e2d0e16 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:01.767016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48c56c-277d-45ad-bff3-f9c30e2d0e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:01.767285 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48c56c-277d-45ad-bff3-f9c30e2d0e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:01.774576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48c56c-277d-45ad-bff3-f9c30e2d0e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:16:01.776027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48c56c-277d-45ad-bff3-f9c30e2d0e16 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:16:01.783842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1213/2446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:16:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:16:01.878930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32354b23-bceb-47f9-9150-75e5c7bb8ecb None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:01.879245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32354b23-bceb-47f9-9150-75e5c7bb8ecb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:01.879514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32354b23-bceb-47f9-9150-75e5c7bb8ecb None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:01.880914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1234/2447] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 6 01:16:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 01:16:01.886460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf5286-911c-47d5-8f5f-97d3a51427f4 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:01.886778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf5286-911c-47d5-8f5f-97d3a51427f4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:01.887572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf5286-911c-47d5-8f5f-97d3a51427f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:01.910573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-afbf5286-911c-47d5-8f5f-97d3a51427f4 None None] MFA Rules not processed for user `42b9c25e98fe4b1bbc33a601d4150071`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:16:01.911784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-afbf5286-911c-47d5-8f5f-97d3a51427f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:16:01.923813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1214/2448] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 6 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:16:01.935045 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32354b23-bceb-47f9-9150-75e5c7bb8ecb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:16:01.937163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-32354b23-bceb-47f9-9150-75e5c7bb8ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:16:01.952434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32354b23-bceb-47f9-9150-75e5c7bb8ecb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:16:01.956448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95879cc-6711-45d4-9a00-f77da983088a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:16:01.957039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95879cc-6711-45d4-9a00-f77da983088a service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:01.957309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95879cc-6711-45d4-9a00-f77da983088a service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:01.957582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95879cc-6711-45d4-9a00-f77da983088a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:01.968433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95879cc-6711-45d4-9a00-f77da983088a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:16:01.969911 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95879cc-6711-45d4-9a00-f77da983088a service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:16:01.981153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1235/2449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:16:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:16:04.374775 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad344-7010-4366-ba2e-d45011b66ee7 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:04.375310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad344-7010-4366-ba2e-d45011b66ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:04.375310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad344-7010-4366-ba2e-d45011b66ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:04.398129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f09ad344-7010-4366-ba2e-d45011b66ee7 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:16:04.399301 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f09ad344-7010-4366-ba2e-d45011b66ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:16:04.407776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1215/2450] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:16:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:16:04.420971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95879cc-6711-45d4-9a00-f77da983088a service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:16:04.433130 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95879cc-6711-45d4-9a00-f77da983088a service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:16:04.439238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfcc97-cd87-4a3d-9ced-17b00732bedd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:16:04.439919 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfcc97-cd87-4a3d-9ced-17b00732bedd service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:04.440332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfcc97-cd87-4a3d-9ced-17b00732bedd service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:04.440701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfcc97-cd87-4a3d-9ced-17b00732bedd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:04.449642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfcc97-cd87-4a3d-9ced-17b00732bedd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:16:04.451300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfcc97-cd87-4a3d-9ced-17b00732bedd service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:16:04.460038 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1236/2451] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:16:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:16:14.390012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=75 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:14.456763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=61 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:27.002332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8ef94-2bd2-4238-95e0-10298f18fa2e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:27.002784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8ef94-2bd2-4238-95e0-10298f18fa2e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:27.002888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8ef94-2bd2-4238-95e0-10298f18fa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:27.023973 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-87e8ef94-2bd2-4238-95e0-10298f18fa2e None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:16:27.025208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-87e8ef94-2bd2-4238-95e0-10298f18fa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:16:27.033056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1216/2452] 10.222.0.25 () {58 vars in 967 bytes} [Tue Sep 6 01:16:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:16:27.046012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfcc97-cd87-4a3d-9ced-17b00732bedd service swift] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:16:27.056553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfcc97-cd87-4a3d-9ced-17b00732bedd service swift] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:16:27.062069 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615ac8d-d7ef-4243-bd16-1ad32ac11e25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:16:27.062666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615ac8d-d7ef-4243-bd16-1ad32ac11e25 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:27.063237 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615ac8d-d7ef-4243-bd16-1ad32ac11e25 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:27.063505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615ac8d-d7ef-4243-bd16-1ad32ac11e25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:27.071919 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615ac8d-d7ef-4243-bd16-1ad32ac11e25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:16:27.073577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615ac8d-d7ef-4243-bd16-1ad32ac11e25 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:16:27.081910 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1237/2453] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:16:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:16:37.019186 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:37.078893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:53.368423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b23e9-267e-4bba-90a7-669f1932a453 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:16:53.369078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b23e9-267e-4bba-90a7-669f1932a453 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:16:53.369078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b23e9-267e-4bba-90a7-669f1932a453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:16:53.388626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-234b23e9-267e-4bba-90a7-669f1932a453 None None] MFA Rules not processed for user `d1dd5768f5c640ac9302d0250f76f5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:16:53.389848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-234b23e9-267e-4bba-90a7-669f1932a453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:16:53.453677 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1217/2454] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:17:03.441289 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=25 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:35.380946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615ac8d-d7ef-4243-bd16-1ad32ac11e25 service swift] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:17:35.382760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b615ac8d-d7ef-4243-bd16-1ad32ac11e25 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:17:35.445682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615ac8d-d7ef-4243-bd16-1ad32ac11e25 service swift] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:17:35.449758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6accb6-be03-4f5d-9248-465c1c755f59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:17:35.450360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6accb6-be03-4f5d-9248-465c1c755f59 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:17:35.450633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6accb6-be03-4f5d-9248-465c1c755f59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:17:35.450899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6accb6-be03-4f5d-9248-465c1c755f59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:17:35.452837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-af6accb6-be03-4f5d-9248-465c1c755f59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:17:35.466651 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6accb6-be03-4f5d-9248-465c1c755f59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:17:35.468112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6accb6-be03-4f5d-9248-465c1c755f59 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:17:35.479412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1238/2455] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:17:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:17:38.221888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b23e9-267e-4bba-90a7-669f1932a453 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:17:38.232862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b23e9-267e-4bba-90a7-669f1932a453 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:17:38.237458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2baadb-17e7-4250-9086-0a605fd1f1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:17:38.238101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2baadb-17e7-4250-9086-0a605fd1f1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:17:38.238380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2baadb-17e7-4250-9086-0a605fd1f1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:17:38.238643 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2baadb-17e7-4250-9086-0a605fd1f1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:17:38.240607 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ab2baadb-17e7-4250-9086-0a605fd1f1d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:17:38.254424 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2baadb-17e7-4250-9086-0a605fd1f1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:17:38.255926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2baadb-17e7-4250-9086-0a605fd1f1d5 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:17:38.267467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1218/2456] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:17:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:17:42.777323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6accb6-be03-4f5d-9248-465c1c755f59 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:17:42.779085 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-af6accb6-be03-4f5d-9248-465c1c755f59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:17:42.793063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6accb6-be03-4f5d-9248-465c1c755f59 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:17:42.798835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9b38-52bc-41aa-847e-5c2387626313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:17:42.799453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9b38-52bc-41aa-847e-5c2387626313 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:17:42.799732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9b38-52bc-41aa-847e-5c2387626313 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:17:42.800007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9b38-52bc-41aa-847e-5c2387626313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:17:42.801746 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-864b9b38-52bc-41aa-847e-5c2387626313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:17:42.863441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b9b38-52bc-41aa-847e-5c2387626313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:17:42.865153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b9b38-52bc-41aa-847e-5c2387626313 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:17:42.874126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1239/2457] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:17:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:17:44.170720 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89152b21-7ea6-481a-8b20-74a27d9fbba5 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:17:44.171229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89152b21-7ea6-481a-8b20-74a27d9fbba5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:17:44.171331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89152b21-7ea6-481a-8b20-74a27d9fbba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:17:44.192059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-89152b21-7ea6-481a-8b20-74a27d9fbba5 None None] MFA Rules not processed for user `3ea04d2b0055428090fc30d01f7c601e`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:17:44.193468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-89152b21-7ea6-481a-8b20-74a27d9fbba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:17:44.200832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1219/2458] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:17:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:17:44.546638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9b38-52bc-41aa-847e-5c2387626313 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:17:44.557653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9b38-52bc-41aa-847e-5c2387626313 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:17:44.562582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdaf5b-41e4-49c8-9916-5a185fc180a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:17:44.563255 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdaf5b-41e4-49c8-9916-5a185fc180a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:17:44.563539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdaf5b-41e4-49c8-9916-5a185fc180a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:17:44.563799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdaf5b-41e4-49c8-9916-5a185fc180a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:17:44.566097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-93cdaf5b-41e4-49c8-9916-5a185fc180a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:17:44.577554 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdaf5b-41e4-49c8-9916-5a185fc180a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:17:44.578984 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdaf5b-41e4-49c8-9916-5a185fc180a1 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:17:44.587602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1240/2459] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:17:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:17:44.913131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89152b21-7ea6-481a-8b20-74a27d9fbba5 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:17:44.914761 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-89152b21-7ea6-481a-8b20-74a27d9fbba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:17:44.930718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89152b21-7ea6-481a-8b20-74a27d9fbba5 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:17:44.936351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1893c-04f3-4c28-953c-b71335b56fda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:17:44.936969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1893c-04f3-4c28-953c-b71335b56fda service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:17:44.937245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1893c-04f3-4c28-953c-b71335b56fda service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:17:44.937517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1893c-04f3-4c28-953c-b71335b56fda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:17:44.939352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fdf1893c-04f3-4c28-953c-b71335b56fda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:17:44.952733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1893c-04f3-4c28-953c-b71335b56fda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:17:44.954439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1893c-04f3-4c28-953c-b71335b56fda service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:17:44.966158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1220/2460] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:17:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:17:46.867795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdaf5b-41e4-49c8-9916-5a185fc180a1 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:17:46.876737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdaf5b-41e4-49c8-9916-5a185fc180a1 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:17:46.881099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369496eb-4145-43e8-b58f-e13c71985938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:17:46.881718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369496eb-4145-43e8-b58f-e13c71985938 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:17:46.881997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369496eb-4145-43e8-b58f-e13c71985938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:17:46.882264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369496eb-4145-43e8-b58f-e13c71985938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:17:46.884006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-369496eb-4145-43e8-b58f-e13c71985938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:17:46.894920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369496eb-4145-43e8-b58f-e13c71985938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:17:46.897244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369496eb-4145-43e8-b58f-e13c71985938 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:17:46.906710 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1241/2461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:17:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:17:54.961255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=15 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:56.902300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=66 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:57.062727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1893c-04f3-4c28-953c-b71335b56fda service placement] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:17:57.064222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fdf1893c-04f3-4c28-953c-b71335b56fda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:17:57.086200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1893c-04f3-4c28-953c-b71335b56fda service placement] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:17:57.093332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0b15b-596b-4484-9819-96dae9aaf6e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:17:57.093956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0b15b-596b-4484-9819-96dae9aaf6e2 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:17:57.094235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0b15b-596b-4484-9819-96dae9aaf6e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:17:57.094508 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0b15b-596b-4484-9819-96dae9aaf6e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:17:57.096376 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a4e0b15b-596b-4484-9819-96dae9aaf6e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:17:57.109536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0b15b-596b-4484-9819-96dae9aaf6e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:17:57.111224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0b15b-596b-4484-9819-96dae9aaf6e2 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:17:57.122092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1221/2462] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:17:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:18:06.594409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369496eb-4145-43e8-b58f-e13c71985938 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:06.607986 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369496eb-4145-43e8-b58f-e13c71985938 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:06.613177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccf070-9845-463c-9056-485b657cc21b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:06.613778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccf070-9845-463c-9056-485b657cc21b service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:06.614055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccf070-9845-463c-9056-485b657cc21b service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:06.614327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccf070-9845-463c-9056-485b657cc21b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:06.616526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-92ccf070-9845-463c-9056-485b657cc21b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:06.630117 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccf070-9845-463c-9056-485b657cc21b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:06.631724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccf070-9845-463c-9056-485b657cc21b service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:06.642538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1242/2463] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:18:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:18:07.117681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:16.637258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:25.599223 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0b15b-596b-4484-9819-96dae9aaf6e2 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:25.600742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a4e0b15b-596b-4484-9819-96dae9aaf6e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:25.613082 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0b15b-596b-4484-9819-96dae9aaf6e2 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:25.617829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240a2ff-494c-4024-892f-1d1e9704c095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:25.618433 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240a2ff-494c-4024-892f-1d1e9704c095 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:25.618702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240a2ff-494c-4024-892f-1d1e9704c095 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:25.618966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240a2ff-494c-4024-892f-1d1e9704c095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:25.620960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f240a2ff-494c-4024-892f-1d1e9704c095 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:25.691061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240a2ff-494c-4024-892f-1d1e9704c095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:25.693104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240a2ff-494c-4024-892f-1d1e9704c095 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:25.702263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1222/2464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:18:25.722431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccf070-9845-463c-9056-485b657cc21b service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:25.732222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccf070-9845-463c-9056-485b657cc21b service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:25.735899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bc07f-8131-4357-81ab-57396c3a8c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:25.736618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bc07f-8131-4357-81ab-57396c3a8c4e service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:25.736970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bc07f-8131-4357-81ab-57396c3a8c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:25.737242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bc07f-8131-4357-81ab-57396c3a8c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:25.738994 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8b7bc07f-8131-4357-81ab-57396c3a8c4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:25.809244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bc07f-8131-4357-81ab-57396c3a8c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:25.810705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bc07f-8131-4357-81ab-57396c3a8c4e service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:25.821395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1243/2465] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:18:29.418625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240a2ff-494c-4024-892f-1d1e9704c095 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:29.432949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240a2ff-494c-4024-892f-1d1e9704c095 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:29.445778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf7b97-d3ab-489a-9b1b-1d3382a93d6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:29.446523 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7b97-d3ab-489a-9b1b-1d3382a93d6a service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:29.446870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7b97-d3ab-489a-9b1b-1d3382a93d6a service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:29.447209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7b97-d3ab-489a-9b1b-1d3382a93d6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:29.449290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7abf7b97-d3ab-489a-9b1b-1d3382a93d6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:29.472480 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf7b97-d3ab-489a-9b1b-1d3382a93d6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:29.474617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf7b97-d3ab-489a-9b1b-1d3382a93d6a service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:29.493037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bc07f-8131-4357-81ab-57396c3a8c4e service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:29.494477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8b7bc07f-8131-4357-81ab-57396c3a8c4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:29.498941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1223/2466] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:18:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:18:29.508489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bc07f-8131-4357-81ab-57396c3a8c4e service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:29.513570 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f60a9-4f0e-4d7f-b0ea-f3afeec4b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:29.514586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f60a9-4f0e-4d7f-b0ea-f3afeec4b4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:29.515217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f60a9-4f0e-4d7f-b0ea-f3afeec4b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:29.515497 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f60a9-4f0e-4d7f-b0ea-f3afeec4b4ef admin admin] PATH_INFO: `/v3/users/d1dd5768f5c640ac9302d0250f76f5a4` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:29.516718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f60a9-4f0e-4d7f-b0ea-f3afeec4b4ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1dd5768f5c640ac9302d0250f76f5a4)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:29.521967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f60a9-4f0e-4d7f-b0ea-f3afeec4b4ef admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:29.576592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dd6f60a9-4f0e-4d7f-b0ea-f3afeec4b4ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1dd5768f5c640ac9302d0250f76f5a4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:18:29.577290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dd6f60a9-4f0e-4d7f-b0ea-f3afeec4b4ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1dd5768f5c640ac9302d0250f76f5a4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:18:29.586078 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dd6f60a9-4f0e-4d7f-b0ea-f3afeec4b4ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1dd5768f5c640ac9302d0250f76f5a4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:18:29.594014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dd6f60a9-4f0e-4d7f-b0ea-f3afeec4b4ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1dd5768f5c640ac9302d0250f76f5a4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:18:29.594842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dd6f60a9-4f0e-4d7f-b0ea-f3afeec4b4ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1dd5768f5c640ac9302d0250f76f5a4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:18:29.613065 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1244/2467] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:18:29 2022] DELETE /identity/v3/users/d1dd5768f5c640ac9302d0250f76f5a4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:18:29.797591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf7b97-d3ab-489a-9b1b-1d3382a93d6a service placement] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:29.808902 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf7b97-d3ab-489a-9b1b-1d3382a93d6a service placement] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:29.891903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5161a51-9897-44da-b7f0-29835014abf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:29.892695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161a51-9897-44da-b7f0-29835014abf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:29.893189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161a51-9897-44da-b7f0-29835014abf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:29.893650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161a51-9897-44da-b7f0-29835014abf9 admin admin] PATH_INFO: `/v3/projects/3a7f33f41c194eb187acf8d3657c54c3` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:29.894804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5161a51-9897-44da-b7f0-29835014abf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7f33f41c194eb187acf8d3657c54c3)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:29.897309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5161a51-9897-44da-b7f0-29835014abf9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:29.973735 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a5161a51-9897-44da-b7f0-29835014abf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7f33f41c194eb187acf8d3657c54c3', 'request_id': 'req-a5161a51-9897-44da-b7f0-29835014abf9'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:18:29.981145 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a5161a51-9897-44da-b7f0-29835014abf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7f33f41c194eb187acf8d3657c54c3', 'request_id': 'req-a5161a51-9897-44da-b7f0-29835014abf9'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:18:29.989979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a5161a51-9897-44da-b7f0-29835014abf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7f33f41c194eb187acf8d3657c54c3', 'request_id': 'req-a5161a51-9897-44da-b7f0-29835014abf9'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:18:30.004506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a5161a51-9897-44da-b7f0-29835014abf9 admin admin] The token cache is being invalidate because project 3a7f33f41c194eb187acf8d3657c54c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:18:30.004908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a5161a51-9897-44da-b7f0-29835014abf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:18:30.005579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a5161a51-9897-44da-b7f0-29835014abf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:18:30.008336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1224/2468] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:18:29 2022] DELETE /identity/v3/projects/3a7f33f41c194eb187acf8d3657c54c3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:18:30.012429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158bc7-8552-4a29-a4c1-517e485a154e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:30.012798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158bc7-8552-4a29-a4c1-517e485a154e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:30.012976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158bc7-8552-4a29-a4c1-517e485a154e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:30.037481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ac158bc7-8552-4a29-a4c1-517e485a154e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:18:30.038742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ac158bc7-8552-4a29-a4c1-517e485a154e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:30.123789 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1245/2469] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:18:30.131810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d27337-d8f0-4d6f-b12e-d8736ca31824 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:30.132140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d27337-d8f0-4d6f-b12e-d8736ca31824 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:30.132505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d27337-d8f0-4d6f-b12e-d8736ca31824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:30.152899 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f3d27337-d8f0-4d6f-b12e-d8736ca31824 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:18:30.154208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f3d27337-d8f0-4d6f-b12e-d8736ca31824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:30.162571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1225/2470] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:18:30.166950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158bc7-8552-4a29-a4c1-517e485a154e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:30.178688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158bc7-8552-4a29-a4c1-517e485a154e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:30.183931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206f564-d74e-4383-a42f-265511a67045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:30.184571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206f564-d74e-4383-a42f-265511a67045 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:30.184855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206f564-d74e-4383-a42f-265511a67045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:30.185332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206f564-d74e-4383-a42f-265511a67045 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:30.185987 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206f564-d74e-4383-a42f-265511a67045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:18:30.186288 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206f564-d74e-4383-a42f-265511a67045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:30.187942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206f564-d74e-4383-a42f-265511a67045 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:30.189585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:30.207758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1246/2471] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:18:30.209050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d27337-d8f0-4d6f-b12e-d8736ca31824 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:30.219575 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d27337-d8f0-4d6f-b12e-d8736ca31824 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:30.224695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8ccc1-3487-44c1-9acf-85fa68c083d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:30.225296 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8ccc1-3487-44c1-9acf-85fa68c083d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:30.225609 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8ccc1-3487-44c1-9acf-85fa68c083d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:30.226097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8ccc1-3487-44c1-9acf-85fa68c083d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:30.226916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8ccc1-3487-44c1-9acf-85fa68c083d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:30.228914 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8ccc1-3487-44c1-9acf-85fa68c083d7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:30.234598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:30.263886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1226/2472] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:18:30 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:18:30.265532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206f564-d74e-4383-a42f-265511a67045 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:30.275815 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206f564-d74e-4383-a42f-265511a67045 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:30.333656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71772813-732e-4505-afaa-948902957f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:30.334322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71772813-732e-4505-afaa-948902957f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:30.334598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71772813-732e-4505-afaa-948902957f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:30.334866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71772813-732e-4505-afaa-948902957f44 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:30.335500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71772813-732e-4505-afaa-948902957f44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:30.337548 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71772813-732e-4505-afaa-948902957f44 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:30.362827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1247/2473] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:18:30 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:18:30.367336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8ccc1-3487-44c1-9acf-85fa68c083d7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:30.378901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8ccc1-3487-44c1-9acf-85fa68c083d7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:30.383759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb8a06-6307-4748-92af-7883e0620080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:30.384275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb8a06-6307-4748-92af-7883e0620080 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:30.384571 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb8a06-6307-4748-92af-7883e0620080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:30.384838 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb8a06-6307-4748-92af-7883e0620080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:30.385476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb8a06-6307-4748-92af-7883e0620080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:30.387115 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb8a06-6307-4748-92af-7883e0620080 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:30.397746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1227/2474] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:18:30.402713 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71772813-732e-4505-afaa-948902957f44 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:30.413388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71772813-732e-4505-afaa-948902957f44 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:30.418078 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb483c-e2c9-4f38-aa7b-e1cf1e2266e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:30.418690 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb483c-e2c9-4f38-aa7b-e1cf1e2266e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:30.418962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb483c-e2c9-4f38-aa7b-e1cf1e2266e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:30.419230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb483c-e2c9-4f38-aa7b-e1cf1e2266e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:30.419877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb483c-e2c9-4f38-aa7b-e1cf1e2266e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:30.421563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb483c-e2c9-4f38-aa7b-e1cf1e2266e0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:30.432869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1248/2475] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:18:30.437179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb8a06-6307-4748-92af-7883e0620080 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:30.447590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb8a06-6307-4748-92af-7883e0620080 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:30.452317 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf741e53-0712-4a84-92ba-95b318a73c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:30.453093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf741e53-0712-4a84-92ba-95b318a73c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:30.453326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf741e53-0712-4a84-92ba-95b318a73c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:30.453607 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf741e53-0712-4a84-92ba-95b318a73c42 admin admin] PATH_INFO: `/v3/projects/891c88950a604b63875cc147671ee0b3/users/a6103fdbcc6d41acb0d113400b3617ba/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:30.469093 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf741e53-0712-4a84-92ba-95b318a73c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891c88950a604b63875cc147671ee0b3, user_id=a6103fdbcc6d41acb0d113400b3617ba, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:30.471833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf741e53-0712-4a84-92ba-95b318a73c42 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:30.491510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1228/2476] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:18:30 2022] PUT /identity/v3/projects/891c88950a604b63875cc147671ee0b3/users/a6103fdbcc6d41acb0d113400b3617ba/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:18:30.496831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197c9a2-0c8c-4f88-92c2-33d506faa0b4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:30.497329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197c9a2-0c8c-4f88-92c2-33d506faa0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:30.497521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197c9a2-0c8c-4f88-92c2-33d506faa0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:30.518259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e197c9a2-0c8c-4f88-92c2-33d506faa0b4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:18:30.519612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e197c9a2-0c8c-4f88-92c2-33d506faa0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:30.587923 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1249/2477] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:18:30.598074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf741e53-0712-4a84-92ba-95b318a73c42 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:30.599945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bf741e53-0712-4a84-92ba-95b318a73c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:30.662397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf741e53-0712-4a84-92ba-95b318a73c42 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:30.666090 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600f739-f22b-413b-82f4-add6c667bfb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:30.666701 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600f739-f22b-413b-82f4-add6c667bfb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:30.666976 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600f739-f22b-413b-82f4-add6c667bfb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:30.667245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600f739-f22b-413b-82f4-add6c667bfb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:30.677220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600f739-f22b-413b-82f4-add6c667bfb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:30.678736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600f739-f22b-413b-82f4-add6c667bfb7 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:30.688746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1229/2478] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:18:32.186793 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9596c7-df72-4867-8b66-90cb1df43441 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:32.187325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9596c7-df72-4867-8b66-90cb1df43441 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:32.187325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9596c7-df72-4867-8b66-90cb1df43441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:32.209163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5f9596c7-df72-4867-8b66-90cb1df43441 None None] MFA Rules not processed for user `7f8c891da32b49d29bf57d116e84debf`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:18:32.210459 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5f9596c7-df72-4867-8b66-90cb1df43441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:32.283658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1250/2479] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:18:35.557062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b107b6d-9b05-4ce6-a119-55d474506474 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:35.557945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b107b6d-9b05-4ce6-a119-55d474506474 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:35.558373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b107b6d-9b05-4ce6-a119-55d474506474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:35.601384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1b107b6d-9b05-4ce6-a119-55d474506474 None None] MFA Rules not processed for user `a6103fdbcc6d41acb0d113400b3617ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:18:35.602460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1b107b6d-9b05-4ce6-a119-55d474506474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:35.696322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1230/2480] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:18:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:18:35.707769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9596c7-df72-4867-8b66-90cb1df43441 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:35.709359 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5f9596c7-df72-4867-8b66-90cb1df43441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:35.731785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:35.795308 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9596c7-df72-4867-8b66-90cb1df43441 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:35.800807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b53c1c-5c29-4e6d-9922-7dc5644ae0d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:35.801561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b53c1c-5c29-4e6d-9922-7dc5644ae0d5 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:35.801834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b53c1c-5c29-4e6d-9922-7dc5644ae0d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:35.802105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b53c1c-5c29-4e6d-9922-7dc5644ae0d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:35.810936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b53c1c-5c29-4e6d-9922-7dc5644ae0d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:35.812631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b53c1c-5c29-4e6d-9922-7dc5644ae0d5 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:35.822530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1251/2481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:18:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:18:37.378503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688fa68-9588-427e-893e-03ecdfe230f8 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:37.379053 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688fa68-9588-427e-893e-03ecdfe230f8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:37.379053 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688fa68-9588-427e-893e-03ecdfe230f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:37.399088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4688fa68-9588-427e-893e-03ecdfe230f8 None None] MFA Rules not processed for user `a6103fdbcc6d41acb0d113400b3617ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:18:37.400330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4688fa68-9588-427e-893e-03ecdfe230f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:37.408208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1231/2482] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:18:41.036006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b53c1c-5c29-4e6d-9922-7dc5644ae0d5 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:41.047820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b53c1c-5c29-4e6d-9922-7dc5644ae0d5 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:41.056525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f68aa-0f9d-4fe8-9acc-632dde6c91ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:41.057414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f68aa-0f9d-4fe8-9acc-632dde6c91ee service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:41.057698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f68aa-0f9d-4fe8-9acc-632dde6c91ee service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:41.057965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f68aa-0f9d-4fe8-9acc-632dde6c91ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:41.059890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-550f68aa-0f9d-4fe8-9acc-632dde6c91ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:41.072914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f68aa-0f9d-4fe8-9acc-632dde6c91ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:41.074590 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f68aa-0f9d-4fe8-9acc-632dde6c91ee service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:41.086049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1252/2483] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:18:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:18:47.231943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688fa68-9588-427e-893e-03ecdfe230f8 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:18:47.233657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4688fa68-9588-427e-893e-03ecdfe230f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:47.252121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688fa68-9588-427e-893e-03ecdfe230f8 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:18:47.257897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfbd64-e2fe-45d9-8e15-b5b83129a29b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:18:47.258507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfbd64-e2fe-45d9-8e15-b5b83129a29b service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:18:47.258785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfbd64-e2fe-45d9-8e15-b5b83129a29b service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:18:47.259057 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfbd64-e2fe-45d9-8e15-b5b83129a29b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:18:47.260880 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f7cfbd64-e2fe-45d9-8e15-b5b83129a29b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:18:47.274848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfbd64-e2fe-45d9-8e15-b5b83129a29b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:18:47.277232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfbd64-e2fe-45d9-8e15-b5b83129a29b service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:18:47.290283 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1232/2484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:18:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:18:51.080753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=32 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:57.284500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=87,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:19:38.810717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1728-2e63-4c59-bdbe-7e72d0aa3e5f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:19:38.811315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1728-2e63-4c59-bdbe-7e72d0aa3e5f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:19:38.811315 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1728-2e63-4c59-bdbe-7e72d0aa3e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:19:38.832141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-337f1728-2e63-4c59-bdbe-7e72d0aa3e5f None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:19:38.833431 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-337f1728-2e63-4c59-bdbe-7e72d0aa3e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:19:38.896728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1253/2485] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:19:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:19:38.950458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfbd64-e2fe-45d9-8e15-b5b83129a29b service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:19:38.952028 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f7cfbd64-e2fe-45d9-8e15-b5b83129a29b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:19:39.028934 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfbd64-e2fe-45d9-8e15-b5b83129a29b service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:19:39.034135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffec1b-b25d-423d-8639-e7c51d1c9c18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:19:39.034919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffec1b-b25d-423d-8639-e7c51d1c9c18 service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:19:39.035203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffec1b-b25d-423d-8639-e7c51d1c9c18 service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:19:39.035479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffec1b-b25d-423d-8639-e7c51d1c9c18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:19:39.045497 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffec1b-b25d-423d-8639-e7c51d1c9c18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:19:39.047236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffec1b-b25d-423d-8639-e7c51d1c9c18 service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:19:39.056835 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1233/2486] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:19:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:19:48.886324 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=25 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:19:49.053444 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=32 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:19:55.367976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3dd8-bd81-4ce5-8d36-f76132a5d9a8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:19:55.368584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3dd8-bd81-4ce5-8d36-f76132a5d9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:19:55.368584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3dd8-bd81-4ce5-8d36-f76132a5d9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:19:55.394761 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-781d3dd8-bd81-4ce5-8d36-f76132a5d9a8 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:19:55.396276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-781d3dd8-bd81-4ce5-8d36-f76132a5d9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:19:55.405455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1254/2487] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:19:55.423332 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffec1b-b25d-423d-8639-e7c51d1c9c18 service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:19:55.439152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffec1b-b25d-423d-8639-e7c51d1c9c18 service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:19:55.446818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c653a1-8cdc-4e7b-a01c-9c27bb04e959 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:19:55.447432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c653a1-8cdc-4e7b-a01c-9c27bb04e959 service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:19:55.447810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c653a1-8cdc-4e7b-a01c-9c27bb04e959 service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:19:55.448272 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c653a1-8cdc-4e7b-a01c-9c27bb04e959 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:19:55.458045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c653a1-8cdc-4e7b-a01c-9c27bb04e959 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:19:55.459690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c653a1-8cdc-4e7b-a01c-9c27bb04e959 service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:19:55.469092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1234/2488] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:19:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:20:05.387452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:05.465325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:17.830901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf2418-1ca5-456d-8d1d-4f132cc74cdc None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:17.831424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf2418-1ca5-456d-8d1d-4f132cc74cdc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:17.831424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf2418-1ca5-456d-8d1d-4f132cc74cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:17.871353 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e5bf2418-1ca5-456d-8d1d-4f132cc74cdc None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:17.872586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e5bf2418-1ca5-456d-8d1d-4f132cc74cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:17.907705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1255/2489] 10.222.0.25 () {58 vars in 967 bytes} [Tue Sep 6 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:17.920038 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c653a1-8cdc-4e7b-a01c-9c27bb04e959 service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:17.969402 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c653a1-8cdc-4e7b-a01c-9c27bb04e959 service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:17.975488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1a98e-b9c4-45e2-a456-973dfbf864de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:17.976097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1a98e-b9c4-45e2-a456-973dfbf864de service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:17.976412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1a98e-b9c4-45e2-a456-973dfbf864de service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:17.976709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1a98e-b9c4-45e2-a456-973dfbf864de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:17.985205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1a98e-b9c4-45e2-a456-973dfbf864de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:17.986950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1a98e-b9c4-45e2-a456-973dfbf864de service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:17.995072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1235/2490] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:20:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:20:27.905265 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=23 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:27.991842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=20 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:30.640404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abf376-147c-49c5-8f16-234acccaf72f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:30.640901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abf376-147c-49c5-8f16-234acccaf72f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:30.641011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abf376-147c-49c5-8f16-234acccaf72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:30.660840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e4abf376-147c-49c5-8f16-234acccaf72f None None] MFA Rules not processed for user `a6103fdbcc6d41acb0d113400b3617ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:30.662039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e4abf376-147c-49c5-8f16-234acccaf72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:30.670343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1256/2491] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:30.991444 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1a98e-b9c4-45e2-a456-973dfbf864de service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:30.994025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2ec1a98e-b9c4-45e2-a456-973dfbf864de service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:31.011933 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1a98e-b9c4-45e2-a456-973dfbf864de service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:31.016587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc0dc5-3a50-44b0-97f2-323760ba87b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:31.017225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc0dc5-3a50-44b0-97f2-323760ba87b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:31.017500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc0dc5-3a50-44b0-97f2-323760ba87b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:31.017769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc0dc5-3a50-44b0-97f2-323760ba87b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:31.019681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-44bc0dc5-3a50-44b0-97f2-323760ba87b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:31.030100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc0dc5-3a50-44b0-97f2-323760ba87b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:31.031564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc0dc5-3a50-44b0-97f2-323760ba87b5 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:31.041128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1236/2492] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:20:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:20:40.655397 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:41.035909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:41.414575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abf376-147c-49c5-8f16-234acccaf72f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:41.436866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abf376-147c-49c5-8f16-234acccaf72f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:41.440700 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0c324-a410-4658-9c57-24f6e596dd66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:41.441297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0c324-a410-4658-9c57-24f6e596dd66 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:41.441573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0c324-a410-4658-9c57-24f6e596dd66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:41.441843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0c324-a410-4658-9c57-24f6e596dd66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:41.443962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-89d0c324-a410-4658-9c57-24f6e596dd66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:41.485491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0c324-a410-4658-9c57-24f6e596dd66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:41.487000 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0c324-a410-4658-9c57-24f6e596dd66 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:41.508836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1257/2493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:20:44.759452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc0dc5-3a50-44b0-97f2-323760ba87b5 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:44.762035 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-44bc0dc5-3a50-44b0-97f2-323760ba87b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:44.777518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc0dc5-3a50-44b0-97f2-323760ba87b5 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:44.782883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae001e5-e380-4223-a363-404d6b920a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:44.783559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae001e5-e380-4223-a363-404d6b920a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:44.783831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae001e5-e380-4223-a363-404d6b920a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:44.784097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae001e5-e380-4223-a363-404d6b920a0e admin admin] PATH_INFO: `/v3/users/7f8c891da32b49d29bf57d116e84debf` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:44.785758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae001e5-e380-4223-a363-404d6b920a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8c891da32b49d29bf57d116e84debf)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:44.787790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae001e5-e380-4223-a363-404d6b920a0e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:44.850563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8ae001e5-e380-4223-a363-404d6b920a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8c891da32b49d29bf57d116e84debf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:44.851250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8ae001e5-e380-4223-a363-404d6b920a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8c891da32b49d29bf57d116e84debf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:44.858606 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8ae001e5-e380-4223-a363-404d6b920a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8c891da32b49d29bf57d116e84debf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:44.859589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8ae001e5-e380-4223-a363-404d6b920a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8c891da32b49d29bf57d116e84debf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:44.873521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8ae001e5-e380-4223-a363-404d6b920a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8c891da32b49d29bf57d116e84debf'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:44.890459 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1237/2494] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:20:44 2022] DELETE /identity/v3/users/7f8c891da32b49d29bf57d116e84debf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:45.070161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0c324-a410-4658-9c57-24f6e596dd66 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:45.083737 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0c324-a410-4658-9c57-24f6e596dd66 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:45.153005 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805400c-86df-4641-838c-f8cb9272935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:45.153648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805400c-86df-4641-838c-f8cb9272935c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:45.153920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805400c-86df-4641-838c-f8cb9272935c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:45.154189 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805400c-86df-4641-838c-f8cb9272935c admin admin] PATH_INFO: `/v3/projects/9e9709d4bf6c4b99b5a31c7055c950cb` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:45.155361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805400c-86df-4641-838c-f8cb9272935c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9709d4bf6c4b99b5a31c7055c950cb)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:45.157366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805400c-86df-4641-838c-f8cb9272935c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:45.210132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2805400c-86df-4641-838c-f8cb9272935c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9709d4bf6c4b99b5a31c7055c950cb', 'request_id': 'req-2805400c-86df-4641-838c-f8cb9272935c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:45.215379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2805400c-86df-4641-838c-f8cb9272935c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9709d4bf6c4b99b5a31c7055c950cb', 'request_id': 'req-2805400c-86df-4641-838c-f8cb9272935c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:45.221605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2805400c-86df-4641-838c-f8cb9272935c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9709d4bf6c4b99b5a31c7055c950cb', 'request_id': 'req-2805400c-86df-4641-838c-f8cb9272935c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:45.235557 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2805400c-86df-4641-838c-f8cb9272935c admin admin] The token cache is being invalidate because project 9e9709d4bf6c4b99b5a31c7055c950cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:20:45.235851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2805400c-86df-4641-838c-f8cb9272935c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:45.236523 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2805400c-86df-4641-838c-f8cb9272935c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:45.238085 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1258/2495] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:20:45 2022] DELETE /identity/v3/projects/9e9709d4bf6c4b99b5a31c7055c950cb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:45.243076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6faa1f9-0f65-454a-b4f4-6767d10f9baa None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:45.243358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6faa1f9-0f65-454a-b4f4-6767d10f9baa None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:45.243621 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6faa1f9-0f65-454a-b4f4-6767d10f9baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:45.304619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f6faa1f9-0f65-454a-b4f4-6767d10f9baa None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:45.305857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f6faa1f9-0f65-454a-b4f4-6767d10f9baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:45.369094 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1238/2496] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:45.377603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed056f5-0dca-4cc7-85a5-3f6c06e825e7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:45.377888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed056f5-0dca-4cc7-85a5-3f6c06e825e7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:45.378163 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed056f5-0dca-4cc7-85a5-3f6c06e825e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:45.399367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2ed056f5-0dca-4cc7-85a5-3f6c06e825e7 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:45.400611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2ed056f5-0dca-4cc7-85a5-3f6c06e825e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:45.409797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1259/2497] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:45.414152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6faa1f9-0f65-454a-b4f4-6767d10f9baa None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:45.427143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6faa1f9-0f65-454a-b4f4-6767d10f9baa None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:45.433270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442814b-3573-48f6-adea-b3922262876b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:45.434661 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442814b-3573-48f6-adea-b3922262876b admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:45.434962 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442814b-3573-48f6-adea-b3922262876b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:45.435209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442814b-3573-48f6-adea-b3922262876b admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:45.435857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442814b-3573-48f6-adea-b3922262876b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:20:45.436157 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442814b-3573-48f6-adea-b3922262876b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:45.437838 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442814b-3573-48f6-adea-b3922262876b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:45.450253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1239/2498] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:20:45.454981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed056f5-0dca-4cc7-85a5-3f6c06e825e7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:45.464572 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed056f5-0dca-4cc7-85a5-3f6c06e825e7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:45.469888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ad1a-0529-4141-a100-214d74434f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:45.470494 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ad1a-0529-4141-a100-214d74434f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:45.470769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ad1a-0529-4141-a100-214d74434f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:45.471038 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ad1a-0529-4141-a100-214d74434f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:45.471682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61ad1a-0529-4141-a100-214d74434f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:45.473702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61ad1a-0529-4141-a100-214d74434f2e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:45.503471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1260/2499] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:20:45 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:20:45.507756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442814b-3573-48f6-adea-b3922262876b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:45.519144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442814b-3573-48f6-adea-b3922262876b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:45.546759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:45.584439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05b83e-562f-4b04-aa4a-e7a7853dfa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:45.585058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05b83e-562f-4b04-aa4a-e7a7853dfa0f admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:45.585333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05b83e-562f-4b04-aa4a-e7a7853dfa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:45.585627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05b83e-562f-4b04-aa4a-e7a7853dfa0f admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:45.586304 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05b83e-562f-4b04-aa4a-e7a7853dfa0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:45.588263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05b83e-562f-4b04-aa4a-e7a7853dfa0f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:45.616912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1240/2500] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:20:45 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:20:45.618225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ad1a-0529-4141-a100-214d74434f2e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:45.628903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ad1a-0529-4141-a100-214d74434f2e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:45.633805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870235f-e300-4f30-bd75-fade323229b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:45.634434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870235f-e300-4f30-bd75-fade323229b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:45.634714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870235f-e300-4f30-bd75-fade323229b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:45.634967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870235f-e300-4f30-bd75-fade323229b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:45.636001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870235f-e300-4f30-bd75-fade323229b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:45.637739 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870235f-e300-4f30-bd75-fade323229b5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:45.643568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:45.649994 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1261/2501] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:20:45.653608 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05b83e-562f-4b04-aa4a-e7a7853dfa0f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:45.664401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05b83e-562f-4b04-aa4a-e7a7853dfa0f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:45.669907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6d7da-01eb-4506-b13c-c4080a10a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:45.670519 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6d7da-01eb-4506-b13c-c4080a10a059 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:45.670859 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6d7da-01eb-4506-b13c-c4080a10a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:45.671138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6d7da-01eb-4506-b13c-c4080a10a059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:45.671782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6d7da-01eb-4506-b13c-c4080a10a059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:45.673451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6d7da-01eb-4506-b13c-c4080a10a059 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:45.689062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1241/2502] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:20:45.690269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870235f-e300-4f30-bd75-fade323229b5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:45.701246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870235f-e300-4f30-bd75-fade323229b5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:45.705980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea7e89-ebe4-4701-ab93-89696fecc823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:45.706652 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea7e89-ebe4-4701-ab93-89696fecc823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:45.706930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea7e89-ebe4-4701-ab93-89696fecc823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:45.707202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea7e89-ebe4-4701-ab93-89696fecc823 admin admin] PATH_INFO: `/v3/projects/0885edbf920f41f0a64fb7563a2fc822/users/c3fd320d6426468b986a9b7f59e01a8e/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:45.723941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea7e89-ebe4-4701-ab93-89696fecc823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0885edbf920f41f0a64fb7563a2fc822, user_id=c3fd320d6426468b986a9b7f59e01a8e, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:45.726755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea7e89-ebe4-4701-ab93-89696fecc823 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:45.742579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1262/2503] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:20:45 2022] PUT /identity/v3/projects/0885edbf920f41f0a64fb7563a2fc822/users/c3fd320d6426468b986a9b7f59e01a8e/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:20:45.754544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6bd43-2829-4357-bb50-3708cfddde83 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:45.754825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6bd43-2829-4357-bb50-3708cfddde83 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:45.755101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6bd43-2829-4357-bb50-3708cfddde83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:45.785586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a8a6bd43-2829-4357-bb50-3708cfddde83 None None] MFA Rules not processed for user `c3fd320d6426468b986a9b7f59e01a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:45.786799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a8a6bd43-2829-4357-bb50-3708cfddde83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:45.862113 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1242/2504] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:45.867405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea7e89-ebe4-4701-ab93-89696fecc823 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:45.938463 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea7e89-ebe4-4701-ab93-89696fecc823 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:45.944098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309ae47-8299-4664-8568-68a438977c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:45.944762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309ae47-8299-4664-8568-68a438977c5d admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:45.945040 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309ae47-8299-4664-8568-68a438977c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:45.945311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309ae47-8299-4664-8568-68a438977c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:45.945947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309ae47-8299-4664-8568-68a438977c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:45.948031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309ae47-8299-4664-8568-68a438977c5d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:45.978161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1263/2505] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:20:45 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:20:45.982398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6bd43-2829-4357-bb50-3708cfddde83 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:45.993735 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6bd43-2829-4357-bb50-3708cfddde83 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:46.058848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9af87-c897-49f0-8ee7-46023f58bacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:46.060116 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9af87-c897-49f0-8ee7-46023f58bacb admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:46.060527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9af87-c897-49f0-8ee7-46023f58bacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:46.060833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9af87-c897-49f0-8ee7-46023f58bacb admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:46.061760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9af87-c897-49f0-8ee7-46023f58bacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:46.063843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9af87-c897-49f0-8ee7-46023f58bacb admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:46.087325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1243/2506] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:20:45 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:20:46.091742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309ae47-8299-4664-8568-68a438977c5d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:46.102105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309ae47-8299-4664-8568-68a438977c5d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:46.107078 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6a2de-5764-426c-a49e-160efc8fe1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:46.107676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6a2de-5764-426c-a49e-160efc8fe1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:46.107950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6a2de-5764-426c-a49e-160efc8fe1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:46.108216 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6a2de-5764-426c-a49e-160efc8fe1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:46.108889 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6a2de-5764-426c-a49e-160efc8fe1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:46.110538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6a2de-5764-426c-a49e-160efc8fe1d1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:46.121310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1264/2507] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:20:46.125790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9af87-c897-49f0-8ee7-46023f58bacb admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:46.136324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9af87-c897-49f0-8ee7-46023f58bacb admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:46.141298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e04ce3-6fc8-448a-bbec-b08831e1da18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:46.141977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e04ce3-6fc8-448a-bbec-b08831e1da18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:46.142234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e04ce3-6fc8-448a-bbec-b08831e1da18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:46.142511 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e04ce3-6fc8-448a-bbec-b08831e1da18 admin admin] PATH_INFO: `/v3/projects/7791d18c71b14fb9b9051b824b28eaef/users/6c4cf0f756884b2eb7f8ab19bf0ca1df/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:46.157942 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e04ce3-6fc8-448a-bbec-b08831e1da18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7791d18c71b14fb9b9051b824b28eaef, user_id=6c4cf0f756884b2eb7f8ab19bf0ca1df, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:46.160700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e04ce3-6fc8-448a-bbec-b08831e1da18 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:46.176741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1244/2508] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:20:46 2022] PUT /identity/v3/projects/7791d18c71b14fb9b9051b824b28eaef/users/6c4cf0f756884b2eb7f8ab19bf0ca1df/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:20:46.182937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6a2de-5764-426c-a49e-160efc8fe1d1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:46.193824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6a2de-5764-426c-a49e-160efc8fe1d1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:46.252048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c30e0b-b669-4ebf-a22b-bf34d43a4b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:46.252609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c30e0b-b669-4ebf-a22b-bf34d43a4b95 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:46.252882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c30e0b-b669-4ebf-a22b-bf34d43a4b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:46.253148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c30e0b-b669-4ebf-a22b-bf34d43a4b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:46.253784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c30e0b-b669-4ebf-a22b-bf34d43a4b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:46.255421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c30e0b-b669-4ebf-a22b-bf34d43a4b95 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:46.265942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1265/2509] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:20:46.270682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e04ce3-6fc8-448a-bbec-b08831e1da18 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:46.276755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:46.284543 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e04ce3-6fc8-448a-bbec-b08831e1da18 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:46.289996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73d424-baa7-4152-ae95-c397f7f091e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:46.290784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73d424-baa7-4152-ae95-c397f7f091e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:46.291061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73d424-baa7-4152-ae95-c397f7f091e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:46.291362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73d424-baa7-4152-ae95-c397f7f091e9 admin admin] PATH_INFO: `/v3/projects/7791d18c71b14fb9b9051b824b28eaef/users/6c4cf0f756884b2eb7f8ab19bf0ca1df/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:46.293454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73d424-baa7-4152-ae95-c397f7f091e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7791d18c71b14fb9b9051b824b28eaef, user_id=6c4cf0f756884b2eb7f8ab19bf0ca1df, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:46.296144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73d424-baa7-4152-ae95-c397f7f091e9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:46.306885 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1245/2510] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:20:46 2022] PUT /identity/v3/projects/7791d18c71b14fb9b9051b824b28eaef/users/6c4cf0f756884b2eb7f8ab19bf0ca1df/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:46.317736 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d44543-db86-484d-b02a-6e3b6abe522a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:46.318027 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d44543-db86-484d-b02a-6e3b6abe522a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:46.318261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d44543-db86-484d-b02a-6e3b6abe522a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:46.348345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-27d44543-db86-484d-b02a-6e3b6abe522a None None] MFA Rules not processed for user `6c4cf0f756884b2eb7f8ab19bf0ca1df`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:46.350208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-27d44543-db86-484d-b02a-6e3b6abe522a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:46.393574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:46.429059 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1266/2511] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:46.445064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73d424-baa7-4152-ae95-c397f7f091e9 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:46.448100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6d73d424-baa7-4152-ae95-c397f7f091e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:46.562940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73d424-baa7-4152-ae95-c397f7f091e9 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:46.567233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bef683-8246-4a9a-8b21-4d7e8859224d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:46.567850 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bef683-8246-4a9a-8b21-4d7e8859224d service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:46.568127 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bef683-8246-4a9a-8b21-4d7e8859224d service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:46.568422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bef683-8246-4a9a-8b21-4d7e8859224d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:46.578823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bef683-8246-4a9a-8b21-4d7e8859224d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:46.580318 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bef683-8246-4a9a-8b21-4d7e8859224d service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:46.590822 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1246/2512] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:20:46.642265 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d44543-db86-484d-b02a-6e3b6abe522a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:46.643728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-27d44543-db86-484d-b02a-6e3b6abe522a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:46.656028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d44543-db86-484d-b02a-6e3b6abe522a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:46.660071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3ba48-2950-4838-bcd6-e44efaef85e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:46.660704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3ba48-2950-4838-bcd6-e44efaef85e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:46.660985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3ba48-2950-4838-bcd6-e44efaef85e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:46.661258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3ba48-2950-4838-bcd6-e44efaef85e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:46.723808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3ba48-2950-4838-bcd6-e44efaef85e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:46.725328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3ba48-2950-4838-bcd6-e44efaef85e1 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:46.735236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1267/2513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:20:50.208311 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bef683-8246-4a9a-8b21-4d7e8859224d service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:50.282271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bef683-8246-4a9a-8b21-4d7e8859224d service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:50.288087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:50.288760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:50.289029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:50.289293 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] PATH_INFO: `/v3/users/c3fd320d6426468b986a9b7f59e01a8e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:50.290556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3fd320d6426468b986a9b7f59e01a8e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:50.292588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:50.342666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3fd320d6426468b986a9b7f59e01a8e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:50.343447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3fd320d6426468b986a9b7f59e01a8e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:50.350563 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3fd320d6426468b986a9b7f59e01a8e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:50.351192 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3fd320d6426468b986a9b7f59e01a8e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:50.364583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3fd320d6426468b986a9b7f59e01a8e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:50.366244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:50.381487 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1247/2514] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:20:50 2022] DELETE /identity/v3/users/c3fd320d6426468b986a9b7f59e01a8e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:50.386460 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce76e-fc36-423c-b974-d70ead3e9156 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:50.386964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce76e-fc36-423c-b974-d70ead3e9156 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:50.387072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce76e-fc36-423c-b974-d70ead3e9156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:50.407159 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e96ce76e-fc36-423c-b974-d70ead3e9156 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:50.408428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e96ce76e-fc36-423c-b974-d70ead3e9156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:50.471814 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1268/2515] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:50.481858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:50.483578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:50.558139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeadfa-b4e6-4cab-a52b-d2c7f41649b2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:50.562029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc056db-218f-4eb1-91b4-545256260e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:50.562685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc056db-218f-4eb1-91b4-545256260e8c service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:50.562964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc056db-218f-4eb1-91b4-545256260e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:50.563267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc056db-218f-4eb1-91b4-545256260e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:50.572939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc056db-218f-4eb1-91b4-545256260e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:50.574431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc056db-218f-4eb1-91b4-545256260e8c service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:50.584601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1248/2516] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:20:50.875491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce76e-fc36-423c-b974-d70ead3e9156 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:50.877042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e96ce76e-fc36-423c-b974-d70ead3e9156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:50.894552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce76e-fc36-423c-b974-d70ead3e9156 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:50.899989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:50.900629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:50.900907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:50.901206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] PATH_INFO: `/v3/projects/0885edbf920f41f0a64fb7563a2fc822` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:50.902591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0885edbf920f41f0a64fb7563a2fc822)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:50.904673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:50.959593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0885edbf920f41f0a64fb7563a2fc822', 'request_id': 'req-2bc55ae0-a017-41af-98b3-aa0347e31edd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:50.965047 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0885edbf920f41f0a64fb7563a2fc822', 'request_id': 'req-2bc55ae0-a017-41af-98b3-aa0347e31edd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:50.971117 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0885edbf920f41f0a64fb7563a2fc822', 'request_id': 'req-2bc55ae0-a017-41af-98b3-aa0347e31edd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:50.973596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:50.988790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] The token cache is being invalidate because project 0885edbf920f41f0a64fb7563a2fc822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:20:50.989114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:50.989724 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:50.991261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1269/2517] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:20:50 2022] DELETE /identity/v3/projects/0885edbf920f41f0a64fb7563a2fc822 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:50.995429 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc056db-218f-4eb1-91b4-545256260e8c service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:51.006342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc056db-218f-4eb1-91b4-545256260e8c service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:51.074914 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb6fa6-b075-4177-a174-42cdfd0d02a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:51.075549 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb6fa6-b075-4177-a174-42cdfd0d02a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:51.075828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb6fa6-b075-4177-a174-42cdfd0d02a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:51.076100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb6fa6-b075-4177-a174-42cdfd0d02a3 admin admin] PATH_INFO: `/v3/users/6c4cf0f756884b2eb7f8ab19bf0ca1df` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:51.077498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb6fa6-b075-4177-a174-42cdfd0d02a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c4cf0f756884b2eb7f8ab19bf0ca1df)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:51.079471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb6fa6-b075-4177-a174-42cdfd0d02a3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:51.134104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-92bb6fa6-b075-4177-a174-42cdfd0d02a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c4cf0f756884b2eb7f8ab19bf0ca1df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:51.134686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-92bb6fa6-b075-4177-a174-42cdfd0d02a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c4cf0f756884b2eb7f8ab19bf0ca1df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:51.142740 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-92bb6fa6-b075-4177-a174-42cdfd0d02a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c4cf0f756884b2eb7f8ab19bf0ca1df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:51.143382 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-92bb6fa6-b075-4177-a174-42cdfd0d02a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c4cf0f756884b2eb7f8ab19bf0ca1df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:51.155847 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-92bb6fa6-b075-4177-a174-42cdfd0d02a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c4cf0f756884b2eb7f8ab19bf0ca1df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:51.170220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1249/2518] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:20:50 2022] DELETE /identity/v3/users/6c4cf0f756884b2eb7f8ab19bf0ca1df => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:51.453154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:51.454682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:51.467745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc55ae0-a017-41af-98b3-aa0347e31edd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:51.526774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b12229-f113-48c8-b986-7d8515d8856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:51.527406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b12229-f113-48c8-b986-7d8515d8856a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:51.527681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b12229-f113-48c8-b986-7d8515d8856a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:51.527947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b12229-f113-48c8-b986-7d8515d8856a admin admin] PATH_INFO: `/v3/projects/7791d18c71b14fb9b9051b824b28eaef` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:51.529142 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b12229-f113-48c8-b986-7d8515d8856a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7791d18c71b14fb9b9051b824b28eaef)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:51.531132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b12229-f113-48c8-b986-7d8515d8856a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:51.582164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-12b12229-f113-48c8-b986-7d8515d8856a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7791d18c71b14fb9b9051b824b28eaef', 'request_id': 'req-12b12229-f113-48c8-b986-7d8515d8856a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:51.587604 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-12b12229-f113-48c8-b986-7d8515d8856a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7791d18c71b14fb9b9051b824b28eaef', 'request_id': 'req-12b12229-f113-48c8-b986-7d8515d8856a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:51.593909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-12b12229-f113-48c8-b986-7d8515d8856a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7791d18c71b14fb9b9051b824b28eaef', 'request_id': 'req-12b12229-f113-48c8-b986-7d8515d8856a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:51.606678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-12b12229-f113-48c8-b986-7d8515d8856a admin admin] The token cache is being invalidate because project 7791d18c71b14fb9b9051b824b28eaef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:20:51.606963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-12b12229-f113-48c8-b986-7d8515d8856a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:51.607586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-12b12229-f113-48c8-b986-7d8515d8856a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:51.609166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1270/2519] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:20:51 2022] DELETE /identity/v3/projects/7791d18c71b14fb9b9051b824b28eaef => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:51.614401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e22e93-0116-4186-b36a-c91fa1e9ec9f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:51.614870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e22e93-0116-4186-b36a-c91fa1e9ec9f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:51.614964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e22e93-0116-4186-b36a-c91fa1e9ec9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:51.623337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:51.638992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-32e22e93-0116-4186-b36a-c91fa1e9ec9f None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:51.640264 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-32e22e93-0116-4186-b36a-c91fa1e9ec9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:51.713347 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1250/2520] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:51.721407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7864-2eb1-443f-9de8-f4ebb84dcc81 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:51.721672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7864-2eb1-443f-9de8-f4ebb84dcc81 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:51.721966 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7864-2eb1-443f-9de8-f4ebb84dcc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:51.743633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7a1e7864-2eb1-443f-9de8-f4ebb84dcc81 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:51.744896 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7a1e7864-2eb1-443f-9de8-f4ebb84dcc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:51.754549 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1271/2521] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:51.759634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e22e93-0116-4186-b36a-c91fa1e9ec9f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:51.777045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e22e93-0116-4186-b36a-c91fa1e9ec9f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:51.784632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b20dc-7900-49fb-ab10-a56786f6c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:51.785238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b20dc-7900-49fb-ab10-a56786f6c2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:51.785510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b20dc-7900-49fb-ab10-a56786f6c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:51.785778 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b20dc-7900-49fb-ab10-a56786f6c2e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:51.786424 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b20dc-7900-49fb-ab10-a56786f6c2e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:20:51.786732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b20dc-7900-49fb-ab10-a56786f6c2e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:51.788414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b20dc-7900-49fb-ab10-a56786f6c2e5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:51.801309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1251/2522] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:20:51.806172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e7864-2eb1-443f-9de8-f4ebb84dcc81 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:51.815943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e7864-2eb1-443f-9de8-f4ebb84dcc81 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:51.821701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb35aa9-315e-4177-a201-b1d8f7ffddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:51.822293 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb35aa9-315e-4177-a201-b1d8f7ffddf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:51.822564 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb35aa9-315e-4177-a201-b1d8f7ffddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:51.822830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb35aa9-315e-4177-a201-b1d8f7ffddf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:51.823457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb35aa9-315e-4177-a201-b1d8f7ffddf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:51.825447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb35aa9-315e-4177-a201-b1d8f7ffddf4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:51.855297 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1272/2523] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:20:51 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:20:51.859638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b20dc-7900-49fb-ab10-a56786f6c2e5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:51.869629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b20dc-7900-49fb-ab10-a56786f6c2e5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:51.926097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5653b3c-f676-4d6c-9238-1ec431ce5f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:51.926697 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5653b3c-f676-4d6c-9238-1ec431ce5f32 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:51.926975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5653b3c-f676-4d6c-9238-1ec431ce5f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:51.927234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5653b3c-f676-4d6c-9238-1ec431ce5f32 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:51.927864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5653b3c-f676-4d6c-9238-1ec431ce5f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:51.929864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5653b3c-f676-4d6c-9238-1ec431ce5f32 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:51.952871 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1252/2524] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:20:51 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:20:51.957217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb35aa9-315e-4177-a201-b1d8f7ffddf4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:51.967939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb35aa9-315e-4177-a201-b1d8f7ffddf4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:51.973198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b270ca8-7408-408d-bc7d-5511fd2184ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:51.973800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b270ca8-7408-408d-bc7d-5511fd2184ca admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:51.974177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b270ca8-7408-408d-bc7d-5511fd2184ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:51.974441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b270ca8-7408-408d-bc7d-5511fd2184ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:51.975081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b270ca8-7408-408d-bc7d-5511fd2184ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:51.976937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b270ca8-7408-408d-bc7d-5511fd2184ca admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:51.987721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1273/2525] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:20:51.991793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5653b3c-f676-4d6c-9238-1ec431ce5f32 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:52.002744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5653b3c-f676-4d6c-9238-1ec431ce5f32 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:52.007516 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd37eed-d5f4-4226-96b6-01935d77265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:52.008114 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd37eed-d5f4-4226-96b6-01935d77265c admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:52.008414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd37eed-d5f4-4226-96b6-01935d77265c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:52.008683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd37eed-d5f4-4226-96b6-01935d77265c admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:52.009320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd37eed-d5f4-4226-96b6-01935d77265c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:52.011312 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd37eed-d5f4-4226-96b6-01935d77265c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:52.022603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1253/2526] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:20:52.027286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b270ca8-7408-408d-bc7d-5511fd2184ca admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:52.038402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b270ca8-7408-408d-bc7d-5511fd2184ca admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:52.043099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22444029-5815-4eff-9843-9e48aa6e5424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:52.043756 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444029-5815-4eff-9843-9e48aa6e5424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:52.044028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444029-5815-4eff-9843-9e48aa6e5424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:52.044307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444029-5815-4eff-9843-9e48aa6e5424 admin admin] PATH_INFO: `/v3/projects/99029114de11407e914158ebd8662194/users/7fbb423d16e84075b9da1f6f23b93b7d/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:52.059301 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22444029-5815-4eff-9843-9e48aa6e5424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99029114de11407e914158ebd8662194, user_id=7fbb423d16e84075b9da1f6f23b93b7d, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:52.062550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22444029-5815-4eff-9843-9e48aa6e5424 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:52.077856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1274/2527] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:20:52 2022] PUT /identity/v3/projects/99029114de11407e914158ebd8662194/users/7fbb423d16e84075b9da1f6f23b93b7d/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:52.089756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59730a-f504-4d56-9a5c-eeb0aade6689 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:52.090040 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59730a-f504-4d56-9a5c-eeb0aade6689 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:52.090311 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59730a-f504-4d56-9a5c-eeb0aade6689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:52.120748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-cb59730a-f504-4d56-9a5c-eeb0aade6689 None None] MFA Rules not processed for user `7fbb423d16e84075b9da1f6f23b93b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:52.122055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cb59730a-f504-4d56-9a5c-eeb0aade6689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:52.186578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:52.192115 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1254/2528] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:52.197541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22444029-5815-4eff-9843-9e48aa6e5424 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:52.220505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:52.264470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22444029-5815-4eff-9843-9e48aa6e5424 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:52.270064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d513f0c-3fc2-4fc6-8558-ffe0b3969530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:52.270676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d513f0c-3fc2-4fc6-8558-ffe0b3969530 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:52.270956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d513f0c-3fc2-4fc6-8558-ffe0b3969530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:52.271224 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d513f0c-3fc2-4fc6-8558-ffe0b3969530 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:52.271852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d513f0c-3fc2-4fc6-8558-ffe0b3969530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:52.273894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d513f0c-3fc2-4fc6-8558-ffe0b3969530 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:52.305554 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1275/2529] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:20:52 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:20:52.306772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59730a-f504-4d56-9a5c-eeb0aade6689 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:52.318338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59730a-f504-4d56-9a5c-eeb0aade6689 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:52.388738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8eb98-5662-4011-b442-bc99b792a612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:52.389473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8eb98-5662-4011-b442-bc99b792a612 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:52.389756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8eb98-5662-4011-b442-bc99b792a612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:52.390018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8eb98-5662-4011-b442-bc99b792a612 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:52.390694 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8eb98-5662-4011-b442-bc99b792a612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:52.392696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8eb98-5662-4011-b442-bc99b792a612 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:52.421862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1255/2530] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:20:52 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:20:52.425941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d513f0c-3fc2-4fc6-8558-ffe0b3969530 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:52.436920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d513f0c-3fc2-4fc6-8558-ffe0b3969530 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:52.442371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bcf94-e35b-4faa-b024-9db05d236c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:52.443001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bcf94-e35b-4faa-b024-9db05d236c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:52.443285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bcf94-e35b-4faa-b024-9db05d236c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:52.443551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bcf94-e35b-4faa-b024-9db05d236c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:52.444195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bcf94-e35b-4faa-b024-9db05d236c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:52.445915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bcf94-e35b-4faa-b024-9db05d236c04 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:52.457261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1276/2531] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:20:52.462677 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8eb98-5662-4011-b442-bc99b792a612 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:52.473495 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8eb98-5662-4011-b442-bc99b792a612 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:52.479030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6817a-7a57-4c82-98b6-c49591fcbfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:52.479690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6817a-7a57-4c82-98b6-c49591fcbfc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:52.479966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6817a-7a57-4c82-98b6-c49591fcbfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:52.480238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6817a-7a57-4c82-98b6-c49591fcbfc9 admin admin] PATH_INFO: `/v3/projects/81ded0c970b94ff0a726ac88b165e496/users/318bd178f5194856bb6bf8ef1f85b4df/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:52.496333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6817a-7a57-4c82-98b6-c49591fcbfc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ded0c970b94ff0a726ac88b165e496, user_id=318bd178f5194856bb6bf8ef1f85b4df, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:52.499142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6817a-7a57-4c82-98b6-c49591fcbfc9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:52.517054 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1256/2532] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:20:52 2022] PUT /identity/v3/projects/81ded0c970b94ff0a726ac88b165e496/users/318bd178f5194856bb6bf8ef1f85b4df/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:52.523567 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bcf94-e35b-4faa-b024-9db05d236c04 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:52.536909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bcf94-e35b-4faa-b024-9db05d236c04 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:52.599881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa25e1-f04e-4a79-8e63-23b3c60cb685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:52.600526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa25e1-f04e-4a79-8e63-23b3c60cb685 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:52.600817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa25e1-f04e-4a79-8e63-23b3c60cb685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:52.601072 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa25e1-f04e-4a79-8e63-23b3c60cb685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:52.601710 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa25e1-f04e-4a79-8e63-23b3c60cb685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:52.603412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa25e1-f04e-4a79-8e63-23b3c60cb685 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:52.613601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1277/2533] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:20:52.618092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6817a-7a57-4c82-98b6-c49591fcbfc9 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:52.630071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6817a-7a57-4c82-98b6-c49591fcbfc9 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:52.637129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab79bb-687d-483f-ba6d-29f245159fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:52.638106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab79bb-687d-483f-ba6d-29f245159fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:52.638485 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab79bb-687d-483f-ba6d-29f245159fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:52.638856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab79bb-687d-483f-ba6d-29f245159fa3 admin admin] PATH_INFO: `/v3/projects/81ded0c970b94ff0a726ac88b165e496/users/318bd178f5194856bb6bf8ef1f85b4df/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:52.642870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab79bb-687d-483f-ba6d-29f245159fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ded0c970b94ff0a726ac88b165e496, user_id=318bd178f5194856bb6bf8ef1f85b4df, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:52.647139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab79bb-687d-483f-ba6d-29f245159fa3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:52.661045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1257/2534] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:20:52 2022] PUT /identity/v3/projects/81ded0c970b94ff0a726ac88b165e496/users/318bd178f5194856bb6bf8ef1f85b4df/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:52.671375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055a42e-e326-492c-b6e8-e2dfaf89e1ae None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:52.671667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055a42e-e326-492c-b6e8-e2dfaf89e1ae None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:52.671961 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055a42e-e326-492c-b6e8-e2dfaf89e1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:52.701962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b055a42e-e326-492c-b6e8-e2dfaf89e1ae None None] MFA Rules not processed for user `318bd178f5194856bb6bf8ef1f85b4df`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:52.703190 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b055a42e-e326-492c-b6e8-e2dfaf89e1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:52.773785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1278/2535] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:52.786101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab79bb-687d-483f-ba6d-29f245159fa3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:52.788025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3eab79bb-687d-483f-ba6d-29f245159fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:52.858425 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab79bb-687d-483f-ba6d-29f245159fa3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:52.863039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056fe78-b000-4b4f-9bd9-0022c82f4e43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:52.863658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056fe78-b000-4b4f-9bd9-0022c82f4e43 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:52.863897 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056fe78-b000-4b4f-9bd9-0022c82f4e43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:52.864203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056fe78-b000-4b4f-9bd9-0022c82f4e43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:52.874535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056fe78-b000-4b4f-9bd9-0022c82f4e43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:52.876022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056fe78-b000-4b4f-9bd9-0022c82f4e43 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:52.886331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1258/2536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:20:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:20:52.980137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055a42e-e326-492c-b6e8-e2dfaf89e1ae None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:52.990638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055a42e-e326-492c-b6e8-e2dfaf89e1ae None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:52.994900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dd1f0-a8f9-48fe-bd7d-dcb3a151e4de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:52.995532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dd1f0-a8f9-48fe-bd7d-dcb3a151e4de service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:52.995784 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dd1f0-a8f9-48fe-bd7d-dcb3a151e4de service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:52.996090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dd1f0-a8f9-48fe-bd7d-dcb3a151e4de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:53.009062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:53.057365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dd1f0-a8f9-48fe-bd7d-dcb3a151e4de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:53.058916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dd1f0-a8f9-48fe-bd7d-dcb3a151e4de service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:53.067858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1279/2537] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:20:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:20:53.359668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056fe78-b000-4b4f-9bd9-0022c82f4e43 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:53.426212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:53.438431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056fe78-b000-4b4f-9bd9-0022c82f4e43 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:53.443087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:53.443715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:53.443988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:53.444256 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] PATH_INFO: `/v3/users/7fbb423d16e84075b9da1f6f23b93b7d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:53.445404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fbb423d16e84075b9da1f6f23b93b7d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:53.447381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:53.503852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fbb423d16e84075b9da1f6f23b93b7d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:53.504587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fbb423d16e84075b9da1f6f23b93b7d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:53.512229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fbb423d16e84075b9da1f6f23b93b7d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:53.512923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fbb423d16e84075b9da1f6f23b93b7d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:53.526572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fbb423d16e84075b9da1f6f23b93b7d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:53.542888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1259/2538] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:20:53 2022] DELETE /identity/v3/users/7fbb423d16e84075b9da1f6f23b93b7d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:53.547550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93f5cd-439f-4f83-ba07-957e2ed2d910 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:53.548044 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93f5cd-439f-4f83-ba07-957e2ed2d910 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:53.548142 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93f5cd-439f-4f83-ba07-957e2ed2d910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:53.568136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-de93f5cd-439f-4f83-ba07-957e2ed2d910 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:53.569372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-de93f5cd-439f-4f83-ba07-957e2ed2d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:53.632376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1280/2539] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:53.643092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:53.644717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:53.708602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dcc27-d61e-4ebd-a1f1-20e4d5daaeaf admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:53.712490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced666-7788-4744-9860-d525df213c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:53.713104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced666-7788-4744-9860-d525df213c49 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:53.713384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced666-7788-4744-9860-d525df213c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:53.713656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced666-7788-4744-9860-d525df213c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:53.723206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbced666-7788-4744-9860-d525df213c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:53.724742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbced666-7788-4744-9860-d525df213c49 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:53.734822 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1260/2540] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:20:54.014900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93f5cd-439f-4f83-ba07-957e2ed2d910 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:54.017109 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-de93f5cd-439f-4f83-ba07-957e2ed2d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:54.029555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93f5cd-439f-4f83-ba07-957e2ed2d910 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:54.035955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:54.036641 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:54.036918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:54.037179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] PATH_INFO: `/v3/projects/99029114de11407e914158ebd8662194` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:54.038451 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99029114de11407e914158ebd8662194)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:54.044946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:54.104106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99029114de11407e914158ebd8662194', 'request_id': 'req-fbc9103b-4952-47bd-8098-bba319a68fa9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.110305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99029114de11407e914158ebd8662194', 'request_id': 'req-fbc9103b-4952-47bd-8098-bba319a68fa9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.116689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99029114de11407e914158ebd8662194', 'request_id': 'req-fbc9103b-4952-47bd-8098-bba319a68fa9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.133201 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] The token cache is being invalidate because project 99029114de11407e914158ebd8662194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:20:54.133402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.134081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.136020 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1281/2541] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:20:54 2022] DELETE /identity/v3/projects/99029114de11407e914158ebd8662194 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:20:54.141889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced666-7788-4744-9860-d525df213c49 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:54.151796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced666-7788-4744-9860-d525df213c49 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:54.212160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ef145-af06-42dd-92de-e77aa9d3aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:54.212844 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ef145-af06-42dd-92de-e77aa9d3aa58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:54.213122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ef145-af06-42dd-92de-e77aa9d3aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:54.213388 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ef145-af06-42dd-92de-e77aa9d3aa58 admin admin] PATH_INFO: `/v3/users/318bd178f5194856bb6bf8ef1f85b4df` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:54.214648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ef145-af06-42dd-92de-e77aa9d3aa58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=318bd178f5194856bb6bf8ef1f85b4df)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:54.216721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ef145-af06-42dd-92de-e77aa9d3aa58 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:54.234420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:54.269623 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c94ef145-af06-42dd-92de-e77aa9d3aa58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '318bd178f5194856bb6bf8ef1f85b4df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.270282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c94ef145-af06-42dd-92de-e77aa9d3aa58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '318bd178f5194856bb6bf8ef1f85b4df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.277189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c94ef145-af06-42dd-92de-e77aa9d3aa58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '318bd178f5194856bb6bf8ef1f85b4df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.277823 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c94ef145-af06-42dd-92de-e77aa9d3aa58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '318bd178f5194856bb6bf8ef1f85b4df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.289586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c94ef145-af06-42dd-92de-e77aa9d3aa58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '318bd178f5194856bb6bf8ef1f85b4df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.307966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1261/2542] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:20:54 2022] DELETE /identity/v3/users/318bd178f5194856bb6bf8ef1f85b4df => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:54.600007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:54.601769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:54.618135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9103b-4952-47bd-8098-bba319a68fa9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:54.656838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:54.680106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fe2d6-831a-4246-b094-059efa151e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:54.680771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fe2d6-831a-4246-b094-059efa151e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:54.681043 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fe2d6-831a-4246-b094-059efa151e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:54.681313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fe2d6-831a-4246-b094-059efa151e64 admin admin] PATH_INFO: `/v3/projects/81ded0c970b94ff0a726ac88b165e496` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:54.682417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fe2d6-831a-4246-b094-059efa151e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ded0c970b94ff0a726ac88b165e496)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:54.684419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fe2d6-831a-4246-b094-059efa151e64 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:54.732522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-836fe2d6-831a-4246-b094-059efa151e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ded0c970b94ff0a726ac88b165e496', 'request_id': 'req-836fe2d6-831a-4246-b094-059efa151e64'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.738411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-836fe2d6-831a-4246-b094-059efa151e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ded0c970b94ff0a726ac88b165e496', 'request_id': 'req-836fe2d6-831a-4246-b094-059efa151e64'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.744712 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-836fe2d6-831a-4246-b094-059efa151e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ded0c970b94ff0a726ac88b165e496', 'request_id': 'req-836fe2d6-831a-4246-b094-059efa151e64'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.758679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-836fe2d6-831a-4246-b094-059efa151e64 admin admin] The token cache is being invalidate because project 81ded0c970b94ff0a726ac88b165e496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:20:54.758965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-836fe2d6-831a-4246-b094-059efa151e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.759575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-836fe2d6-831a-4246-b094-059efa151e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:20:54.761723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1282/2543] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:20:54 2022] DELETE /identity/v3/projects/81ded0c970b94ff0a726ac88b165e496 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:54.768106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c9e89-3e55-4670-833e-c982c3674857 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:54.768615 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c9e89-3e55-4670-833e-c982c3674857 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:54.768728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c9e89-3e55-4670-833e-c982c3674857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:54.789236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-906c9e89-3e55-4670-833e-c982c3674857 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:54.790467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-906c9e89-3e55-4670-833e-c982c3674857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:54.852812 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1262/2544] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:54.860886 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c49dfa-902c-458d-a9e3-729da8b891ff None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:54.861175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c49dfa-902c-458d-a9e3-729da8b891ff None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:54.861445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c49dfa-902c-458d-a9e3-729da8b891ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:54.882375 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e5c49dfa-902c-458d-a9e3-729da8b891ff None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:54.883580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e5c49dfa-902c-458d-a9e3-729da8b891ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:54.892267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1283/2545] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:54.896777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c9e89-3e55-4670-833e-c982c3674857 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:54.907281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c9e89-3e55-4670-833e-c982c3674857 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:54.912634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2de8e6-1461-4169-b38a-6ab3db3633c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:54.913244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2de8e6-1461-4169-b38a-6ab3db3633c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:54.913524 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2de8e6-1461-4169-b38a-6ab3db3633c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:54.913799 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2de8e6-1461-4169-b38a-6ab3db3633c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:54.914461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2de8e6-1461-4169-b38a-6ab3db3633c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:20:54.914759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2de8e6-1461-4169-b38a-6ab3db3633c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:54.916477 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2de8e6-1461-4169-b38a-6ab3db3633c0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:54.928535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1263/2546] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:20:54.932839 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c49dfa-902c-458d-a9e3-729da8b891ff None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:54.942299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c49dfa-902c-458d-a9e3-729da8b891ff None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:54.947092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90512ece-1c20-4480-acc6-730daef848fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:54.947689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90512ece-1c20-4480-acc6-730daef848fe admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:54.947966 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90512ece-1c20-4480-acc6-730daef848fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:54.948238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90512ece-1c20-4480-acc6-730daef848fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:54.948911 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90512ece-1c20-4480-acc6-730daef848fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:54.950880 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90512ece-1c20-4480-acc6-730daef848fe admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:54.985193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1284/2547] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:20:54 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:20:54.989341 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2de8e6-1461-4169-b38a-6ab3db3633c0 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:55.000003 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2de8e6-1461-4169-b38a-6ab3db3633c0 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:55.060424 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4dc1e-721d-4a3f-89f2-3c438a3a0566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:55.061035 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4dc1e-721d-4a3f-89f2-3c438a3a0566 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:55.061330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4dc1e-721d-4a3f-89f2-3c438a3a0566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:55.061598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4dc1e-721d-4a3f-89f2-3c438a3a0566 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:55.062479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4dc1e-721d-4a3f-89f2-3c438a3a0566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:55.064493 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4dc1e-721d-4a3f-89f2-3c438a3a0566 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:55.087969 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1264/2548] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:20:54 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:20:55.092259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90512ece-1c20-4480-acc6-730daef848fe admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:55.102751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90512ece-1c20-4480-acc6-730daef848fe admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:55.108457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b95be1-5443-4144-9ceb-04f9056f656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:55.109236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b95be1-5443-4144-9ceb-04f9056f656d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:55.109519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b95be1-5443-4144-9ceb-04f9056f656d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:55.109816 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b95be1-5443-4144-9ceb-04f9056f656d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:55.110505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b95be1-5443-4144-9ceb-04f9056f656d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:55.112489 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b95be1-5443-4144-9ceb-04f9056f656d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:55.122506 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1285/2549] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:20:55.126605 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4dc1e-721d-4a3f-89f2-3c438a3a0566 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:55.137259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4dc1e-721d-4a3f-89f2-3c438a3a0566 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:55.142471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724d9da-e610-4a06-abad-b2695f1f5b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:55.143076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724d9da-e610-4a06-abad-b2695f1f5b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:55.143355 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724d9da-e610-4a06-abad-b2695f1f5b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:55.143630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724d9da-e610-4a06-abad-b2695f1f5b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:55.144274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724d9da-e610-4a06-abad-b2695f1f5b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:55.145959 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724d9da-e610-4a06-abad-b2695f1f5b70 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:55.151424 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:55.158058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1265/2550] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:20:55.163157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b95be1-5443-4144-9ceb-04f9056f656d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:55.176105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b95be1-5443-4144-9ceb-04f9056f656d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:55.181579 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505697c2-5393-42a7-993d-882e62ab30a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:55.182231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505697c2-5393-42a7-993d-882e62ab30a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:55.182536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505697c2-5393-42a7-993d-882e62ab30a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:55.182830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505697c2-5393-42a7-993d-882e62ab30a4 admin admin] PATH_INFO: `/v3/projects/d9e0d81f020d489cb2e6d17b93809887/users/bf41d3a9cc17416aba4226c44d0d3ef0/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:55.198037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505697c2-5393-42a7-993d-882e62ab30a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e0d81f020d489cb2e6d17b93809887, user_id=bf41d3a9cc17416aba4226c44d0d3ef0, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:55.200781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505697c2-5393-42a7-993d-882e62ab30a4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:55.216399 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1286/2551] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:20:55 2022] PUT /identity/v3/projects/d9e0d81f020d489cb2e6d17b93809887/users/bf41d3a9cc17416aba4226c44d0d3ef0/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:20:55.228803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baea079-35ec-4bfd-9fdf-6a1c22b673fe None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:55.229080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baea079-35ec-4bfd-9fdf-6a1c22b673fe None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:55.229362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baea079-35ec-4bfd-9fdf-6a1c22b673fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:55.261213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4baea079-35ec-4bfd-9fdf-6a1c22b673fe None None] MFA Rules not processed for user `bf41d3a9cc17416aba4226c44d0d3ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:20:55.262540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4baea079-35ec-4bfd-9fdf-6a1c22b673fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:55.330779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1266/2552] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:20:55.344583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505697c2-5393-42a7-993d-882e62ab30a4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:20:55.347863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-505697c2-5393-42a7-993d-882e62ab30a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:20:55.412630 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505697c2-5393-42a7-993d-882e62ab30a4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:20:55.419238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca95df-f494-43f6-add9-9df231e347da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:20:55.420114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca95df-f494-43f6-add9-9df231e347da service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:20:55.420481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca95df-f494-43f6-add9-9df231e347da service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:20:55.420827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca95df-f494-43f6-add9-9df231e347da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:20:55.431014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca95df-f494-43f6-add9-9df231e347da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:20:55.432537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca95df-f494-43f6-add9-9df231e347da service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:20:55.442027 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1287/2553] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:20:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:00.904513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baea079-35ec-4bfd-9fdf-6a1c22b673fe None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:00.973397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baea079-35ec-4bfd-9fdf-6a1c22b673fe None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:00.979565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:00.980209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:00.980521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:00.980796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] PATH_INFO: `/v3/users/bf41d3a9cc17416aba4226c44d0d3ef0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:00.981946 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf41d3a9cc17416aba4226c44d0d3ef0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:00.983988 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:01.040913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf41d3a9cc17416aba4226c44d0d3ef0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:01.041656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf41d3a9cc17416aba4226c44d0d3ef0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:01.050853 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf41d3a9cc17416aba4226c44d0d3ef0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:01.051401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf41d3a9cc17416aba4226c44d0d3ef0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:01.064516 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf41d3a9cc17416aba4226c44d0d3ef0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:01.088496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1267/2554] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:21:00 2022] DELETE /identity/v3/users/bf41d3a9cc17416aba4226c44d0d3ef0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:01.094023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988cdca-a417-4e4f-8f22-ff5da9944bae None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:01.094743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988cdca-a417-4e4f-8f22-ff5da9944bae None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:01.094743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988cdca-a417-4e4f-8f22-ff5da9944bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:01.113479 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:01.119842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9988cdca-a417-4e4f-8f22-ff5da9944bae None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:01.122211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9988cdca-a417-4e4f-8f22-ff5da9944bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:01.183964 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1288/2555] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:01.194207 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:01.195758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:01.207948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:01.260322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18549491-730d-4c12-8a23-77ae12561465 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:01.264510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fadaf7-9eb2-4a37-b6cf-431ef8539a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:01.265174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fadaf7-9eb2-4a37-b6cf-431ef8539a54 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:01.265583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fadaf7-9eb2-4a37-b6cf-431ef8539a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:01.265835 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fadaf7-9eb2-4a37-b6cf-431ef8539a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:01.275364 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fadaf7-9eb2-4a37-b6cf-431ef8539a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:01.276877 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fadaf7-9eb2-4a37-b6cf-431ef8539a54 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:01.286573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1268/2556] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:01.569197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988cdca-a417-4e4f-8f22-ff5da9944bae None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:01.570770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9988cdca-a417-4e4f-8f22-ff5da9944bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:01.584012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988cdca-a417-4e4f-8f22-ff5da9944bae None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:01.588916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb379e-9a28-4f6f-9399-9933033ca263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:01.589613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb379e-9a28-4f6f-9399-9933033ca263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:01.590161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb379e-9a28-4f6f-9399-9933033ca263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:01.590527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb379e-9a28-4f6f-9399-9933033ca263 admin admin] PATH_INFO: `/v3/projects/d9e0d81f020d489cb2e6d17b93809887` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:01.591762 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb379e-9a28-4f6f-9399-9933033ca263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e0d81f020d489cb2e6d17b93809887)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:01.594014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb379e-9a28-4f6f-9399-9933033ca263 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:01.643280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-82fb379e-9a28-4f6f-9399-9933033ca263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e0d81f020d489cb2e6d17b93809887', 'request_id': 'req-82fb379e-9a28-4f6f-9399-9933033ca263'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:01.649001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-82fb379e-9a28-4f6f-9399-9933033ca263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e0d81f020d489cb2e6d17b93809887', 'request_id': 'req-82fb379e-9a28-4f6f-9399-9933033ca263'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:01.655441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-82fb379e-9a28-4f6f-9399-9933033ca263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e0d81f020d489cb2e6d17b93809887', 'request_id': 'req-82fb379e-9a28-4f6f-9399-9933033ca263'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:01.671018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-82fb379e-9a28-4f6f-9399-9933033ca263 admin admin] The token cache is being invalidate because project d9e0d81f020d489cb2e6d17b93809887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:21:01.671437 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-82fb379e-9a28-4f6f-9399-9933033ca263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:01.672246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-82fb379e-9a28-4f6f-9399-9933033ca263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:01.673829 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1289/2557] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:21:01 2022] DELETE /identity/v3/projects/d9e0d81f020d489cb2e6d17b93809887 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:01.678953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312f157-48c3-4de9-a030-6f9a37339245 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:01.679330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312f157-48c3-4de9-a030-6f9a37339245 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:01.679624 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312f157-48c3-4de9-a030-6f9a37339245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:01.699642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9312f157-48c3-4de9-a030-6f9a37339245 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:01.700790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9312f157-48c3-4de9-a030-6f9a37339245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:01.763087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1269/2558] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:01.771282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50972ea9-71aa-4b24-a190-2881c0f73540 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:01.771562 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50972ea9-71aa-4b24-a190-2881c0f73540 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:01.771831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50972ea9-71aa-4b24-a190-2881c0f73540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:01.792355 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-50972ea9-71aa-4b24-a190-2881c0f73540 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:01.793634 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-50972ea9-71aa-4b24-a190-2881c0f73540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:01.804977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1290/2559] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:01.811752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312f157-48c3-4de9-a030-6f9a37339245 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:01.828036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312f157-48c3-4de9-a030-6f9a37339245 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:01.833670 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0aeca-bef9-49b2-8412-fb0906a8cb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:01.834349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0aeca-bef9-49b2-8412-fb0906a8cb48 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:01.834596 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0aeca-bef9-49b2-8412-fb0906a8cb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:01.834888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0aeca-bef9-49b2-8412-fb0906a8cb48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:01.835533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0aeca-bef9-49b2-8412-fb0906a8cb48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:21:01.835814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0aeca-bef9-49b2-8412-fb0906a8cb48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:01.837508 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0aeca-bef9-49b2-8412-fb0906a8cb48 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:01.849773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1270/2560] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:21:01.854331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50972ea9-71aa-4b24-a190-2881c0f73540 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:01.864034 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50972ea9-71aa-4b24-a190-2881c0f73540 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:01.870008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f65c37-c9e4-4f89-9ec0-5a0d1a9734f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:01.870598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f65c37-c9e4-4f89-9ec0-5a0d1a9734f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:01.870873 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f65c37-c9e4-4f89-9ec0-5a0d1a9734f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:01.871117 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f65c37-c9e4-4f89-9ec0-5a0d1a9734f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:01.871765 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f65c37-c9e4-4f89-9ec0-5a0d1a9734f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:01.873751 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f65c37-c9e4-4f89-9ec0-5a0d1a9734f7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:01.905387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1291/2561] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:01 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:01.909886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0aeca-bef9-49b2-8412-fb0906a8cb48 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:01.920989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0aeca-bef9-49b2-8412-fb0906a8cb48 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:01.978214 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45ebd-73fd-4003-a18f-018cdf368001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:01.978761 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45ebd-73fd-4003-a18f-018cdf368001 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:01.979039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45ebd-73fd-4003-a18f-018cdf368001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:01.979303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45ebd-73fd-4003-a18f-018cdf368001 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:01.979918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae45ebd-73fd-4003-a18f-018cdf368001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:01.981936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae45ebd-73fd-4003-a18f-018cdf368001 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:02.009155 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1271/2562] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:21:01 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:21:02.014759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f65c37-c9e4-4f89-9ec0-5a0d1a9734f7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:02.031252 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f65c37-c9e4-4f89-9ec0-5a0d1a9734f7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:02.036230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14014a-5300-4106-87f4-5fa1a1a329e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:02.036857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14014a-5300-4106-87f4-5fa1a1a329e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.037133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14014a-5300-4106-87f4-5fa1a1a329e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.037397 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14014a-5300-4106-87f4-5fa1a1a329e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.038043 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14014a-5300-4106-87f4-5fa1a1a329e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:02.039698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14014a-5300-4106-87f4-5fa1a1a329e5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:02.050221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1292/2563] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:02.054741 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45ebd-73fd-4003-a18f-018cdf368001 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:02.065383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45ebd-73fd-4003-a18f-018cdf368001 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:02.070790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9ea2d-3de5-469b-8850-8a4577624720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:02.071484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ea2d-3de5-469b-8850-8a4577624720 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.071755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ea2d-3de5-469b-8850-8a4577624720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.072021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ea2d-3de5-469b-8850-8a4577624720 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.072703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9ea2d-3de5-469b-8850-8a4577624720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:02.074351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9ea2d-3de5-469b-8850-8a4577624720 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:02.085460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1272/2564] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:02.090010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14014a-5300-4106-87f4-5fa1a1a329e5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:02.100232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14014a-5300-4106-87f4-5fa1a1a329e5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:02.105199 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d64585-6f61-4cf8-b67a-4de8b4e8a0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:02.105849 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d64585-6f61-4cf8-b67a-4de8b4e8a0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.106125 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d64585-6f61-4cf8-b67a-4de8b4e8a0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.106439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d64585-6f61-4cf8-b67a-4de8b4e8a0c2 admin admin] PATH_INFO: `/v3/projects/ff49e0ad074f4c9a9b9221cb8b5a02ed/users/983cfee52cef4a49b37c7891d56cfa57/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.121441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d64585-6f61-4cf8-b67a-4de8b4e8a0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff49e0ad074f4c9a9b9221cb8b5a02ed, user_id=983cfee52cef4a49b37c7891d56cfa57, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:02.124109 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d64585-6f61-4cf8-b67a-4de8b4e8a0c2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:02.139847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1293/2565] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:02 2022] PUT /identity/v3/projects/ff49e0ad074f4c9a9b9221cb8b5a02ed/users/983cfee52cef4a49b37c7891d56cfa57/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:21:02.151227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ef460-4691-408c-bd6e-0fddbd30e5c9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.151566 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ef460-4691-408c-bd6e-0fddbd30e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.151850 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ef460-4691-408c-bd6e-0fddbd30e5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.182515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-917ef460-4691-408c-bd6e-0fddbd30e5c9 None None] MFA Rules not processed for user `983cfee52cef4a49b37c7891d56cfa57`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:02.183719 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-917ef460-4691-408c-bd6e-0fddbd30e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:02.189506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:02.262712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1273/2566] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:02.267521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d64585-6f61-4cf8-b67a-4de8b4e8a0c2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:02.299203 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:02.338544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d64585-6f61-4cf8-b67a-4de8b4e8a0c2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:02.344452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b5980-49e7-4cfa-92ac-a4d8e5c083db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:02.345060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b5980-49e7-4cfa-92ac-a4d8e5c083db admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.345337 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b5980-49e7-4cfa-92ac-a4d8e5c083db admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.345607 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b5980-49e7-4cfa-92ac-a4d8e5c083db admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.346239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b5980-49e7-4cfa-92ac-a4d8e5c083db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:02.348200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b5980-49e7-4cfa-92ac-a4d8e5c083db admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:02.378282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1294/2567] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:02 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:02.384238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ef460-4691-408c-bd6e-0fddbd30e5c9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:02.398044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ef460-4691-408c-bd6e-0fddbd30e5c9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:02.458734 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c026218-8839-4657-b7dc-a70ce7a08a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:02.459368 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c026218-8839-4657-b7dc-a70ce7a08a89 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.459648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c026218-8839-4657-b7dc-a70ce7a08a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.459919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c026218-8839-4657-b7dc-a70ce7a08a89 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.460579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c026218-8839-4657-b7dc-a70ce7a08a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:02.462676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c026218-8839-4657-b7dc-a70ce7a08a89 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:02.486065 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1274/2568] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:21:02 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:02.490187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b5980-49e7-4cfa-92ac-a4d8e5c083db admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:02.500927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b5980-49e7-4cfa-92ac-a4d8e5c083db admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:02.509415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373c4b7-d86a-4cd5-8898-fb63fe86d74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:02.510640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373c4b7-d86a-4cd5-8898-fb63fe86d74c admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.511011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373c4b7-d86a-4cd5-8898-fb63fe86d74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.511348 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373c4b7-d86a-4cd5-8898-fb63fe86d74c admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.512244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373c4b7-d86a-4cd5-8898-fb63fe86d74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:02.514893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373c4b7-d86a-4cd5-8898-fb63fe86d74c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:02.525880 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1295/2569] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:02.530010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c026218-8839-4657-b7dc-a70ce7a08a89 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:02.540960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c026218-8839-4657-b7dc-a70ce7a08a89 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:02.547715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5af3-826f-4c3c-bb95-9b1c6d59012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:02.548377 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5af3-826f-4c3c-bb95-9b1c6d59012c admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.548653 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5af3-826f-4c3c-bb95-9b1c6d59012c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.548922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5af3-826f-4c3c-bb95-9b1c6d59012c admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.549574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d5af3-826f-4c3c-bb95-9b1c6d59012c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:02.551216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d5af3-826f-4c3c-bb95-9b1c6d59012c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:02.562107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1275/2570] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:02.566483 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373c4b7-d86a-4cd5-8898-fb63fe86d74c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:02.576725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373c4b7-d86a-4cd5-8898-fb63fe86d74c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:02.582030 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca80ea-fe30-4a1e-8b06-95581f3485d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:02.582644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca80ea-fe30-4a1e-8b06-95581f3485d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.582949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca80ea-fe30-4a1e-8b06-95581f3485d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.583219 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca80ea-fe30-4a1e-8b06-95581f3485d0 admin admin] PATH_INFO: `/v3/projects/394f60b02d41483a8dc9cc0058e9e6ab/users/51565c169b0046ffbcaebe7ff1c31c5a/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.602717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca80ea-fe30-4a1e-8b06-95581f3485d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394f60b02d41483a8dc9cc0058e9e6ab, user_id=51565c169b0046ffbcaebe7ff1c31c5a, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:02.605483 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca80ea-fe30-4a1e-8b06-95581f3485d0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:02.620654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1296/2571] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:02 2022] PUT /identity/v3/projects/394f60b02d41483a8dc9cc0058e9e6ab/users/51565c169b0046ffbcaebe7ff1c31c5a/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:02.631396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35abc-f927-4361-9988-9c887aceeabe None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.631649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35abc-f927-4361-9988-9c887aceeabe None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.631935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35abc-f927-4361-9988-9c887aceeabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.663533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-84f35abc-f927-4361-9988-9c887aceeabe None None] MFA Rules not processed for user `51565c169b0046ffbcaebe7ff1c31c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:02.664824 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-84f35abc-f927-4361-9988-9c887aceeabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:02.733562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1276/2572] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:02.738257 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca80ea-fe30-4a1e-8b06-95581f3485d0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:02.804135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca80ea-fe30-4a1e-8b06-95581f3485d0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:02.809436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de734760-e77c-4174-bae9-8e18d90837ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:02.810062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de734760-e77c-4174-bae9-8e18d90837ae admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.810341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de734760-e77c-4174-bae9-8e18d90837ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.810602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de734760-e77c-4174-bae9-8e18d90837ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.811264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de734760-e77c-4174-bae9-8e18d90837ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:02.813525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de734760-e77c-4174-bae9-8e18d90837ae admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:02.840012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1297/2573] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:02 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:02.844464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f35abc-f927-4361-9988-9c887aceeabe None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:02.855711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f35abc-f927-4361-9988-9c887aceeabe None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:02.868894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:02.923197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3297aaf-08e3-4b5f-8878-4f66572f1c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:02.923881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3297aaf-08e3-4b5f-8878-4f66572f1c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.924038 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3297aaf-08e3-4b5f-8878-4f66572f1c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.924336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3297aaf-08e3-4b5f-8878-4f66572f1c3d admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.924987 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3297aaf-08e3-4b5f-8878-4f66572f1c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:02.926938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3297aaf-08e3-4b5f-8878-4f66572f1c3d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:02.956657 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1277/2574] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:21:02 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:02.962185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de734760-e77c-4174-bae9-8e18d90837ae admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:02.973635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de734760-e77c-4174-bae9-8e18d90837ae admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:02.978850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4817e54-4285-48f9-9058-9ae308ee0626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:02.979450 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817e54-4285-48f9-9058-9ae308ee0626 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:02.979729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817e54-4285-48f9-9058-9ae308ee0626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:02.980005 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817e54-4285-48f9-9058-9ae308ee0626 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:02.980692 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4817e54-4285-48f9-9058-9ae308ee0626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:02.982378 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4817e54-4285-48f9-9058-9ae308ee0626 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:02.993261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1298/2575] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:02.999471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3297aaf-08e3-4b5f-8878-4f66572f1c3d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:03.010864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3297aaf-08e3-4b5f-8878-4f66572f1c3d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:03.016345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81586b-5462-4275-881d-7594aa4701f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:03.017039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81586b-5462-4275-881d-7594aa4701f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:03.017289 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81586b-5462-4275-881d-7594aa4701f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:03.017564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81586b-5462-4275-881d-7594aa4701f9 admin admin] PATH_INFO: `/v3/projects/ea85ad409c6243b1b4c23d007961998d/users/1ab8dc0862da4b95b005d60c76750dfe/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:03.035045 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81586b-5462-4275-881d-7594aa4701f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea85ad409c6243b1b4c23d007961998d, user_id=1ab8dc0862da4b95b005d60c76750dfe, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:03.037906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81586b-5462-4275-881d-7594aa4701f9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:03.058211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1278/2576] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:02 2022] PUT /identity/v3/projects/ea85ad409c6243b1b4c23d007961998d/users/1ab8dc0862da4b95b005d60c76750dfe/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:03.062438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4817e54-4285-48f9-9058-9ae308ee0626 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:03.072860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4817e54-4285-48f9-9058-9ae308ee0626 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:03.121000 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:03.131275 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b4688-11b2-4e0e-b580-9d0ee86fb9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:03.131906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b4688-11b2-4e0e-b580-9d0ee86fb9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:03.132184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b4688-11b2-4e0e-b580-9d0ee86fb9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:03.132490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b4688-11b2-4e0e-b580-9d0ee86fb9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:03.133135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b4688-11b2-4e0e-b580-9d0ee86fb9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:03.135158 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b4688-11b2-4e0e-b580-9d0ee86fb9e5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:03.147847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1299/2577] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:03.152005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81586b-5462-4275-881d-7594aa4701f9 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:03.162838 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81586b-5462-4275-881d-7594aa4701f9 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:03.167627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd477f76-255a-400d-9fa0-f65976854322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:03.168307 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd477f76-255a-400d-9fa0-f65976854322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:03.168585 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd477f76-255a-400d-9fa0-f65976854322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:03.168856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd477f76-255a-400d-9fa0-f65976854322 admin admin] PATH_INFO: `/v3/projects/ea85ad409c6243b1b4c23d007961998d/users/1ab8dc0862da4b95b005d60c76750dfe/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:03.170813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd477f76-255a-400d-9fa0-f65976854322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea85ad409c6243b1b4c23d007961998d, user_id=1ab8dc0862da4b95b005d60c76750dfe, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:03.173690 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd477f76-255a-400d-9fa0-f65976854322 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:03.184102 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1279/2578] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:03 2022] PUT /identity/v3/projects/ea85ad409c6243b1b4c23d007961998d/users/1ab8dc0862da4b95b005d60c76750dfe/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:03.194446 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f3979-e89c-4dc4-81b7-dacfbb354011 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:03.194738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f3979-e89c-4dc4-81b7-dacfbb354011 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:03.195015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f3979-e89c-4dc4-81b7-dacfbb354011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:03.223452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-381f3979-e89c-4dc4-81b7-dacfbb354011 None None] MFA Rules not processed for user `1ab8dc0862da4b95b005d60c76750dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:03.224704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-381f3979-e89c-4dc4-81b7-dacfbb354011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:03.294433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1300/2579] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:03.306650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd477f76-255a-400d-9fa0-f65976854322 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:03.312491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cd477f76-255a-400d-9fa0-f65976854322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:03.380712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd477f76-255a-400d-9fa0-f65976854322 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:03.385279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1500d3-6f56-4235-8673-a2438531c996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:03.385908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1500d3-6f56-4235-8673-a2438531c996 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:03.386181 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1500d3-6f56-4235-8673-a2438531c996 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:03.386451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1500d3-6f56-4235-8673-a2438531c996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:03.445437 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1500d3-6f56-4235-8673-a2438531c996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:03.446923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1500d3-6f56-4235-8673-a2438531c996 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:03.455955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1280/2580] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:04.997584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f3979-e89c-4dc4-81b7-dacfbb354011 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:04.999116 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-381f3979-e89c-4dc4-81b7-dacfbb354011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:05.012696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f3979-e89c-4dc4-81b7-dacfbb354011 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:05.017590 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52a341-1e91-435c-80b4-7b5b6b8f1d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:05.018229 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52a341-1e91-435c-80b4-7b5b6b8f1d12 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:05.018529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52a341-1e91-435c-80b4-7b5b6b8f1d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:05.018820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52a341-1e91-435c-80b4-7b5b6b8f1d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:05.078561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52a341-1e91-435c-80b4-7b5b6b8f1d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:05.080133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52a341-1e91-435c-80b4-7b5b6b8f1d12 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:05.089384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1301/2581] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:05.671582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1500d3-6f56-4235-8673-a2438531c996 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:05.680996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1500d3-6f56-4235-8673-a2438531c996 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:05.685567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e6ad-37e6-4ef5-8bc8-d87381f99be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:05.686173 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e6ad-37e6-4ef5-8bc8-d87381f99be2 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:05.686445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e6ad-37e6-4ef5-8bc8-d87381f99be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:05.686712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e6ad-37e6-4ef5-8bc8-d87381f99be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:05.696713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43e6ad-37e6-4ef5-8bc8-d87381f99be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:05.698182 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43e6ad-37e6-4ef5-8bc8-d87381f99be2 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:05.708564 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1281/2582] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:09.685366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52a341-1e91-435c-80b4-7b5b6b8f1d12 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:09.750879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52a341-1e91-435c-80b4-7b5b6b8f1d12 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:09.756323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:09.756963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:09.757244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:09.757517 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] PATH_INFO: `/v3/users/983cfee52cef4a49b37c7891d56cfa57` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:09.758687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] RBAC: Authorizing `identity:delete_user(user_id=983cfee52cef4a49b37c7891d56cfa57)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:09.761058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:09.775593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:09.811523 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '983cfee52cef4a49b37c7891d56cfa57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:09.812164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '983cfee52cef4a49b37c7891d56cfa57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:09.821160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '983cfee52cef4a49b37c7891d56cfa57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:09.828534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '983cfee52cef4a49b37c7891d56cfa57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:09.829191 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '983cfee52cef4a49b37c7891d56cfa57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:09.846921 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1302/2583] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:21:09 2022] DELETE /identity/v3/users/983cfee52cef4a49b37c7891d56cfa57 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:09.851593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500fc78-d134-4498-ba26-d39c79d6f096 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:09.852115 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500fc78-d134-4498-ba26-d39c79d6f096 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:09.852234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500fc78-d134-4498-ba26-d39c79d6f096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:09.872077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1500fc78-d134-4498-ba26-d39c79d6f096 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:09.873777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1500fc78-d134-4498-ba26-d39c79d6f096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:09.879398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:09.949284 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1282/2584] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:09.961335 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:09.963071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:10.027732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36d75-c5ee-4790-b8e4-22eb0cd4027f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:10.031753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e7d28-d22f-4140-b1ce-05d7b42f3df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:10.032393 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e7d28-d22f-4140-b1ce-05d7b42f3df3 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:10.032661 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e7d28-d22f-4140-b1ce-05d7b42f3df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:10.032922 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e7d28-d22f-4140-b1ce-05d7b42f3df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:10.042320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e7d28-d22f-4140-b1ce-05d7b42f3df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:10.043805 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e7d28-d22f-4140-b1ce-05d7b42f3df3 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:10.054453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1303/2585] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:10.352881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500fc78-d134-4498-ba26-d39c79d6f096 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:10.354368 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1500fc78-d134-4498-ba26-d39c79d6f096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:10.368658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500fc78-d134-4498-ba26-d39c79d6f096 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:10.374763 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:10.375362 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:10.375640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:10.375915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] PATH_INFO: `/v3/projects/ff49e0ad074f4c9a9b9221cb8b5a02ed` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:10.377238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff49e0ad074f4c9a9b9221cb8b5a02ed)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:10.379110 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:10.429611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff49e0ad074f4c9a9b9221cb8b5a02ed', 'request_id': 'req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:10.436576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff49e0ad074f4c9a9b9221cb8b5a02ed', 'request_id': 'req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:10.445986 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff49e0ad074f4c9a9b9221cb8b5a02ed', 'request_id': 'req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:10.456494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] The token cache is being invalidate because project ff49e0ad074f4c9a9b9221cb8b5a02ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:21:10.456755 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:10.457373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:10.459012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1283/2586] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:21:10 2022] DELETE /identity/v3/projects/ff49e0ad074f4c9a9b9221cb8b5a02ed => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:10.463127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e7d28-d22f-4140-b1ce-05d7b42f3df3 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:10.472908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e7d28-d22f-4140-b1ce-05d7b42f3df3 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:10.535931 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:10.536596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:10.536883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:10.537162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] PATH_INFO: `/v3/users/51565c169b0046ffbcaebe7ff1c31c5a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:10.538359 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51565c169b0046ffbcaebe7ff1c31c5a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:10.540409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:10.584531 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:10.595234 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51565c169b0046ffbcaebe7ff1c31c5a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:10.595936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51565c169b0046ffbcaebe7ff1c31c5a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:10.603365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51565c169b0046ffbcaebe7ff1c31c5a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:10.610347 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51565c169b0046ffbcaebe7ff1c31c5a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:10.610978 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51565c169b0046ffbcaebe7ff1c31c5a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:10.628672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1304/2587] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:21:10 2022] DELETE /identity/v3/users/51565c169b0046ffbcaebe7ff1c31c5a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:10.917638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:10.919235 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:10.932930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf43db5-2c2b-4501-a86d-f9cda814e9ad admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:10.990977 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:10.991544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:10.991828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:10.992084 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] PATH_INFO: `/v3/projects/394f60b02d41483a8dc9cc0058e9e6ab` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:10.993290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=394f60b02d41483a8dc9cc0058e9e6ab)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:10.995316 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:11.035462 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:11.046247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394f60b02d41483a8dc9cc0058e9e6ab', 'request_id': 'req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.053058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394f60b02d41483a8dc9cc0058e9e6ab', 'request_id': 'req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.062577 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394f60b02d41483a8dc9cc0058e9e6ab', 'request_id': 'req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.073501 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] The token cache is being invalidate because project 394f60b02d41483a8dc9cc0058e9e6ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:21:11.073787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.074430 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.075954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1284/2588] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:21:10 2022] DELETE /identity/v3/projects/394f60b02d41483a8dc9cc0058e9e6ab => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:11.080093 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:11.081632 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:11.094518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653cf49-4e88-4045-8500-f7bb9e6d04f7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:11.161164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cebc2-1e06-4899-8d3c-b7f7ac209725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:11.161800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cebc2-1e06-4899-8d3c-b7f7ac209725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:11.162074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cebc2-1e06-4899-8d3c-b7f7ac209725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:11.162402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cebc2-1e06-4899-8d3c-b7f7ac209725 admin admin] PATH_INFO: `/v3/users/1ab8dc0862da4b95b005d60c76750dfe` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:11.163559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cebc2-1e06-4899-8d3c-b7f7ac209725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab8dc0862da4b95b005d60c76750dfe)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:11.165588 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cebc2-1e06-4899-8d3c-b7f7ac209725 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:11.223050 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8e6cebc2-1e06-4899-8d3c-b7f7ac209725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab8dc0862da4b95b005d60c76750dfe'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.223684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8e6cebc2-1e06-4899-8d3c-b7f7ac209725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab8dc0862da4b95b005d60c76750dfe'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.232455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8e6cebc2-1e06-4899-8d3c-b7f7ac209725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab8dc0862da4b95b005d60c76750dfe'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.240043 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8e6cebc2-1e06-4899-8d3c-b7f7ac209725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab8dc0862da4b95b005d60c76750dfe'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.240720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8e6cebc2-1e06-4899-8d3c-b7f7ac209725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab8dc0862da4b95b005d60c76750dfe'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.258750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1305/2589] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:21:11 2022] DELETE /identity/v3/users/1ab8dc0862da4b95b005d60c76750dfe => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:21:11.542148 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:11.543573 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:11.557516 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e2463-52c9-4bce-89c6-46f0b00e2a0f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:11.617505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872521a5-7bdd-4d59-857f-20c3dc1d21d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:11.618137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872521a5-7bdd-4d59-857f-20c3dc1d21d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:11.618408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872521a5-7bdd-4d59-857f-20c3dc1d21d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:11.618685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872521a5-7bdd-4d59-857f-20c3dc1d21d4 admin admin] PATH_INFO: `/v3/projects/ea85ad409c6243b1b4c23d007961998d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:11.619775 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872521a5-7bdd-4d59-857f-20c3dc1d21d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea85ad409c6243b1b4c23d007961998d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:11.621771 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872521a5-7bdd-4d59-857f-20c3dc1d21d4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:11.673759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-872521a5-7bdd-4d59-857f-20c3dc1d21d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea85ad409c6243b1b4c23d007961998d', 'request_id': 'req-872521a5-7bdd-4d59-857f-20c3dc1d21d4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.679958 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-872521a5-7bdd-4d59-857f-20c3dc1d21d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea85ad409c6243b1b4c23d007961998d', 'request_id': 'req-872521a5-7bdd-4d59-857f-20c3dc1d21d4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.689818 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-872521a5-7bdd-4d59-857f-20c3dc1d21d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea85ad409c6243b1b4c23d007961998d', 'request_id': 'req-872521a5-7bdd-4d59-857f-20c3dc1d21d4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.700733 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-872521a5-7bdd-4d59-857f-20c3dc1d21d4 admin admin] The token cache is being invalidate because project ea85ad409c6243b1b4c23d007961998d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:21:11.701015 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-872521a5-7bdd-4d59-857f-20c3dc1d21d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.701631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-872521a5-7bdd-4d59-857f-20c3dc1d21d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:11.703122 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1285/2590] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:21:11 2022] DELETE /identity/v3/projects/ea85ad409c6243b1b4c23d007961998d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:11.708963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551a277-f595-448f-bd4e-64030ea366af None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:11.709242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551a277-f595-448f-bd4e-64030ea366af None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:11.709508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551a277-f595-448f-bd4e-64030ea366af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:11.729914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a551a277-f595-448f-bd4e-64030ea366af None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:11.731157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a551a277-f595-448f-bd4e-64030ea366af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:11.758882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:11.794145 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1306/2591] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:11.802396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecfb39-9efe-443f-bfad-5254b1b27fa7 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:11.802677 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecfb39-9efe-443f-bfad-5254b1b27fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:11.802950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecfb39-9efe-443f-bfad-5254b1b27fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:11.824336 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-43ecfb39-9efe-443f-bfad-5254b1b27fa7 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:11.825554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-43ecfb39-9efe-443f-bfad-5254b1b27fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:11.835270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1286/2592] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:11.839827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551a277-f595-448f-bd4e-64030ea366af None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:11.850377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551a277-f595-448f-bd4e-64030ea366af None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:11.855998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129e0e5-d767-44a9-b071-eda102751ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:11.856664 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129e0e5-d767-44a9-b071-eda102751ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:11.856939 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129e0e5-d767-44a9-b071-eda102751ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:11.857197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129e0e5-d767-44a9-b071-eda102751ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:11.857864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129e0e5-d767-44a9-b071-eda102751ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:21:11.858166 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129e0e5-d767-44a9-b071-eda102751ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:11.859834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129e0e5-d767-44a9-b071-eda102751ef0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:11.872121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1307/2593] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:21:11.877352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecfb39-9efe-443f-bfad-5254b1b27fa7 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:11.887385 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecfb39-9efe-443f-bfad-5254b1b27fa7 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:11.893598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582eafc-ad43-4f44-9e99-c8624e35e017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:11.894205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582eafc-ad43-4f44-9e99-c8624e35e017 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:11.894479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582eafc-ad43-4f44-9e99-c8624e35e017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:11.894747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582eafc-ad43-4f44-9e99-c8624e35e017 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:11.895378 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582eafc-ad43-4f44-9e99-c8624e35e017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:11.897418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582eafc-ad43-4f44-9e99-c8624e35e017 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:11.928953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1287/2594] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:11 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:11.933219 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129e0e5-d767-44a9-b071-eda102751ef0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:11.943824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129e0e5-d767-44a9-b071-eda102751ef0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:12.003153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad243f-41ef-4139-8b0e-38f4bb963639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:12.003773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad243f-41ef-4139-8b0e-38f4bb963639 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:12.004054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad243f-41ef-4139-8b0e-38f4bb963639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:12.004334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad243f-41ef-4139-8b0e-38f4bb963639 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:12.004999 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad243f-41ef-4139-8b0e-38f4bb963639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:12.006990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad243f-41ef-4139-8b0e-38f4bb963639 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:12.031352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1308/2595] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:21:11 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:12.037762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582eafc-ad43-4f44-9e99-c8624e35e017 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:12.050244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582eafc-ad43-4f44-9e99-c8624e35e017 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:12.055194 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986c6b5-8eaf-4399-bd43-9f5701b66d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:12.055800 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986c6b5-8eaf-4399-bd43-9f5701b66d86 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:12.056076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986c6b5-8eaf-4399-bd43-9f5701b66d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:12.056369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986c6b5-8eaf-4399-bd43-9f5701b66d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:12.057011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986c6b5-8eaf-4399-bd43-9f5701b66d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:12.058658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986c6b5-8eaf-4399-bd43-9f5701b66d86 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:12.069087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1288/2596] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:12.073232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad243f-41ef-4139-8b0e-38f4bb963639 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:12.083748 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad243f-41ef-4139-8b0e-38f4bb963639 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:12.088947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e3336-10d6-4ff0-861a-23fa3daf129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:12.089546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e3336-10d6-4ff0-861a-23fa3daf129a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:12.089825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e3336-10d6-4ff0-861a-23fa3daf129a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:12.090096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e3336-10d6-4ff0-861a-23fa3daf129a admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:12.090855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e3336-10d6-4ff0-861a-23fa3daf129a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:12.092532 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e3336-10d6-4ff0-861a-23fa3daf129a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:12.103666 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1309/2597] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:21:12.107949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986c6b5-8eaf-4399-bd43-9f5701b66d86 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:12.118513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986c6b5-8eaf-4399-bd43-9f5701b66d86 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:12.124061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f17cb-c93c-484e-9e23-4c5b4c48b526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:12.124756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f17cb-c93c-484e-9e23-4c5b4c48b526 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:12.125058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f17cb-c93c-484e-9e23-4c5b4c48b526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:12.125356 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f17cb-c93c-484e-9e23-4c5b4c48b526 admin admin] PATH_INFO: `/v3/projects/18432799891b456dbf4540c63c4fceb4/users/c4654da1a4704aa194abcb92cf857619/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:12.137411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:12.142263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f17cb-c93c-484e-9e23-4c5b4c48b526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18432799891b456dbf4540c63c4fceb4, user_id=c4654da1a4704aa194abcb92cf857619, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:12.146221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f17cb-c93c-484e-9e23-4c5b4c48b526 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:12.161594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1289/2598] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:12 2022] PUT /identity/v3/projects/18432799891b456dbf4540c63c4fceb4/users/c4654da1a4704aa194abcb92cf857619/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:21:12.166818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8643c-0531-4c22-92e3-6574f80d9414 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:12.167104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8643c-0531-4c22-92e3-6574f80d9414 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:12.167377 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8643c-0531-4c22-92e3-6574f80d9414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:12.187080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-22b8643c-0531-4c22-92e3-6574f80d9414 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:12.188310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-22b8643c-0531-4c22-92e3-6574f80d9414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:12.258230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1310/2599] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:12.269037 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f17cb-c93c-484e-9e23-4c5b4c48b526 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:12.270856 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-910f17cb-c93c-484e-9e23-4c5b4c48b526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:12.337527 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f17cb-c93c-484e-9e23-4c5b4c48b526 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:12.345034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa0203-39cb-4e1c-97f8-726c2c1bdaa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:12.346095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa0203-39cb-4e1c-97f8-726c2c1bdaa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:12.346574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa0203-39cb-4e1c-97f8-726c2c1bdaa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:12.346933 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa0203-39cb-4e1c-97f8-726c2c1bdaa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:12.362750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa0203-39cb-4e1c-97f8-726c2c1bdaa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:12.364225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa0203-39cb-4e1c-97f8-726c2c1bdaa9 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:12.373914 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1290/2600] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:16.198050 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa3e93-5ce1-4c38-b3d1-c15526f3de24 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:16.198614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa3e93-5ce1-4c38-b3d1-c15526f3de24 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:16.198614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa3e93-5ce1-4c38-b3d1-c15526f3de24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:16.230735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-28aa3e93-5ce1-4c38-b3d1-c15526f3de24 None None] MFA Rules not processed for user `c4654da1a4704aa194abcb92cf857619`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:16.232001 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-28aa3e93-5ce1-4c38-b3d1-c15526f3de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:16.264881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:16.309908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1311/2601] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:16.315698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa0203-39cb-4e1c-97f8-726c2c1bdaa9 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:16.327146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa0203-39cb-4e1c-97f8-726c2c1bdaa9 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:16.332099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce2530-edd8-43fc-a6e8-9b26a467717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:16.332878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce2530-edd8-43fc-a6e8-9b26a467717e admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:16.333366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce2530-edd8-43fc-a6e8-9b26a467717e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:16.333696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce2530-edd8-43fc-a6e8-9b26a467717e admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:16.334404 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce2530-edd8-43fc-a6e8-9b26a467717e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:16.336848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce2530-edd8-43fc-a6e8-9b26a467717e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:16.372803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1291/2602] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:16 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:16.374124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa3e93-5ce1-4c38-b3d1-c15526f3de24 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:16.390022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa3e93-5ce1-4c38-b3d1-c15526f3de24 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:16.459488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94671eef-4134-4f0c-b4ca-2d2cfe2c283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:16.460219 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94671eef-4134-4f0c-b4ca-2d2cfe2c283f admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:16.460605 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94671eef-4134-4f0c-b4ca-2d2cfe2c283f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:16.460942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94671eef-4134-4f0c-b4ca-2d2cfe2c283f admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:16.461962 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94671eef-4134-4f0c-b4ca-2d2cfe2c283f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:16.464238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94671eef-4134-4f0c-b4ca-2d2cfe2c283f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:16.492268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1312/2603] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:21:16 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:16.496583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce2530-edd8-43fc-a6e8-9b26a467717e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:16.509845 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce2530-edd8-43fc-a6e8-9b26a467717e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:16.514414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd372d94-df91-4017-900f-c02728b437cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:16.515243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd372d94-df91-4017-900f-c02728b437cb admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:16.515584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd372d94-df91-4017-900f-c02728b437cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:16.515918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd372d94-df91-4017-900f-c02728b437cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:16.516679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd372d94-df91-4017-900f-c02728b437cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:16.518700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd372d94-df91-4017-900f-c02728b437cb admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:16.531280 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1292/2604] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:16.535502 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94671eef-4134-4f0c-b4ca-2d2cfe2c283f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:16.546863 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94671eef-4134-4f0c-b4ca-2d2cfe2c283f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:16.552350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31332b3-1412-4c8e-8adc-2b7cfe2330f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:16.553165 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31332b3-1412-4c8e-8adc-2b7cfe2330f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:16.553627 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31332b3-1412-4c8e-8adc-2b7cfe2330f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:16.553994 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31332b3-1412-4c8e-8adc-2b7cfe2330f8 admin admin] PATH_INFO: `/v3/projects/cde4e31a9ba14e449b37aea464b3fb53/users/bf0720b6e4ce491b9e24f8186f0930df/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:16.571486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31332b3-1412-4c8e-8adc-2b7cfe2330f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde4e31a9ba14e449b37aea464b3fb53, user_id=bf0720b6e4ce491b9e24f8186f0930df, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:16.574341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31332b3-1412-4c8e-8adc-2b7cfe2330f8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:16.589360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1313/2605] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:16 2022] PUT /identity/v3/projects/cde4e31a9ba14e449b37aea464b3fb53/users/bf0720b6e4ce491b9e24f8186f0930df/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:21:16.593769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd372d94-df91-4017-900f-c02728b437cb admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:16.605091 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd372d94-df91-4017-900f-c02728b437cb admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:16.665106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd311b-d991-4e5c-948e-b3baa01b6837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:16.665782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd311b-d991-4e5c-948e-b3baa01b6837 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:16.666129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd311b-d991-4e5c-948e-b3baa01b6837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:16.666441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd311b-d991-4e5c-948e-b3baa01b6837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:16.667131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd311b-d991-4e5c-948e-b3baa01b6837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:16.668872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd311b-d991-4e5c-948e-b3baa01b6837 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:16.680672 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1293/2606] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:16.685781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31332b3-1412-4c8e-8adc-2b7cfe2330f8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:16.700608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31332b3-1412-4c8e-8adc-2b7cfe2330f8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:16.705281 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c358e-0c8a-4fcd-baae-a4ed576db39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:16.705943 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c358e-0c8a-4fcd-baae-a4ed576db39a admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:16.706220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c358e-0c8a-4fcd-baae-a4ed576db39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:16.706493 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c358e-0c8a-4fcd-baae-a4ed576db39a admin admin] PATH_INFO: `/v3/projects/cde4e31a9ba14e449b37aea464b3fb53/users/bf0720b6e4ce491b9e24f8186f0930df/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:16.708461 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c358e-0c8a-4fcd-baae-a4ed576db39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde4e31a9ba14e449b37aea464b3fb53, user_id=bf0720b6e4ce491b9e24f8186f0930df, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:16.711186 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c358e-0c8a-4fcd-baae-a4ed576db39a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:16.722267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1314/2607] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:16 2022] PUT /identity/v3/projects/cde4e31a9ba14e449b37aea464b3fb53/users/bf0720b6e4ce491b9e24f8186f0930df/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:19.269328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd311b-d991-4e5c-948e-b3baa01b6837 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:19.272609 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cebd311b-d991-4e5c-948e-b3baa01b6837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:19.368513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:19.441711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd311b-d991-4e5c-948e-b3baa01b6837 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:19.531017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ea077-7a38-4faf-b03c-ea2ebddda37c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:19.531742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ea077-7a38-4faf-b03c-ea2ebddda37c service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:19.531922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ea077-7a38-4faf-b03c-ea2ebddda37c service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:19.532193 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ea077-7a38-4faf-b03c-ea2ebddda37c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:19.534686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-806ea077-7a38-4faf-b03c-ea2ebddda37c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:19.550734 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ea077-7a38-4faf-b03c-ea2ebddda37c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:19.552622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ea077-7a38-4faf-b03c-ea2ebddda37c service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:19.575397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1294/2608] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:21.322884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda7598-e77b-441b-ba15-08942cfb0040 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:21.323438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda7598-e77b-441b-ba15-08942cfb0040 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:21.323438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda7598-e77b-441b-ba15-08942cfb0040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:21.356226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6cda7598-e77b-441b-ba15-08942cfb0040 None None] MFA Rules not processed for user `bf0720b6e4ce491b9e24f8186f0930df`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:21.357681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6cda7598-e77b-441b-ba15-08942cfb0040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:21.447436 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1315/2609] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:21.459409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ea077-7a38-4faf-b03c-ea2ebddda37c service placement] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:21.461521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-806ea077-7a38-4faf-b03c-ea2ebddda37c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:21.523682 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ea077-7a38-4faf-b03c-ea2ebddda37c service placement] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:21.527574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584315d-4033-4284-8701-be9cb90e2093 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31ebbadd69da4bc6ad25b5c882962ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:21.528209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584315d-4033-4284-8701-be9cb90e2093 service glance] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:21.528511 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584315d-4033-4284-8701-be9cb90e2093 service glance] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:21.528785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584315d-4033-4284-8701-be9cb90e2093 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:21.590884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584315d-4033-4284-8701-be9cb90e2093 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:21.592497 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584315d-4033-4284-8701-be9cb90e2093 service glance] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:21.604018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1295/2610] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:21.745057 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7101c-0b29-4b49-bb76-841b5793fdf3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:21.745411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7101c-0b29-4b49-bb76-841b5793fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:21.745750 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7101c-0b29-4b49-bb76-841b5793fdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:21.754322 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:21.766290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fcf7101c-0b29-4b49-bb76-841b5793fdf3 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:21.767629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fcf7101c-0b29-4b49-bb76-841b5793fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:21.825412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1316/2611] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:21.875506 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584315d-4033-4284-8701-be9cb90e2093 service glance] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:21.877310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c584315d-4033-4284-8701-be9cb90e2093 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:21.906100 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:21.952246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584315d-4033-4284-8701-be9cb90e2093 service glance] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:21.957881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b76d8-a9fe-4877-b830-46e4494bf996 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:21.958518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b76d8-a9fe-4877-b830-46e4494bf996 service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:21.958796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b76d8-a9fe-4877-b830-46e4494bf996 service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:21.959066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b76d8-a9fe-4877-b830-46e4494bf996 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:21.967551 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b76d8-a9fe-4877-b830-46e4494bf996 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:21.969206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b76d8-a9fe-4877-b830-46e4494bf996 service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:21.977678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1296/2612] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:21:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:21:31.194872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d007e2-1fc1-49b8-bdbe-7e4c2dbb4b11 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:31.195445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d007e2-1fc1-49b8-bdbe-7e4c2dbb4b11 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:31.195445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d007e2-1fc1-49b8-bdbe-7e4c2dbb4b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:31.215152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-48d007e2-1fc1-49b8-bdbe-7e4c2dbb4b11 None None] MFA Rules not processed for user `c4654da1a4704aa194abcb92cf857619`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:31.216382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-48d007e2-1fc1-49b8-bdbe-7e4c2dbb4b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:31.223957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1317/2613] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:31.519330 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b76d8-a9fe-4877-b830-46e4494bf996 service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:31.576374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b76d8-a9fe-4877-b830-46e4494bf996 service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:31.580609 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20972737-eb92-4fdb-9ea6-1b5e19e7f9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:31.581216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20972737-eb92-4fdb-9ea6-1b5e19e7f9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:31.581501 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20972737-eb92-4fdb-9ea6-1b5e19e7f9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:31.581772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20972737-eb92-4fdb-9ea6-1b5e19e7f9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:31.583636 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-20972737-eb92-4fdb-9ea6-1b5e19e7f9b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:31.652843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20972737-eb92-4fdb-9ea6-1b5e19e7f9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:31.654327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20972737-eb92-4fdb-9ea6-1b5e19e7f9b4 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:31.664077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1297/2614] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:33.255859 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2660f3-bf46-41bb-be0b-e9fed151d2d7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:33.257222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2660f3-bf46-41bb-be0b-e9fed151d2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:33.257545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2660f3-bf46-41bb-be0b-e9fed151d2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:33.279833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-df2660f3-bf46-41bb-be0b-e9fed151d2d7 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:33.281341 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-df2660f3-bf46-41bb-be0b-e9fed151d2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:33.290045 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1318/2615] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:33.307829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20972737-eb92-4fdb-9ea6-1b5e19e7f9b4 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:33.320559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20972737-eb92-4fdb-9ea6-1b5e19e7f9b4 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:33.325825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4419e23-489e-47c3-8819-2c60e7f4a470 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:33.326559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4419e23-489e-47c3-8819-2c60e7f4a470 service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:33.326909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4419e23-489e-47c3-8819-2c60e7f4a470 service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:33.327255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4419e23-489e-47c3-8819-2c60e7f4a470 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:33.336746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4419e23-489e-47c3-8819-2c60e7f4a470 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:33.338512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4419e23-489e-47c3-8819-2c60e7f4a470 service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:33.350101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1298/2616] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:21:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:21:36.120193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2660f3-bf46-41bb-be0b-e9fed151d2d7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:36.122103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-df2660f3-bf46-41bb-be0b-e9fed151d2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:36.152153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2660f3-bf46-41bb-be0b-e9fed151d2d7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:36.159154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf31565-5812-44fb-981b-0460aef3b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:36.160672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf31565-5812-44fb-981b-0460aef3b584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:36.161328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf31565-5812-44fb-981b-0460aef3b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:36.161813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf31565-5812-44fb-981b-0460aef3b584 admin admin] PATH_INFO: `/v3/users/3ea04d2b0055428090fc30d01f7c601e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:36.163484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf31565-5812-44fb-981b-0460aef3b584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea04d2b0055428090fc30d01f7c601e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:36.165773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf31565-5812-44fb-981b-0460aef3b584 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:36.233586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aaf31565-5812-44fb-981b-0460aef3b584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea04d2b0055428090fc30d01f7c601e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:36.234744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aaf31565-5812-44fb-981b-0460aef3b584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea04d2b0055428090fc30d01f7c601e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:36.247929 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aaf31565-5812-44fb-981b-0460aef3b584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea04d2b0055428090fc30d01f7c601e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:36.260111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aaf31565-5812-44fb-981b-0460aef3b584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea04d2b0055428090fc30d01f7c601e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:36.261416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aaf31565-5812-44fb-981b-0460aef3b584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea04d2b0055428090fc30d01f7c601e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:36.283624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1319/2617] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:21:36 2022] DELETE /identity/v3/users/3ea04d2b0055428090fc30d01f7c601e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:36.484774 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4419e23-489e-47c3-8819-2c60e7f4a470 service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:36.498649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4419e23-489e-47c3-8819-2c60e7f4a470 service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:36.560557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:36.576279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7c231-b657-40f9-ba61-57e782620bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:36.577011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7c231-b657-40f9-ba61-57e782620bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:36.577290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7c231-b657-40f9-ba61-57e782620bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:36.577565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7c231-b657-40f9-ba61-57e782620bb4 admin admin] PATH_INFO: `/v3/projects/38e3d31127cf4858a529d8564ecd710a` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:36.578695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7c231-b657-40f9-ba61-57e782620bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e3d31127cf4858a529d8564ecd710a)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:36.580739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7c231-b657-40f9-ba61-57e782620bb4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:36.631124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9ae7c231-b657-40f9-ba61-57e782620bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e3d31127cf4858a529d8564ecd710a', 'request_id': 'req-9ae7c231-b657-40f9-ba61-57e782620bb4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:36.638930 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9ae7c231-b657-40f9-ba61-57e782620bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e3d31127cf4858a529d8564ecd710a', 'request_id': 'req-9ae7c231-b657-40f9-ba61-57e782620bb4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:36.652420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9ae7c231-b657-40f9-ba61-57e782620bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e3d31127cf4858a529d8564ecd710a', 'request_id': 'req-9ae7c231-b657-40f9-ba61-57e782620bb4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:36.665411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9ae7c231-b657-40f9-ba61-57e782620bb4 admin admin] The token cache is being invalidate because project 38e3d31127cf4858a529d8564ecd710a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:21:36.665703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9ae7c231-b657-40f9-ba61-57e782620bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:36.666375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9ae7c231-b657-40f9-ba61-57e782620bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:36.668034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1299/2618] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:21:36 2022] DELETE /identity/v3/projects/38e3d31127cf4858a529d8564ecd710a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:36.673292 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a98205-3f01-48b1-aeab-6cd237d91182 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:36.673536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a98205-3f01-48b1-aeab-6cd237d91182 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:36.673808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a98205-3f01-48b1-aeab-6cd237d91182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:36.693417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-25a98205-3f01-48b1-aeab-6cd237d91182 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:36.694803 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-25a98205-3f01-48b1-aeab-6cd237d91182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:36.762674 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1320/2619] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:21:36.772083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c7d5d-3b91-4af6-9b3c-590b19cb227e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:36.772408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c7d5d-3b91-4af6-9b3c-590b19cb227e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:36.772689 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c7d5d-3b91-4af6-9b3c-590b19cb227e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:36.793747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-706c7d5d-3b91-4af6-9b3c-590b19cb227e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:36.795322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-706c7d5d-3b91-4af6-9b3c-590b19cb227e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:36.804689 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1300/2620] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:36.809144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a98205-3f01-48b1-aeab-6cd237d91182 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:36.839527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a98205-3f01-48b1-aeab-6cd237d91182 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:36.845731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ac134-de69-4049-b157-6b43b978654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:36.846353 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ac134-de69-4049-b157-6b43b978654a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:36.846621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ac134-de69-4049-b157-6b43b978654a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:36.846894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ac134-de69-4049-b157-6b43b978654a admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:36.847569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ac134-de69-4049-b157-6b43b978654a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:21:36.847867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ac134-de69-4049-b157-6b43b978654a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:36.849580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ac134-de69-4049-b157-6b43b978654a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:36.860326 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:36.863340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1321/2621] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:21:36.867724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c7d5d-3b91-4af6-9b3c-590b19cb227e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:36.884453 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c7d5d-3b91-4af6-9b3c-590b19cb227e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:36.889636 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539216b-f218-48d8-9346-4e7fdfe5b98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:36.890268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539216b-f218-48d8-9346-4e7fdfe5b98a admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:36.890594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539216b-f218-48d8-9346-4e7fdfe5b98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:36.890829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539216b-f218-48d8-9346-4e7fdfe5b98a admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:36.891638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539216b-f218-48d8-9346-4e7fdfe5b98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:36.894458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539216b-f218-48d8-9346-4e7fdfe5b98a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:36.928664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1301/2622] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:36 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:36.932253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ac134-de69-4049-b157-6b43b978654a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:36.944055 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ac134-de69-4049-b157-6b43b978654a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:37.018064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c9811-9353-40a3-a598-9c64a52ac870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:37.018812 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c9811-9353-40a3-a598-9c64a52ac870 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:37.019194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c9811-9353-40a3-a598-9c64a52ac870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:37.019568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c9811-9353-40a3-a598-9c64a52ac870 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:37.020349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c9811-9353-40a3-a598-9c64a52ac870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:37.022823 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c9811-9353-40a3-a598-9c64a52ac870 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:37.061470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1322/2623] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:21:36 2022] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:37.066072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539216b-f218-48d8-9346-4e7fdfe5b98a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:37.077933 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539216b-f218-48d8-9346-4e7fdfe5b98a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:37.083277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54685b-c08d-450e-8e2f-3c4c642a1996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:37.083898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54685b-c08d-450e-8e2f-3c4c642a1996 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:37.084185 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54685b-c08d-450e-8e2f-3c4c642a1996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:37.084579 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54685b-c08d-450e-8e2f-3c4c642a1996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:37.085265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54685b-c08d-450e-8e2f-3c4c642a1996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:37.087005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54685b-c08d-450e-8e2f-3c4c642a1996 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:37.098686 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1302/2624] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:21:37.102930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c9811-9353-40a3-a598-9c64a52ac870 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:37.114562 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c9811-9353-40a3-a598-9c64a52ac870 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:37.119905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f8e5-8c2f-4fd8-aafc-e4089426273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:37.120556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f8e5-8c2f-4fd8-aafc-e4089426273e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:37.121218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f8e5-8c2f-4fd8-aafc-e4089426273e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:37.121218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f8e5-8c2f-4fd8-aafc-e4089426273e admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:37.121743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95f8e5-8c2f-4fd8-aafc-e4089426273e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:37.123419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95f8e5-8c2f-4fd8-aafc-e4089426273e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:37.136237 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1323/2625] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:37.140874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54685b-c08d-450e-8e2f-3c4c642a1996 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:37.152617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54685b-c08d-450e-8e2f-3c4c642a1996 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:37.158772 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eb27a-bec5-432b-a892-745bf8007b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:37.159473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eb27a-bec5-432b-a892-745bf8007b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:37.159769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eb27a-bec5-432b-a892-745bf8007b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:37.160180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eb27a-bec5-432b-a892-745bf8007b6f admin admin] PATH_INFO: `/v3/projects/366230ab5ad24a6682bb9acade678687/users/d43ff25d73ff47c8a92fb864e4c2ea84/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:37.181612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eb27a-bec5-432b-a892-745bf8007b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=366230ab5ad24a6682bb9acade678687, user_id=d43ff25d73ff47c8a92fb864e4c2ea84, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:37.184349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eb27a-bec5-432b-a892-745bf8007b6f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:37.200115 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1303/2626] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:37 2022] PUT /identity/v3/projects/366230ab5ad24a6682bb9acade678687/users/d43ff25d73ff47c8a92fb864e4c2ea84/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:37.211231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d948-9a6e-4447-ad0c-f92e49044755 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:37.211687 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d948-9a6e-4447-ad0c-f92e49044755 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:37.212102 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d948-9a6e-4447-ad0c-f92e49044755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:37.242661 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8cb1d948-9a6e-4447-ad0c-f92e49044755 None None] MFA Rules not processed for user `d43ff25d73ff47c8a92fb864e4c2ea84`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:37.243999 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8cb1d948-9a6e-4447-ad0c-f92e49044755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:37.319416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1324/2627] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:37.320725 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eb27a-bec5-432b-a892-745bf8007b6f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:37.390010 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eb27a-bec5-432b-a892-745bf8007b6f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:37.395021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31402e-d850-412c-b086-52e77ff383c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:37.395650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31402e-d850-412c-b086-52e77ff383c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:37.395946 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31402e-d850-412c-b086-52e77ff383c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:37.396224 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31402e-d850-412c-b086-52e77ff383c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:37.396887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31402e-d850-412c-b086-52e77ff383c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:37.398886 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31402e-d850-412c-b086-52e77ff383c3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:37.428848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:37.440552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1304/2628] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:37 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:37.441628 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1d948-9a6e-4447-ad0c-f92e49044755 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:37.454486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1d948-9a6e-4447-ad0c-f92e49044755 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:37.523747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea0602-9394-401a-8a2f-a2496fa0c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:37.524516 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea0602-9394-401a-8a2f-a2496fa0c08f admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:37.524799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea0602-9394-401a-8a2f-a2496fa0c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:37.525066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea0602-9394-401a-8a2f-a2496fa0c08f admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:37.525712 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea0602-9394-401a-8a2f-a2496fa0c08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:37.527709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea0602-9394-401a-8a2f-a2496fa0c08f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:37.538534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:37.558893 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1325/2629] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:21:37 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:21:37.563541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31402e-d850-412c-b086-52e77ff383c3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:37.574490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31402e-d850-412c-b086-52e77ff383c3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:37.579131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe631e1-7832-47ed-9c95-02a96142b697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:37.582444 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe631e1-7832-47ed-9c95-02a96142b697 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:37.582444 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe631e1-7832-47ed-9c95-02a96142b697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:37.582444 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe631e1-7832-47ed-9c95-02a96142b697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:37.583012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe631e1-7832-47ed-9c95-02a96142b697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:37.584756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe631e1-7832-47ed-9c95-02a96142b697 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:37.601914 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1305/2630] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:37.605277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea0602-9394-401a-8a2f-a2496fa0c08f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:37.619118 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea0602-9394-401a-8a2f-a2496fa0c08f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:37.624087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39aa083-1423-4dda-9418-9ab4001f1a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:37.624800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39aa083-1423-4dda-9418-9ab4001f1a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:37.625076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39aa083-1423-4dda-9418-9ab4001f1a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:37.625352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39aa083-1423-4dda-9418-9ab4001f1a01 admin admin] PATH_INFO: `/v3/projects/c376158976db45e3afc5ff3b7dada983/users/9bbc14bd040345708436eed7342c1e85/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:37.642500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39aa083-1423-4dda-9418-9ab4001f1a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c376158976db45e3afc5ff3b7dada983, user_id=9bbc14bd040345708436eed7342c1e85, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:37.645361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39aa083-1423-4dda-9418-9ab4001f1a01 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:37.661324 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1326/2631] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:37 2022] PUT /identity/v3/projects/c376158976db45e3afc5ff3b7dada983/users/9bbc14bd040345708436eed7342c1e85/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:37.668522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe631e1-7832-47ed-9c95-02a96142b697 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:37.680789 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe631e1-7832-47ed-9c95-02a96142b697 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:37.749705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75314f-b905-4b1c-9382-99fc77125d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:37.750427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75314f-b905-4b1c-9382-99fc77125d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:37.750788 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75314f-b905-4b1c-9382-99fc77125d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:37.751152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75314f-b905-4b1c-9382-99fc77125d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:37.751900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75314f-b905-4b1c-9382-99fc77125d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:37.753692 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75314f-b905-4b1c-9382-99fc77125d08 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:37.765497 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1306/2632] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:37.769882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39aa083-1423-4dda-9418-9ab4001f1a01 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:37.780515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39aa083-1423-4dda-9418-9ab4001f1a01 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:37.785092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824276a-e1d3-49f3-81f8-96ee785a1cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:37.785735 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824276a-e1d3-49f3-81f8-96ee785a1cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:37.786007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824276a-e1d3-49f3-81f8-96ee785a1cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:37.786276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824276a-e1d3-49f3-81f8-96ee785a1cf6 admin admin] PATH_INFO: `/v3/projects/c376158976db45e3afc5ff3b7dada983/users/9bbc14bd040345708436eed7342c1e85/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:37.788179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824276a-e1d3-49f3-81f8-96ee785a1cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c376158976db45e3afc5ff3b7dada983, user_id=9bbc14bd040345708436eed7342c1e85, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:37.790902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824276a-e1d3-49f3-81f8-96ee785a1cf6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:37.801307 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1327/2633] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:37 2022] PUT /identity/v3/projects/c376158976db45e3afc5ff3b7dada983/users/9bbc14bd040345708436eed7342c1e85/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:37.813154 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5ed1-a3ef-451c-b016-6b7b1f754e4b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:37.813811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5ed1-a3ef-451c-b016-6b7b1f754e4b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:37.814263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5ed1-a3ef-451c-b016-6b7b1f754e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:37.850654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-eeca5ed1-a3ef-451c-b016-6b7b1f754e4b None None] MFA Rules not processed for user `9bbc14bd040345708436eed7342c1e85`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:37.852139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-eeca5ed1-a3ef-451c-b016-6b7b1f754e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:37.930160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1307/2634] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:37.942700 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824276a-e1d3-49f3-81f8-96ee785a1cf6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:37.944500 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7824276a-e1d3-49f3-81f8-96ee785a1cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:38.016498 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824276a-e1d3-49f3-81f8-96ee785a1cf6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:38.020637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6976b2-4723-4e8b-a40f-f6bca7048d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:38.021275 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6976b2-4723-4e8b-a40f-f6bca7048d24 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:38.021528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6976b2-4723-4e8b-a40f-f6bca7048d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:38.021797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6976b2-4723-4e8b-a40f-f6bca7048d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:38.030791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6976b2-4723-4e8b-a40f-f6bca7048d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:38.032400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6976b2-4723-4e8b-a40f-f6bca7048d24 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:38.045977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1328/2635] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:38.436515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca5ed1-a3ef-451c-b016-6b7b1f754e4b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:38.446287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca5ed1-a3ef-451c-b016-6b7b1f754e4b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:38.451013 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69212316-0e3a-45e7-8843-ab90de590903 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbc14bd040345708436eed7342c1e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c376158976db45e3afc5ff3b7dada983', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:38.451756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69212316-0e3a-45e7-8843-ab90de590903 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:38.452038 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69212316-0e3a-45e7-8843-ab90de590903 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:38.452342 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69212316-0e3a-45e7-8843-ab90de590903 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:38.453123 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69212316-0e3a-45e7-8843-ab90de590903 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:21:38.453422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69212316-0e3a-45e7-8843-ab90de590903 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:38.455194 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69212316-0e3a-45e7-8843-ab90de590903 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:38.469216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1308/2636] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:21:38.473244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6976b2-4723-4e8b-a40f-f6bca7048d24 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:38.482731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6976b2-4723-4e8b-a40f-f6bca7048d24 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:38.487613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4f938-d28b-4947-858b-d1332be6c110 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbc14bd040345708436eed7342c1e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c376158976db45e3afc5ff3b7dada983', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:38.488221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4f938-d28b-4947-858b-d1332be6c110 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:38.488522 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4f938-d28b-4947-858b-d1332be6c110 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:38.488796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4f938-d28b-4947-858b-d1332be6c110 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:38.489424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4f938-d28b-4947-858b-d1332be6c110 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:38.491429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4f938-d28b-4947-858b-d1332be6c110 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:38.525889 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1329/2637] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:38 2022] POST /identity/v3/projects => generated 354 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:38.526842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69212316-0e3a-45e7-8843-ab90de590903 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:38.540810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69212316-0e3a-45e7-8843-ab90de590903 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:38.595549 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:38.604233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595603f-c921-4817-86a8-bece02bf76c1 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbc14bd040345708436eed7342c1e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c376158976db45e3afc5ff3b7dada983', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:38.604905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595603f-c921-4817-86a8-bece02bf76c1 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:38.605182 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595603f-c921-4817-86a8-bece02bf76c1 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:38.605456 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595603f-c921-4817-86a8-bece02bf76c1 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:38.606107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595603f-c921-4817-86a8-bece02bf76c1 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:21:38.606411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595603f-c921-4817-86a8-bece02bf76c1 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:38.608121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595603f-c921-4817-86a8-bece02bf76c1 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:38.622416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1309/2638] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:21:38.665521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4f938-d28b-4947-858b-d1332be6c110 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:38.676967 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4f938-d28b-4947-858b-d1332be6c110 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:38.681535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbc14bd040345708436eed7342c1e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c376158976db45e3afc5ff3b7dada983', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:38.682179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:38.682457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:38.682727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] PATH_INFO: `/v3/projects/8e79113f5bd4468c9f4c78dfd40dcd7e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:38.683861 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8e79113f5bd4468c9f4c78dfd40dcd7e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:38.686060 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:38.736429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e79113f5bd4468c9f4c78dfd40dcd7e', 'request_id': 'req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:38.742696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e79113f5bd4468c9f4c78dfd40dcd7e', 'request_id': 'req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:38.751369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e79113f5bd4468c9f4c78dfd40dcd7e', 'request_id': 'req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:38.770409 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] The token cache is being invalidate because project 8e79113f5bd4468c9f4c78dfd40dcd7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:21:38.770760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:38.771601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9d426c12-a2ee-4dbc-8b1a-8594f0c74a25 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:38.773524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1330/2639] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:21:38 2022] DELETE /identity/v3/projects/8e79113f5bd4468c9f4c78dfd40dcd7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:21:38.996063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595603f-c921-4817-86a8-bece02bf76c1 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:38.998150 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c595603f-c921-4817-86a8-bece02bf76c1 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:39.071872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595603f-c921-4817-86a8-bece02bf76c1 tempest-VolumeQuotaClassesTest-674498263 tempest-VolumeQuotaClassesTest-674498263-project-admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:39.134260 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:39.134911 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:39.135195 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:39.135471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] PATH_INFO: `/v3/users/d43ff25d73ff47c8a92fb864e4c2ea84` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:39.137013 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43ff25d73ff47c8a92fb864e4c2ea84)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:39.139004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:39.196271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43ff25d73ff47c8a92fb864e4c2ea84'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:39.196951 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43ff25d73ff47c8a92fb864e4c2ea84'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:39.204057 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43ff25d73ff47c8a92fb864e4c2ea84'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:39.205635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43ff25d73ff47c8a92fb864e4c2ea84'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:39.218865 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43ff25d73ff47c8a92fb864e4c2ea84'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:39.234205 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1310/2640] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:21:38 2022] DELETE /identity/v3/users/d43ff25d73ff47c8a92fb864e4c2ea84 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:39.238982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc158d-99f6-4979-85b0-2b9699997ec1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:39.239266 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc158d-99f6-4979-85b0-2b9699997ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:39.239540 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc158d-99f6-4979-85b0-2b9699997ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:39.260845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-53dc158d-99f6-4979-85b0-2b9699997ec1 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:39.262083 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-53dc158d-99f6-4979-85b0-2b9699997ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:39.278314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:39.346139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1331/2641] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:39.355985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:39.357440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:39.380622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:39.438610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28191b9d-2a8e-4f82-9304-46039a576dc2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:39.442718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859017cb-4316-4e90-bea0-27c096a8c815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:39.443565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859017cb-4316-4e90-bea0-27c096a8c815 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:39.443842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859017cb-4316-4e90-bea0-27c096a8c815 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:39.444209 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859017cb-4316-4e90-bea0-27c096a8c815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:39.466280 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859017cb-4316-4e90-bea0-27c096a8c815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:39.467824 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859017cb-4316-4e90-bea0-27c096a8c815 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:39.478766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1311/2642] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:21:39.781868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc158d-99f6-4979-85b0-2b9699997ec1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:39.784097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-53dc158d-99f6-4979-85b0-2b9699997ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:39.799881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc158d-99f6-4979-85b0-2b9699997ec1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:39.806614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:39.807934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:39.808103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:39.808422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] PATH_INFO: `/v3/projects/366230ab5ad24a6682bb9acade678687` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:39.809653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] RBAC: Authorizing `identity:delete_project(project_id=366230ab5ad24a6682bb9acade678687)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:39.811640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:39.868853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366230ab5ad24a6682bb9acade678687', 'request_id': 'req-032ddc71-6d19-4711-8464-68548cf3564d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:39.874672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366230ab5ad24a6682bb9acade678687', 'request_id': 'req-032ddc71-6d19-4711-8464-68548cf3564d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:39.881424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366230ab5ad24a6682bb9acade678687', 'request_id': 'req-032ddc71-6d19-4711-8464-68548cf3564d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:39.898257 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] The token cache is being invalidate because project 366230ab5ad24a6682bb9acade678687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:21:39.898589 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:39.899220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:39.900813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1332/2643] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:21:39 2022] DELETE /identity/v3/projects/366230ab5ad24a6682bb9acade678687 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:39.905030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859017cb-4316-4e90-bea0-27c096a8c815 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:39.915198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859017cb-4316-4e90-bea0-27c096a8c815 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:39.975234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f814a-b4b7-4925-b97b-de7093c5d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:39.975875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f814a-b4b7-4925-b97b-de7093c5d608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:39.976147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f814a-b4b7-4925-b97b-de7093c5d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:39.976451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f814a-b4b7-4925-b97b-de7093c5d608 admin admin] PATH_INFO: `/v3/users/9bbc14bd040345708436eed7342c1e85` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:39.977565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f814a-b4b7-4925-b97b-de7093c5d608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbc14bd040345708436eed7342c1e85)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:39.979531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f814a-b4b7-4925-b97b-de7093c5d608 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:40.047231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e01f814a-b4b7-4925-b97b-de7093c5d608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbc14bd040345708436eed7342c1e85'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:40.048190 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e01f814a-b4b7-4925-b97b-de7093c5d608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbc14bd040345708436eed7342c1e85'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:40.056896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e01f814a-b4b7-4925-b97b-de7093c5d608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbc14bd040345708436eed7342c1e85'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:40.057683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e01f814a-b4b7-4925-b97b-de7093c5d608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbc14bd040345708436eed7342c1e85'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:40.073919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e01f814a-b4b7-4925-b97b-de7093c5d608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbc14bd040345708436eed7342c1e85'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:40.090374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1312/2644] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:21:39 2022] DELETE /identity/v3/users/9bbc14bd040345708436eed7342c1e85 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:40.388771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:40.392993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:40.410555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ddc71-6d19-4711-8464-68548cf3564d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:40.477017 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc1e1f-f9a9-49ec-a549-20792bd62624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:40.477571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc1e1f-f9a9-49ec-a549-20792bd62624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:40.477844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc1e1f-f9a9-49ec-a549-20792bd62624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:40.478112 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc1e1f-f9a9-49ec-a549-20792bd62624 admin admin] PATH_INFO: `/v3/projects/c376158976db45e3afc5ff3b7dada983` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:40.479236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc1e1f-f9a9-49ec-a549-20792bd62624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c376158976db45e3afc5ff3b7dada983)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:40.481311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc1e1f-f9a9-49ec-a549-20792bd62624 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:40.537012 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:40.542456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7ccc1e1f-f9a9-49ec-a549-20792bd62624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c376158976db45e3afc5ff3b7dada983', 'request_id': 'req-7ccc1e1f-f9a9-49ec-a549-20792bd62624'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:40.553493 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7ccc1e1f-f9a9-49ec-a549-20792bd62624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c376158976db45e3afc5ff3b7dada983', 'request_id': 'req-7ccc1e1f-f9a9-49ec-a549-20792bd62624'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:40.560483 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7ccc1e1f-f9a9-49ec-a549-20792bd62624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c376158976db45e3afc5ff3b7dada983', 'request_id': 'req-7ccc1e1f-f9a9-49ec-a549-20792bd62624'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:40.575673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7ccc1e1f-f9a9-49ec-a549-20792bd62624 admin admin] The token cache is being invalidate because project c376158976db45e3afc5ff3b7dada983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:21:40.576044 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7ccc1e1f-f9a9-49ec-a549-20792bd62624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:40.576902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7ccc1e1f-f9a9-49ec-a549-20792bd62624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:40.578507 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1333/2645] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:21:40 2022] DELETE /identity/v3/projects/c376158976db45e3afc5ff3b7dada983 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:40.583760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d74e8-a8e9-40e9-8d70-e1abff996b15 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:40.584047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d74e8-a8e9-40e9-8d70-e1abff996b15 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:40.584353 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d74e8-a8e9-40e9-8d70-e1abff996b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:40.610943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-325d74e8-a8e9-40e9-8d70-e1abff996b15 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:40.612373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-325d74e8-a8e9-40e9-8d70-e1abff996b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:40.650784 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:40.683147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1313/2646] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:40.691318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef697-63f8-4b73-82a7-cc75dda77ed6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:40.691618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef697-63f8-4b73-82a7-cc75dda77ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:40.691862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef697-63f8-4b73-82a7-cc75dda77ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:40.726440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-151ef697-63f8-4b73-82a7-cc75dda77ed6 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:40.727876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-151ef697-63f8-4b73-82a7-cc75dda77ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:40.736230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1334/2647] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:40.740825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d74e8-a8e9-40e9-8d70-e1abff996b15 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:40.751590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d74e8-a8e9-40e9-8d70-e1abff996b15 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:40.756555 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaef424-4f25-46ef-bd36-cd6b2d9006cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:40.757181 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaef424-4f25-46ef-bd36-cd6b2d9006cc admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:40.757457 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaef424-4f25-46ef-bd36-cd6b2d9006cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:40.757906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaef424-4f25-46ef-bd36-cd6b2d9006cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:40.758909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaef424-4f25-46ef-bd36-cd6b2d9006cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:21:40.759216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaef424-4f25-46ef-bd36-cd6b2d9006cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:40.760938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaef424-4f25-46ef-bd36-cd6b2d9006cc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:40.775611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1314/2648] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:21:40.780265 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ef697-63f8-4b73-82a7-cc75dda77ed6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:40.790830 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ef697-63f8-4b73-82a7-cc75dda77ed6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:40.795504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1aa05-cd33-4916-905f-117c079a948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:40.796110 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1aa05-cd33-4916-905f-117c079a948c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:40.796414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1aa05-cd33-4916-905f-117c079a948c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:40.796680 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1aa05-cd33-4916-905f-117c079a948c admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:40.797309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1aa05-cd33-4916-905f-117c079a948c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:40.799303 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1aa05-cd33-4916-905f-117c079a948c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:40.829075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1335/2649] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:40 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:40.833723 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaef424-4f25-46ef-bd36-cd6b2d9006cc admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:40.846194 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaef424-4f25-46ef-bd36-cd6b2d9006cc admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:40.909081 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d2121-566b-4818-8b8a-09c33b24d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:40.909808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d2121-566b-4818-8b8a-09c33b24d4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:40.910243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d2121-566b-4818-8b8a-09c33b24d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:40.910525 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d2121-566b-4818-8b8a-09c33b24d4f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:40.911183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d2121-566b-4818-8b8a-09c33b24d4f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:40.913242 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d2121-566b-4818-8b8a-09c33b24d4f4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:40.939118 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1315/2650] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:21:40 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:40.943561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1aa05-cd33-4916-905f-117c079a948c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:40.954200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1aa05-cd33-4916-905f-117c079a948c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:40.962639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82897467-2d38-48bc-b1e6-0b0be75210b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:40.963422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82897467-2d38-48bc-b1e6-0b0be75210b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:40.963772 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82897467-2d38-48bc-b1e6-0b0be75210b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:40.964180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82897467-2d38-48bc-b1e6-0b0be75210b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:40.965537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82897467-2d38-48bc-b1e6-0b0be75210b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:40.968259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82897467-2d38-48bc-b1e6-0b0be75210b0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:40.980074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1336/2651] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:40.984320 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d2121-566b-4818-8b8a-09c33b24d4f4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:40.995944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d2121-566b-4818-8b8a-09c33b24d4f4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:41.001591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23249a4e-2721-4e0e-a625-dc48d21e80c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:41.002410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23249a4e-2721-4e0e-a625-dc48d21e80c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:41.002693 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23249a4e-2721-4e0e-a625-dc48d21e80c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:41.002967 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23249a4e-2721-4e0e-a625-dc48d21e80c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:41.003775 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23249a4e-2721-4e0e-a625-dc48d21e80c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:41.005788 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23249a4e-2721-4e0e-a625-dc48d21e80c8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:41.021935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1316/2652] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:41.026946 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82897467-2d38-48bc-b1e6-0b0be75210b0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:41.038626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82897467-2d38-48bc-b1e6-0b0be75210b0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:41.043421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c12d27-06a6-42ee-9f58-0c6e4f8b2878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:41.047609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12d27-06a6-42ee-9f58-0c6e4f8b2878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:41.048140 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12d27-06a6-42ee-9f58-0c6e4f8b2878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:41.048679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12d27-06a6-42ee-9f58-0c6e4f8b2878 admin admin] PATH_INFO: `/v3/projects/4e84858ea4a64c6fbab972538aeefe10/users/ca7f5114da904c7883cb3bada30708b5/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:41.067486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c12d27-06a6-42ee-9f58-0c6e4f8b2878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e84858ea4a64c6fbab972538aeefe10, user_id=ca7f5114da904c7883cb3bada30708b5, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:41.070294 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c12d27-06a6-42ee-9f58-0c6e4f8b2878 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:41.085002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1337/2653] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:41 2022] PUT /identity/v3/projects/4e84858ea4a64c6fbab972538aeefe10/users/ca7f5114da904c7883cb3bada30708b5/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:41.096908 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525db19-f9f6-4053-bc34-e5e911836750 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:41.097742 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525db19-f9f6-4053-bc34-e5e911836750 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:41.098260 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525db19-f9f6-4053-bc34-e5e911836750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:41.131838 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b525db19-f9f6-4053-bc34-e5e911836750 None None] MFA Rules not processed for user `ca7f5114da904c7883cb3bada30708b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:41.133116 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b525db19-f9f6-4053-bc34-e5e911836750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:41.201968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1317/2654] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:41.206448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c12d27-06a6-42ee-9f58-0c6e4f8b2878 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:41.274467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c12d27-06a6-42ee-9f58-0c6e4f8b2878 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:41.281018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6fae6-21c2-400e-9ab8-807c1127d25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:41.281801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6fae6-21c2-400e-9ab8-807c1127d25a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:41.282345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6fae6-21c2-400e-9ab8-807c1127d25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:41.282761 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6fae6-21c2-400e-9ab8-807c1127d25a admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:41.283530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6fae6-21c2-400e-9ab8-807c1127d25a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:41.285556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6fae6-21c2-400e-9ab8-807c1127d25a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:41.318127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1338/2655] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:41 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:41.322455 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525db19-f9f6-4053-bc34-e5e911836750 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:41.333678 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525db19-f9f6-4053-bc34-e5e911836750 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:41.368754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:41.410890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5b9d-7e4a-4f95-a145-b8d525c9bcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:41.411901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5b9d-7e4a-4f95-a145-b8d525c9bcee admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:41.411901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5b9d-7e4a-4f95-a145-b8d525c9bcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:41.412143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5b9d-7e4a-4f95-a145-b8d525c9bcee admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:41.412759 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a5b9d-7e4a-4f95-a145-b8d525c9bcee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:41.414734 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a5b9d-7e4a-4f95-a145-b8d525c9bcee admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:41.441910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1318/2656] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:21:41 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:41.448535 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6fae6-21c2-400e-9ab8-807c1127d25a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:41.460062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6fae6-21c2-400e-9ab8-807c1127d25a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:41.465187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cf309-131c-4e46-b98c-3ab5de8d3308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:41.465882 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cf309-131c-4e46-b98c-3ab5de8d3308 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:41.466296 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cf309-131c-4e46-b98c-3ab5de8d3308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:41.466574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cf309-131c-4e46-b98c-3ab5de8d3308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:41.467313 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cf309-131c-4e46-b98c-3ab5de8d3308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:41.469603 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cf309-131c-4e46-b98c-3ab5de8d3308 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:41.483331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1339/2657] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:41.487986 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5b9d-7e4a-4f95-a145-b8d525c9bcee admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:41.499070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5b9d-7e4a-4f95-a145-b8d525c9bcee admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:41.503999 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89402725-9d07-49cd-9a6a-6c929325aff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:41.504646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89402725-9d07-49cd-9a6a-6c929325aff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:41.504929 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89402725-9d07-49cd-9a6a-6c929325aff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:41.505203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89402725-9d07-49cd-9a6a-6c929325aff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:41.505880 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89402725-9d07-49cd-9a6a-6c929325aff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:41.507528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89402725-9d07-49cd-9a6a-6c929325aff7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:41.519431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1319/2658] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:41.523617 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cf309-131c-4e46-b98c-3ab5de8d3308 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:41.534427 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cf309-131c-4e46-b98c-3ab5de8d3308 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:41.540959 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf997dce-1e95-41ad-a2f0-d809f4e604d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:41.542070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf997dce-1e95-41ad-a2f0-d809f4e604d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:41.542633 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf997dce-1e95-41ad-a2f0-d809f4e604d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:41.543414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf997dce-1e95-41ad-a2f0-d809f4e604d0 admin admin] PATH_INFO: `/v3/projects/3b3a011e66374adaac1511f6cf473017/users/07f1325d3cb2450584b3f1aee2942db1/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:41.564556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf997dce-1e95-41ad-a2f0-d809f4e604d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3a011e66374adaac1511f6cf473017, user_id=07f1325d3cb2450584b3f1aee2942db1, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:41.567361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf997dce-1e95-41ad-a2f0-d809f4e604d0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:41.584197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1340/2659] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:41 2022] PUT /identity/v3/projects/3b3a011e66374adaac1511f6cf473017/users/07f1325d3cb2450584b3f1aee2942db1/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:21:41.598156 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a1069-5aaa-496c-b6c3-efa6e628c757 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:41.598480 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a1069-5aaa-496c-b6c3-efa6e628c757 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:41.598735 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a1069-5aaa-496c-b6c3-efa6e628c757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:41.662104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-cf3a1069-5aaa-496c-b6c3-efa6e628c757 None None] MFA Rules not processed for user `07f1325d3cb2450584b3f1aee2942db1`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:41.663349 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cf3a1069-5aaa-496c-b6c3-efa6e628c757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:41.740588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1320/2660] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:41.745314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf997dce-1e95-41ad-a2f0-d809f4e604d0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:41.777640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:41.843078 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf997dce-1e95-41ad-a2f0-d809f4e604d0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:41.849240 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5c5b0-52ed-4ab4-957a-c1dfd8e137fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:41.850139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5c5b0-52ed-4ab4-957a-c1dfd8e137fc admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:41.850517 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5c5b0-52ed-4ab4-957a-c1dfd8e137fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:41.850895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5c5b0-52ed-4ab4-957a-c1dfd8e137fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:41.851684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5c5b0-52ed-4ab4-957a-c1dfd8e137fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:41.853947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5c5b0-52ed-4ab4-957a-c1dfd8e137fc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:41.887585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1341/2661] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:41 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:41.892008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a1069-5aaa-496c-b6c3-efa6e628c757 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:41.903312 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a1069-5aaa-496c-b6c3-efa6e628c757 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:41.963555 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94649d-be47-460e-a98f-275e8e1b6f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:41.964174 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94649d-be47-460e-a98f-275e8e1b6f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:41.964510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94649d-be47-460e-a98f-275e8e1b6f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:41.964786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94649d-be47-460e-a98f-275e8e1b6f5e admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:41.965440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94649d-be47-460e-a98f-275e8e1b6f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:41.967415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94649d-be47-460e-a98f-275e8e1b6f5e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:41.992421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1321/2662] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:21:41 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:21:41.996607 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5c5b0-52ed-4ab4-957a-c1dfd8e137fc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:42.012626 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5c5b0-52ed-4ab4-957a-c1dfd8e137fc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:42.017514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad2f2c-9371-43c9-99c9-303378aade78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:42.018136 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad2f2c-9371-43c9-99c9-303378aade78 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:42.018453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad2f2c-9371-43c9-99c9-303378aade78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:42.018726 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad2f2c-9371-43c9-99c9-303378aade78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:42.019383 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad2f2c-9371-43c9-99c9-303378aade78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:42.026137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad2f2c-9371-43c9-99c9-303378aade78 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:42.038391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1342/2663] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:42.042491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94649d-be47-460e-a98f-275e8e1b6f5e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:42.053009 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94649d-be47-460e-a98f-275e8e1b6f5e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:42.057982 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde522f-1c95-4353-be3d-4cdf7c2fe1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:42.058654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde522f-1c95-4353-be3d-4cdf7c2fe1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:42.058928 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde522f-1c95-4353-be3d-4cdf7c2fe1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:42.059189 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde522f-1c95-4353-be3d-4cdf7c2fe1f2 admin admin] PATH_INFO: `/v3/projects/c0b6dc607b1642ac80c12f5ab1ec7032/users/2e69b80766d34106b6edfbf5d5aded54/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:42.075863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde522f-1c95-4353-be3d-4cdf7c2fe1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b6dc607b1642ac80c12f5ab1ec7032, user_id=2e69b80766d34106b6edfbf5d5aded54, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:42.079297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde522f-1c95-4353-be3d-4cdf7c2fe1f2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:42.097882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1322/2664] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:42 2022] PUT /identity/v3/projects/c0b6dc607b1642ac80c12f5ab1ec7032/users/2e69b80766d34106b6edfbf5d5aded54/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:42.102308 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad2f2c-9371-43c9-99c9-303378aade78 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:42.113475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad2f2c-9371-43c9-99c9-303378aade78 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:42.174041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30383139-f942-48de-a055-62b14da4d61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:42.175027 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30383139-f942-48de-a055-62b14da4d61a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:42.176085 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30383139-f942-48de-a055-62b14da4d61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:42.176397 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30383139-f942-48de-a055-62b14da4d61a admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:42.177590 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30383139-f942-48de-a055-62b14da4d61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:42.186434 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30383139-f942-48de-a055-62b14da4d61a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:42.196972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde522f-1c95-4353-be3d-4cdf7c2fe1f2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:42.197406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1343/2665] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:42.208696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde522f-1c95-4353-be3d-4cdf7c2fe1f2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:42.213957 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c2dc2-c546-4b6f-8140-d78c19d2855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:42.214638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c2dc2-c546-4b6f-8140-d78c19d2855b admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:42.214965 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c2dc2-c546-4b6f-8140-d78c19d2855b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:42.215265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c2dc2-c546-4b6f-8140-d78c19d2855b admin admin] PATH_INFO: `/v3/projects/c0b6dc607b1642ac80c12f5ab1ec7032/users/2e69b80766d34106b6edfbf5d5aded54/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:42.217882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c2dc2-c546-4b6f-8140-d78c19d2855b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b6dc607b1642ac80c12f5ab1ec7032, user_id=2e69b80766d34106b6edfbf5d5aded54, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:42.221255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c2dc2-c546-4b6f-8140-d78c19d2855b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:42.225097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:42.235151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1323/2666] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:42 2022] PUT /identity/v3/projects/c0b6dc607b1642ac80c12f5ab1ec7032/users/2e69b80766d34106b6edfbf5d5aded54/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:42.245996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c410767-ff4d-4652-b112-1911f2987e01 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:42.246268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c410767-ff4d-4652-b112-1911f2987e01 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:42.246551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c410767-ff4d-4652-b112-1911f2987e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:42.275258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5c410767-ff4d-4652-b112-1911f2987e01 None None] MFA Rules not processed for user `2e69b80766d34106b6edfbf5d5aded54`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:42.276556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5c410767-ff4d-4652-b112-1911f2987e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:42.357335 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1344/2667] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:42.371684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c2dc2-c546-4b6f-8140-d78c19d2855b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:42.373552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e97c2dc2-c546-4b6f-8140-d78c19d2855b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:42.443806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c2dc2-c546-4b6f-8140-d78c19d2855b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:42.448039 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d4ca6-df1f-46d4-b93b-15ed38ea8ae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:42.448875 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4ca6-df1f-46d4-b93b-15ed38ea8ae7 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:42.449431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4ca6-df1f-46d4-b93b-15ed38ea8ae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:42.449883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4ca6-df1f-46d4-b93b-15ed38ea8ae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:42.460021 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d4ca6-df1f-46d4-b93b-15ed38ea8ae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:42.461569 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d4ca6-df1f-46d4-b93b-15ed38ea8ae7 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:42.471632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1324/2668] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:42.517817 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c410767-ff4d-4652-b112-1911f2987e01 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:42.519850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5c410767-ff4d-4652-b112-1911f2987e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:42.538496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c410767-ff4d-4652-b112-1911f2987e01 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:42.543918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5333f7-8e97-4655-b5b0-bb8ae4a4814e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:42.544872 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5333f7-8e97-4655-b5b0-bb8ae4a4814e service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:42.545238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5333f7-8e97-4655-b5b0-bb8ae4a4814e service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:42.545606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5333f7-8e97-4655-b5b0-bb8ae4a4814e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:42.565033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:42.616668 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5333f7-8e97-4655-b5b0-bb8ae4a4814e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:42.618085 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5333f7-8e97-4655-b5b0-bb8ae4a4814e service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:42.627777 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1345/2669] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:45.590280 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d4ca6-df1f-46d4-b93b-15ed38ea8ae7 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:45.656505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d4ca6-df1f-46d4-b93b-15ed38ea8ae7 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:45.661180 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:45.661815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:45.662097 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:45.662371 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] PATH_INFO: `/v3/users/ca7f5114da904c7883cb3bada30708b5` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:45.663508 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca7f5114da904c7883cb3bada30708b5)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:45.665529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:45.716553 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca7f5114da904c7883cb3bada30708b5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:45.717216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca7f5114da904c7883cb3bada30708b5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:45.724103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca7f5114da904c7883cb3bada30708b5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:45.724764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca7f5114da904c7883cb3bada30708b5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:45.736743 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca7f5114da904c7883cb3bada30708b5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:45.752234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1325/2670] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:21:45 2022] DELETE /identity/v3/users/ca7f5114da904c7883cb3bada30708b5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:45.757141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131860f-2479-45a9-a33c-0edd039acb0b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:45.757667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131860f-2479-45a9-a33c-0edd039acb0b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:45.757790 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131860f-2479-45a9-a33c-0edd039acb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:45.780118 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7131860f-2479-45a9-a33c-0edd039acb0b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:45.781449 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7131860f-2479-45a9-a33c-0edd039acb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:45.845534 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1346/2671] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:45.858473 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:45.860013 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:45.881707 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:45.924276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956a2a1-06ed-4001-80ee-9ac5944b5400 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:45.928129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3ac23-dd72-4e8f-8c63-eedf58fb6757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:45.928780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3ac23-dd72-4e8f-8c63-eedf58fb6757 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:45.929062 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3ac23-dd72-4e8f-8c63-eedf58fb6757 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:45.929331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3ac23-dd72-4e8f-8c63-eedf58fb6757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:45.938600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3ac23-dd72-4e8f-8c63-eedf58fb6757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:45.940087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3ac23-dd72-4e8f-8c63-eedf58fb6757 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:45.949985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1326/2672] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:21:46.232103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131860f-2479-45a9-a33c-0edd039acb0b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:46.233837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7131860f-2479-45a9-a33c-0edd039acb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:46.256954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131860f-2479-45a9-a33c-0edd039acb0b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:46.263748 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:46.264466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:46.264733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:46.265023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] PATH_INFO: `/v3/projects/4e84858ea4a64c6fbab972538aeefe10` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:46.266205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e84858ea4a64c6fbab972538aeefe10)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:46.268204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:46.457230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e84858ea4a64c6fbab972538aeefe10', 'request_id': 'req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:46.462975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e84858ea4a64c6fbab972538aeefe10', 'request_id': 'req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:46.469379 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e84858ea4a64c6fbab972538aeefe10', 'request_id': 'req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:46.484877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] The token cache is being invalidate because project 4e84858ea4a64c6fbab972538aeefe10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:21:46.485181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:46.485852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:46.487698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1347/2673] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:21:46 2022] DELETE /identity/v3/projects/4e84858ea4a64c6fbab972538aeefe10 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:46.491684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3ac23-dd72-4e8f-8c63-eedf58fb6757 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:46.501629 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3ac23-dd72-4e8f-8c63-eedf58fb6757 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:46.566129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:46.566898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:46.567181 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:46.567466 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] PATH_INFO: `/v3/users/07f1325d3cb2450584b3f1aee2942db1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:46.568941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f1325d3cb2450584b3f1aee2942db1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:46.571632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:46.622575 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f1325d3cb2450584b3f1aee2942db1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:46.623785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f1325d3cb2450584b3f1aee2942db1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:46.631326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f1325d3cb2450584b3f1aee2942db1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:46.632129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f1325d3cb2450584b3f1aee2942db1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:46.644974 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f1325d3cb2450584b3f1aee2942db1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:46.662591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1327/2674] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:21:46 2022] DELETE /identity/v3/users/07f1325d3cb2450584b3f1aee2942db1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:46.980175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:46.981698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:46.994635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61b67d-f1a6-4fde-a3ed-5c4ca6897a29 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:47.034092 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:47.059985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:47.060701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:47.060976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:47.061227 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] PATH_INFO: `/v3/projects/3b3a011e66374adaac1511f6cf473017` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:47.062374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b3a011e66374adaac1511f6cf473017)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:47.064312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:47.115723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b3a011e66374adaac1511f6cf473017', 'request_id': 'req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.122970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b3a011e66374adaac1511f6cf473017', 'request_id': 'req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.131305 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b3a011e66374adaac1511f6cf473017', 'request_id': 'req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.147610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] The token cache is being invalidate because project 3b3a011e66374adaac1511f6cf473017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:21:47.147898 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.148582 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.150071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1348/2675] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:21:46 2022] DELETE /identity/v3/projects/3b3a011e66374adaac1511f6cf473017 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:47.154311 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:47.155896 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:47.169306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490582d9-fe65-4859-84ca-7d773e874184 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:47.215447 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:47.237700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5f26f-a148-4278-92e9-e2bad43edbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:47.238854 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5f26f-a148-4278-92e9-e2bad43edbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:47.239134 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5f26f-a148-4278-92e9-e2bad43edbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:47.239443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5f26f-a148-4278-92e9-e2bad43edbd3 admin admin] PATH_INFO: `/v3/users/2e69b80766d34106b6edfbf5d5aded54` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:47.240617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5f26f-a148-4278-92e9-e2bad43edbd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e69b80766d34106b6edfbf5d5aded54)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:47.242617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5f26f-a148-4278-92e9-e2bad43edbd3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:47.298464 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-adf5f26f-a148-4278-92e9-e2bad43edbd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e69b80766d34106b6edfbf5d5aded54'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.299104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-adf5f26f-a148-4278-92e9-e2bad43edbd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e69b80766d34106b6edfbf5d5aded54'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.307242 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-adf5f26f-a148-4278-92e9-e2bad43edbd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e69b80766d34106b6edfbf5d5aded54'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.307960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-adf5f26f-a148-4278-92e9-e2bad43edbd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e69b80766d34106b6edfbf5d5aded54'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.321744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-adf5f26f-a148-4278-92e9-e2bad43edbd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e69b80766d34106b6edfbf5d5aded54'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.336760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1328/2676] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:21:47 2022] DELETE /identity/v3/users/2e69b80766d34106b6edfbf5d5aded54 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:21:47.634182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:47.635876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:47.650217 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28becf-f00d-49b3-b0cc-cc0efb7cb481 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:47.720742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5bb3b-60bf-4e0f-b843-906638bc89f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:47.721381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5bb3b-60bf-4e0f-b843-906638bc89f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:47.722042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5bb3b-60bf-4e0f-b843-906638bc89f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:47.722042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5bb3b-60bf-4e0f-b843-906638bc89f5 admin admin] PATH_INFO: `/v3/projects/c0b6dc607b1642ac80c12f5ab1ec7032` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:47.723585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5bb3b-60bf-4e0f-b843-906638bc89f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b6dc607b1642ac80c12f5ab1ec7032)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:47.725561 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5bb3b-60bf-4e0f-b843-906638bc89f5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:47.777242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-83b5bb3b-60bf-4e0f-b843-906638bc89f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b6dc607b1642ac80c12f5ab1ec7032', 'request_id': 'req-83b5bb3b-60bf-4e0f-b843-906638bc89f5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.784234 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-83b5bb3b-60bf-4e0f-b843-906638bc89f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b6dc607b1642ac80c12f5ab1ec7032', 'request_id': 'req-83b5bb3b-60bf-4e0f-b843-906638bc89f5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.791189 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-83b5bb3b-60bf-4e0f-b843-906638bc89f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b6dc607b1642ac80c12f5ab1ec7032', 'request_id': 'req-83b5bb3b-60bf-4e0f-b843-906638bc89f5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.801323 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:47.806753 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-83b5bb3b-60bf-4e0f-b843-906638bc89f5 admin admin] The token cache is being invalidate because project c0b6dc607b1642ac80c12f5ab1ec7032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:21:47.807218 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-83b5bb3b-60bf-4e0f-b843-906638bc89f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.808231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-83b5bb3b-60bf-4e0f-b843-906638bc89f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:21:47.809994 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1349/2677] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:21:47 2022] DELETE /identity/v3/projects/c0b6dc607b1642ac80c12f5ab1ec7032 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:47.815953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b86ca-6390-465a-bb31-7d4d21a21364 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:47.817160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b86ca-6390-465a-bb31-7d4d21a21364 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:47.817160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b86ca-6390-465a-bb31-7d4d21a21364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:47.838373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0b2b86ca-6390-465a-bb31-7d4d21a21364 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:47.839746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0b2b86ca-6390-465a-bb31-7d4d21a21364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:47.904088 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1329/2678] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:47.912998 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa041-8426-403c-9525-571c679ea0e5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:47.913283 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa041-8426-403c-9525-571c679ea0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:47.913589 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa041-8426-403c-9525-571c679ea0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:47.934883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-970aa041-8426-403c-9525-571c679ea0e5 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:47.936110 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-970aa041-8426-403c-9525-571c679ea0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:47.945282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1350/2679] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:47.950098 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b86ca-6390-465a-bb31-7d4d21a21364 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:47.962635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b86ca-6390-465a-bb31-7d4d21a21364 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:47.968256 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f028743-dc55-4294-bede-5d3d394027b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:47.968891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f028743-dc55-4294-bede-5d3d394027b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:47.969163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f028743-dc55-4294-bede-5d3d394027b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:47.969429 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f028743-dc55-4294-bede-5d3d394027b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:47.970069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f028743-dc55-4294-bede-5d3d394027b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:21:47.970366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f028743-dc55-4294-bede-5d3d394027b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:47.972007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f028743-dc55-4294-bede-5d3d394027b2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:47.984254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1330/2680] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:21:47.989039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aa041-8426-403c-9525-571c679ea0e5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:47.998808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aa041-8426-403c-9525-571c679ea0e5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:48.005211 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9623f-f0ec-4a30-b1aa-b73479601f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:48.005808 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9623f-f0ec-4a30-b1aa-b73479601f43 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:48.006080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9623f-f0ec-4a30-b1aa-b73479601f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:48.006352 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9623f-f0ec-4a30-b1aa-b73479601f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:48.006976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9623f-f0ec-4a30-b1aa-b73479601f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:48.009310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9623f-f0ec-4a30-b1aa-b73479601f43 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:48.043110 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1351/2681] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:47 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:48.047533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f028743-dc55-4294-bede-5d3d394027b2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:48.058307 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f028743-dc55-4294-bede-5d3d394027b2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:48.103972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:48.119216 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985bb91-b21f-43a3-a4a5-8bbe72ded3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:48.119857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985bb91-b21f-43a3-a4a5-8bbe72ded3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:48.120131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985bb91-b21f-43a3-a4a5-8bbe72ded3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:48.120432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985bb91-b21f-43a3-a4a5-8bbe72ded3d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:48.121065 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985bb91-b21f-43a3-a4a5-8bbe72ded3d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:48.123064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985bb91-b21f-43a3-a4a5-8bbe72ded3d1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:48.146307 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1331/2682] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:21:48 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:48.150571 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9623f-f0ec-4a30-b1aa-b73479601f43 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:48.162578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9623f-f0ec-4a30-b1aa-b73479601f43 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:48.168740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba538d-ccae-415b-8ff0-a57daf14991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:48.169372 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba538d-ccae-415b-8ff0-a57daf14991a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:48.169645 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba538d-ccae-415b-8ff0-a57daf14991a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:48.169907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba538d-ccae-415b-8ff0-a57daf14991a admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:48.170555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba538d-ccae-415b-8ff0-a57daf14991a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:48.172204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba538d-ccae-415b-8ff0-a57daf14991a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:48.183349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1352/2683] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:48.187781 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985bb91-b21f-43a3-a4a5-8bbe72ded3d1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:48.198655 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985bb91-b21f-43a3-a4a5-8bbe72ded3d1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:48.205991 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea15da7-8685-4b5d-904a-febc67eb1866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:48.206881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea15da7-8685-4b5d-904a-febc67eb1866 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:48.207361 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea15da7-8685-4b5d-904a-febc67eb1866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:48.207580 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea15da7-8685-4b5d-904a-febc67eb1866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:48.208218 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea15da7-8685-4b5d-904a-febc67eb1866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:48.209920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea15da7-8685-4b5d-904a-febc67eb1866 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:48.222143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1332/2684] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:48.226600 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba538d-ccae-415b-8ff0-a57daf14991a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:48.236853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba538d-ccae-415b-8ff0-a57daf14991a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:48.242200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acace32e-2421-4a90-93b8-10ea5b785308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:48.242851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acace32e-2421-4a90-93b8-10ea5b785308 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:48.243129 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acace32e-2421-4a90-93b8-10ea5b785308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:48.243400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acace32e-2421-4a90-93b8-10ea5b785308 admin admin] PATH_INFO: `/v3/projects/c7df8c28f04b43939f45d4189065e6ea/users/20907cba93bb4ea0a1018675b2313151/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:48.257920 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acace32e-2421-4a90-93b8-10ea5b785308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7df8c28f04b43939f45d4189065e6ea, user_id=20907cba93bb4ea0a1018675b2313151, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:48.260996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acace32e-2421-4a90-93b8-10ea5b785308 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:48.275929 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1353/2685] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:48 2022] PUT /identity/v3/projects/c7df8c28f04b43939f45d4189065e6ea/users/20907cba93bb4ea0a1018675b2313151/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:48.281121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a87fc6-4a92-433f-9c1c-bf7be87c45a9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:48.281408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a87fc6-4a92-433f-9c1c-bf7be87c45a9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:48.281732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a87fc6-4a92-433f-9c1c-bf7be87c45a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:48.302103 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b5a87fc6-4a92-433f-9c1c-bf7be87c45a9 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:48.303322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b5a87fc6-4a92-433f-9c1c-bf7be87c45a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:48.368367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1333/2686] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:21:48.378263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acace32e-2421-4a90-93b8-10ea5b785308 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:48.380155 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-acace32e-2421-4a90-93b8-10ea5b785308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:48.446235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acace32e-2421-4a90-93b8-10ea5b785308 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:48.450267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55775a-7828-4ea5-9305-f4b079ba5c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:48.450877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55775a-7828-4ea5-9305-f4b079ba5c10 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:48.451187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55775a-7828-4ea5-9305-f4b079ba5c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:48.451461 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55775a-7828-4ea5-9305-f4b079ba5c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:48.460723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55775a-7828-4ea5-9305-f4b079ba5c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:48.462246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55775a-7828-4ea5-9305-f4b079ba5c10 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:48.473367 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1354/2687] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:21:49.125414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124620e5-d779-4a5e-8e85-cb48243d5c47 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:49.125971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124620e5-d779-4a5e-8e85-cb48243d5c47 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:49.125971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124620e5-d779-4a5e-8e85-cb48243d5c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:49.156017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-124620e5-d779-4a5e-8e85-cb48243d5c47 None None] MFA Rules not processed for user `20907cba93bb4ea0a1018675b2313151`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:49.157191 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-124620e5-d779-4a5e-8e85-cb48243d5c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:49.225071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1334/2688] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:49.229718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55775a-7828-4ea5-9305-f4b079ba5c10 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:49.239800 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55775a-7828-4ea5-9305-f4b079ba5c10 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:49.244196 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a3977-0eee-4010-b883-e4883c5645d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:49.244820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a3977-0eee-4010-b883-e4883c5645d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:49.245095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a3977-0eee-4010-b883-e4883c5645d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:49.245473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a3977-0eee-4010-b883-e4883c5645d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:49.246114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a3977-0eee-4010-b883-e4883c5645d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:49.248049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a3977-0eee-4010-b883-e4883c5645d4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:49.283129 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1355/2689] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:21:49 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:21:49.284486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124620e5-d779-4a5e-8e85-cb48243d5c47 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:49.295892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124620e5-d779-4a5e-8e85-cb48243d5c47 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:49.348333 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:49.356915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284914b6-24f8-47d1-b514-3e82a3d28867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:49.358197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284914b6-24f8-47d1-b514-3e82a3d28867 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:49.358765 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284914b6-24f8-47d1-b514-3e82a3d28867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:49.359200 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284914b6-24f8-47d1-b514-3e82a3d28867 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:49.359840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284914b6-24f8-47d1-b514-3e82a3d28867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:49.361888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284914b6-24f8-47d1-b514-3e82a3d28867 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:49.388538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1335/2690] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:21:49 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:21:49.394543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a3977-0eee-4010-b883-e4883c5645d4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:49.410172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a3977-0eee-4010-b883-e4883c5645d4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:49.414840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7721329-c052-42bb-89d3-023b79b6bc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:49.415437 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7721329-c052-42bb-89d3-023b79b6bc6d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:49.415710 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7721329-c052-42bb-89d3-023b79b6bc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:49.415975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7721329-c052-42bb-89d3-023b79b6bc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:49.416655 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7721329-c052-42bb-89d3-023b79b6bc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:49.418294 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7721329-c052-42bb-89d3-023b79b6bc6d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:49.428693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1356/2691] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:21:49.432957 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284914b6-24f8-47d1-b514-3e82a3d28867 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:49.443572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284914b6-24f8-47d1-b514-3e82a3d28867 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:49.448838 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fab79-efcc-4d81-9df7-ffa63756f676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:49.449493 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fab79-efcc-4d81-9df7-ffa63756f676 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:49.449766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fab79-efcc-4d81-9df7-ffa63756f676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:49.450047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fab79-efcc-4d81-9df7-ffa63756f676 admin admin] PATH_INFO: `/v3/projects/e3a5fdbef88a425c8c45e2132f9d2586/users/ed96d9ddf13d466798dfa944b3478a33/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:49.465435 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fab79-efcc-4d81-9df7-ffa63756f676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a5fdbef88a425c8c45e2132f9d2586, user_id=ed96d9ddf13d466798dfa944b3478a33, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:49.468130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fab79-efcc-4d81-9df7-ffa63756f676 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:49.483409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1336/2692] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:49 2022] PUT /identity/v3/projects/e3a5fdbef88a425c8c45e2132f9d2586/users/ed96d9ddf13d466798dfa944b3478a33/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:49.487539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7721329-c052-42bb-89d3-023b79b6bc6d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:49.499258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7721329-c052-42bb-89d3-023b79b6bc6d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:49.561654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971756c-8a0e-493e-9228-7bd345434b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:49.562376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971756c-8a0e-493e-9228-7bd345434b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:49.562714 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971756c-8a0e-493e-9228-7bd345434b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:49.563042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971756c-8a0e-493e-9228-7bd345434b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:49.563813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971756c-8a0e-493e-9228-7bd345434b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:49.565553 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971756c-8a0e-493e-9228-7bd345434b32 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:49.571221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:21:49.576662 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1357/2693] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:21:49.580944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fab79-efcc-4d81-9df7-ffa63756f676 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:49.592666 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fab79-efcc-4d81-9df7-ffa63756f676 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:49.599041 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e8701-9ca6-427e-ba0a-7219d7b26f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:49.599707 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8701-9ca6-427e-ba0a-7219d7b26f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:49.600067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8701-9ca6-427e-ba0a-7219d7b26f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:49.600251 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8701-9ca6-427e-ba0a-7219d7b26f98 admin admin] PATH_INFO: `/v3/projects/e3a5fdbef88a425c8c45e2132f9d2586/users/ed96d9ddf13d466798dfa944b3478a33/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:49.602432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e8701-9ca6-427e-ba0a-7219d7b26f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a5fdbef88a425c8c45e2132f9d2586, user_id=ed96d9ddf13d466798dfa944b3478a33, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:49.605184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e8701-9ca6-427e-ba0a-7219d7b26f98 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:49.616372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1337/2694] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:21:49 2022] PUT /identity/v3/projects/e3a5fdbef88a425c8c45e2132f9d2586/users/ed96d9ddf13d466798dfa944b3478a33/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:21:50.279696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8223-dcce-49f4-8749-7745b839789b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:50.280195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8223-dcce-49f4-8749-7745b839789b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:50.280318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8223-dcce-49f4-8749-7745b839789b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:50.310016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-76db8223-dcce-49f4-8749-7745b839789b None None] MFA Rules not processed for user `ed96d9ddf13d466798dfa944b3478a33`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:50.311244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-76db8223-dcce-49f4-8749-7745b839789b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:50.381068 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1358/2695] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:50.393436 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ec84a-1f04-4734-80d9-0b01852648d7 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:50.394072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ec84a-1f04-4734-80d9-0b01852648d7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:50.394423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ec84a-1f04-4734-80d9-0b01852648d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:50.414672 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3c1ec84a-1f04-4734-80d9-0b01852648d7 None None] MFA Rules not processed for user `20907cba93bb4ea0a1018675b2313151`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:21:50.416114 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3c1ec84a-1f04-4734-80d9-0b01852648d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:50.476129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1338/2696] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:21:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:21:50.487895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8223-dcce-49f4-8749-7745b839789b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:21:50.489518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-76db8223-dcce-49f4-8749-7745b839789b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:21:50.587693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8223-dcce-49f4-8749-7745b839789b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:21:50.593795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e21551-6b26-4076-ad10-267716bf834e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:21:50.594440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e21551-6b26-4076-ad10-267716bf834e service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:21:50.594813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e21551-6b26-4076-ad10-267716bf834e service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:21:50.595039 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e21551-6b26-4076-ad10-267716bf834e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:21:50.605389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e21551-6b26-4076-ad10-267716bf834e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:21:50.607117 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e21551-6b26-4076-ad10-267716bf834e service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:21:50.617121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1359/2697] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:21:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:22:00.468683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=44,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:00.569476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ec84a-1f04-4734-80d9-0b01852648d7 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:00.612108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=77 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:00.634522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ec84a-1f04-4734-80d9-0b01852648d7 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:00.638396 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92662d6-99ea-4095-86d5-fa8bf482a5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:00.639006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92662d6-99ea-4095-86d5-fa8bf482a5ee service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:00.639285 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92662d6-99ea-4095-86d5-fa8bf482a5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:00.639565 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92662d6-99ea-4095-86d5-fa8bf482a5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:00.641436 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c92662d6-99ea-4095-86d5-fa8bf482a5ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:00.713923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92662d6-99ea-4095-86d5-fa8bf482a5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:00.715593 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92662d6-99ea-4095-86d5-fa8bf482a5ee service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:00.728050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1339/2698] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:22:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:22:05.284402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e21551-6b26-4076-ad10-267716bf834e service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:05.286024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-20e21551-6b26-4076-ad10-267716bf834e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:05.342360 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e21551-6b26-4076-ad10-267716bf834e service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:05.346088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06015cb2-cb16-4762-870d-dbf8629d82a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:05.346693 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06015cb2-cb16-4762-870d-dbf8629d82a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:05.346959 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06015cb2-cb16-4762-870d-dbf8629d82a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:05.347225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06015cb2-cb16-4762-870d-dbf8629d82a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:05.356549 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06015cb2-cb16-4762-870d-dbf8629d82a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:05.358137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06015cb2-cb16-4762-870d-dbf8629d82a9 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:05.368090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1360/2699] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:22:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:22:10.721863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=50 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:15.363723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=26 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:25.743009 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92662d6-99ea-4095-86d5-fa8bf482a5ee service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:25.744750 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c92662d6-99ea-4095-86d5-fa8bf482a5ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:25.797381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06015cb2-cb16-4762-870d-dbf8629d82a9 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:25.835068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92662d6-99ea-4095-86d5-fa8bf482a5ee service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:25.841435 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179f397-a5a6-4cd1-866f-b01b60a893bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:25.841796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179f397-a5a6-4cd1-866f-b01b60a893bb service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:25.842111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179f397-a5a6-4cd1-866f-b01b60a893bb service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:25.842421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179f397-a5a6-4cd1-866f-b01b60a893bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:25.844213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7179f397-a5a6-4cd1-866f-b01b60a893bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:25.856400 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179f397-a5a6-4cd1-866f-b01b60a893bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:25.858146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179f397-a5a6-4cd1-866f-b01b60a893bb service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:25.875126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06015cb2-cb16-4762-870d-dbf8629d82a9 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:25.876426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1340/2700] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:22:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:22:25.880665 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:25.882282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:25.882282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:25.882524 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] PATH_INFO: `/v3/users/20907cba93bb4ea0a1018675b2313151` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:25.883679 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20907cba93bb4ea0a1018675b2313151)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:25.886058 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:25.933970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20907cba93bb4ea0a1018675b2313151'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:25.934721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20907cba93bb4ea0a1018675b2313151'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:25.943201 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20907cba93bb4ea0a1018675b2313151'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:25.951123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20907cba93bb4ea0a1018675b2313151'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:25.951794 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20907cba93bb4ea0a1018675b2313151'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:25.971113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1361/2701] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:22:25 2022] DELETE /identity/v3/users/20907cba93bb4ea0a1018675b2313151 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:22:26.161937 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179f397-a5a6-4cd1-866f-b01b60a893bb service placement] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:26.183557 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179f397-a5a6-4cd1-866f-b01b60a893bb service placement] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:26.249231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657adee9-a306-4e97-9bc3-97008b8c8a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:26.250211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657adee9-a306-4e97-9bc3-97008b8c8a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:26.250807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657adee9-a306-4e97-9bc3-97008b8c8a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:26.251083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657adee9-a306-4e97-9bc3-97008b8c8a9f admin admin] PATH_INFO: `/v3/projects/c7df8c28f04b43939f45d4189065e6ea` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:26.252244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657adee9-a306-4e97-9bc3-97008b8c8a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7df8c28f04b43939f45d4189065e6ea)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:26.254313 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657adee9-a306-4e97-9bc3-97008b8c8a9f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:26.306955 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-657adee9-a306-4e97-9bc3-97008b8c8a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7df8c28f04b43939f45d4189065e6ea', 'request_id': 'req-657adee9-a306-4e97-9bc3-97008b8c8a9f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.313346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-657adee9-a306-4e97-9bc3-97008b8c8a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7df8c28f04b43939f45d4189065e6ea', 'request_id': 'req-657adee9-a306-4e97-9bc3-97008b8c8a9f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.322801 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-657adee9-a306-4e97-9bc3-97008b8c8a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7df8c28f04b43939f45d4189065e6ea', 'request_id': 'req-657adee9-a306-4e97-9bc3-97008b8c8a9f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.334732 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-657adee9-a306-4e97-9bc3-97008b8c8a9f admin admin] The token cache is being invalidate because project c7df8c28f04b43939f45d4189065e6ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:22:26.335017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-657adee9-a306-4e97-9bc3-97008b8c8a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.335727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-657adee9-a306-4e97-9bc3-97008b8c8a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.337351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1341/2702] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:22:26 2022] DELETE /identity/v3/projects/c7df8c28f04b43939f45d4189065e6ea => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:22:26.341484 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:26.343220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:26.356080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c70d2-2f4a-45d6-8a62-8f6532827db6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:26.416622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:26.417293 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:26.417558 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:26.417827 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] PATH_INFO: `/v3/users/ed96d9ddf13d466798dfa944b3478a33` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:26.419086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed96d9ddf13d466798dfa944b3478a33)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:26.421171 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:26.426864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea16d7d-2970-4726-8704-4d8ddc3e2115 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:26.427147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea16d7d-2970-4726-8704-4d8ddc3e2115 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:26.427423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea16d7d-2970-4726-8704-4d8ddc3e2115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:26.445539 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:26.447441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8ea16d7d-2970-4726-8704-4d8ddc3e2115 None None] MFA Rules not processed for user `a6103fdbcc6d41acb0d113400b3617ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:22:26.448820 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8ea16d7d-2970-4726-8704-4d8ddc3e2115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:26.462726 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:26.473440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed96d9ddf13d466798dfa944b3478a33'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.474127 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed96d9ddf13d466798dfa944b3478a33'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.482778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed96d9ddf13d466798dfa944b3478a33'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.489919 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed96d9ddf13d466798dfa944b3478a33'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.490593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed96d9ddf13d466798dfa944b3478a33'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.508486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1362/2703] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:22:26 2022] DELETE /identity/v3/users/ed96d9ddf13d466798dfa944b3478a33 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:22:26.509499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1342/2704] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:22:26.813152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:26.815103 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:26.890608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f1774-bd9f-475e-b79d-f5f4d24e5b95 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:26.895108 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e54801-b7ee-4c60-ac49-66b4400415fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:26.895744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e54801-b7ee-4c60-ac49-66b4400415fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:26.896022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e54801-b7ee-4c60-ac49-66b4400415fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:26.896486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e54801-b7ee-4c60-ac49-66b4400415fa admin admin] PATH_INFO: `/v3/projects/e3a5fdbef88a425c8c45e2132f9d2586` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:26.897468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e54801-b7ee-4c60-ac49-66b4400415fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a5fdbef88a425c8c45e2132f9d2586)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:26.900325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e54801-b7ee-4c60-ac49-66b4400415fa admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:26.952280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d2e54801-b7ee-4c60-ac49-66b4400415fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a5fdbef88a425c8c45e2132f9d2586', 'request_id': 'req-d2e54801-b7ee-4c60-ac49-66b4400415fa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.957686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d2e54801-b7ee-4c60-ac49-66b4400415fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a5fdbef88a425c8c45e2132f9d2586', 'request_id': 'req-d2e54801-b7ee-4c60-ac49-66b4400415fa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.964123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d2e54801-b7ee-4c60-ac49-66b4400415fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a5fdbef88a425c8c45e2132f9d2586', 'request_id': 'req-d2e54801-b7ee-4c60-ac49-66b4400415fa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.979495 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d2e54801-b7ee-4c60-ac49-66b4400415fa admin admin] The token cache is being invalidate because project e3a5fdbef88a425c8c45e2132f9d2586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:22:26.979858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d2e54801-b7ee-4c60-ac49-66b4400415fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.980530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d2e54801-b7ee-4c60-ac49-66b4400415fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:26.982071 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1363/2705] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:22:26 2022] DELETE /identity/v3/projects/e3a5fdbef88a425c8c45e2132f9d2586 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:22:26.987131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecdd5e-d3ee-45bf-bf09-c51ba342c80a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:26.987627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecdd5e-d3ee-45bf-bf09-c51ba342c80a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:26.987731 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecdd5e-d3ee-45bf-bf09-c51ba342c80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.009839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b4ecdd5e-d3ee-45bf-bf09-c51ba342c80a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:22:27.011063 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b4ecdd5e-d3ee-45bf-bf09-c51ba342c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:27.075033 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1343/2706] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:22:27.083133 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e6fa-f454-4ddf-9767-63055ef022bd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.083511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e6fa-f454-4ddf-9767-63055ef022bd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.083878 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e6fa-f454-4ddf-9767-63055ef022bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.106413 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9d80e6fa-f454-4ddf-9767-63055ef022bd None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:22:27.107685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9d80e6fa-f454-4ddf-9767-63055ef022bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:27.115608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1364/2707] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:22:27.120576 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecdd5e-d3ee-45bf-bf09-c51ba342c80a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:27.130792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecdd5e-d3ee-45bf-bf09-c51ba342c80a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:27.136622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b531a-3e0f-4833-873b-66f4b22227ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:27.137231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b531a-3e0f-4833-873b-66f4b22227ee admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.137493 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b531a-3e0f-4833-873b-66f4b22227ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.137762 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b531a-3e0f-4833-873b-66f4b22227ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.138407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b531a-3e0f-4833-873b-66f4b22227ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:22:27.138706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b531a-3e0f-4833-873b-66f4b22227ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:27.140372 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b531a-3e0f-4833-873b-66f4b22227ee admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:27.152518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1344/2708] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:22:27.157173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80e6fa-f454-4ddf-9767-63055ef022bd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:27.167980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80e6fa-f454-4ddf-9767-63055ef022bd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:27.172941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec0bf9-1504-46e4-896b-c57ecadb206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:27.173562 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec0bf9-1504-46e4-896b-c57ecadb206b admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.173834 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec0bf9-1504-46e4-896b-c57ecadb206b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.174098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec0bf9-1504-46e4-896b-c57ecadb206b admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.174719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec0bf9-1504-46e4-896b-c57ecadb206b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:27.176696 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec0bf9-1504-46e4-896b-c57ecadb206b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:27.199951 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:27.222650 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1365/2709] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:22:27 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:22:27.226927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b531a-3e0f-4833-873b-66f4b22227ee admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:27.237811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b531a-3e0f-4833-873b-66f4b22227ee admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:27.307072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed01206-f7e4-4c8a-a232-91fc254e67eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:27.307695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed01206-f7e4-4c8a-a232-91fc254e67eb admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.307972 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed01206-f7e4-4c8a-a232-91fc254e67eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.308244 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed01206-f7e4-4c8a-a232-91fc254e67eb admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.308923 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed01206-f7e4-4c8a-a232-91fc254e67eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:27.310900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed01206-f7e4-4c8a-a232-91fc254e67eb admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:27.337075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1345/2710] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:22:27 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:22:27.340989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec0bf9-1504-46e4-896b-c57ecadb206b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:27.352160 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec0bf9-1504-46e4-896b-c57ecadb206b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:27.357239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8901a-39ed-4863-b56f-963e0246cf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:27.357990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8901a-39ed-4863-b56f-963e0246cf98 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.358262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8901a-39ed-4863-b56f-963e0246cf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.358529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8901a-39ed-4863-b56f-963e0246cf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.359167 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8901a-39ed-4863-b56f-963e0246cf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:27.360853 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8901a-39ed-4863-b56f-963e0246cf98 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:27.376556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1366/2711] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:22:27.380212 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed01206-f7e4-4c8a-a232-91fc254e67eb admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:27.390798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed01206-f7e4-4c8a-a232-91fc254e67eb admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:27.395446 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1459f-5968-433b-8f6b-8d256cb7a2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:27.396073 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1459f-5968-433b-8f6b-8d256cb7a2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.396408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1459f-5968-433b-8f6b-8d256cb7a2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.396631 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1459f-5968-433b-8f6b-8d256cb7a2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.397272 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1459f-5968-433b-8f6b-8d256cb7a2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:27.399143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1459f-5968-433b-8f6b-8d256cb7a2b3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:27.410486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1346/2712] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:22:27.415205 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8901a-39ed-4863-b56f-963e0246cf98 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:27.425037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8901a-39ed-4863-b56f-963e0246cf98 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:27.429949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac254d9-1d7c-47ac-97fe-e63a3e24e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:27.430602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac254d9-1d7c-47ac-97fe-e63a3e24e7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.430875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac254d9-1d7c-47ac-97fe-e63a3e24e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.431144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac254d9-1d7c-47ac-97fe-e63a3e24e7ec admin admin] PATH_INFO: `/v3/projects/5011c4f0b8fe45be9d267e6ad1b48e9b/users/750d55f4774c4c0eae634ac55572dbd9/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.446947 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac254d9-1d7c-47ac-97fe-e63a3e24e7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5011c4f0b8fe45be9d267e6ad1b48e9b, user_id=750d55f4774c4c0eae634ac55572dbd9, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:27.449674 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac254d9-1d7c-47ac-97fe-e63a3e24e7ec admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:27.464648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1367/2713] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:22:27 2022] PUT /identity/v3/projects/5011c4f0b8fe45be9d267e6ad1b48e9b/users/750d55f4774c4c0eae634ac55572dbd9/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:22:27.476044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15630c-ecde-4779-827c-eef4abf42616 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.476752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15630c-ecde-4779-827c-eef4abf42616 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.476954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15630c-ecde-4779-827c-eef4abf42616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.505793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3d15630c-ecde-4779-827c-eef4abf42616 None None] MFA Rules not processed for user `750d55f4774c4c0eae634ac55572dbd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:22:27.507373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3d15630c-ecde-4779-827c-eef4abf42616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:27.526432 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:27.578204 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1347/2714] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:22:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:22:27.583010 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac254d9-1d7c-47ac-97fe-e63a3e24e7ec admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:27.653519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac254d9-1d7c-47ac-97fe-e63a3e24e7ec admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:27.659082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2b89-aba9-4bfa-934f-29e0d5303043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:27.659702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2b89-aba9-4bfa-934f-29e0d5303043 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.659979 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2b89-aba9-4bfa-934f-29e0d5303043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.660244 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2b89-aba9-4bfa-934f-29e0d5303043 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.660919 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2b89-aba9-4bfa-934f-29e0d5303043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:27.662857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2b89-aba9-4bfa-934f-29e0d5303043 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:27.694184 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1368/2715] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:22:27 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:22:27.697649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15630c-ecde-4779-827c-eef4abf42616 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:27.709121 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15630c-ecde-4779-827c-eef4abf42616 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:27.778337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193ea5d-69e6-49a6-afbf-8ba152cc8bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:27.778993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193ea5d-69e6-49a6-afbf-8ba152cc8bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.779267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193ea5d-69e6-49a6-afbf-8ba152cc8bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.779539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193ea5d-69e6-49a6-afbf-8ba152cc8bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.780229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193ea5d-69e6-49a6-afbf-8ba152cc8bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:27.782228 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193ea5d-69e6-49a6-afbf-8ba152cc8bf5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:27.807825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1348/2716] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:22:27 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:22:27.811901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2b89-aba9-4bfa-934f-29e0d5303043 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:27.822948 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2b89-aba9-4bfa-934f-29e0d5303043 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:27.828198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45093639-229b-4932-9265-85acc07c066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:27.828892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45093639-229b-4932-9265-85acc07c066a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.829085 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45093639-229b-4932-9265-85acc07c066a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.829369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45093639-229b-4932-9265-85acc07c066a admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.830009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45093639-229b-4932-9265-85acc07c066a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:27.831629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45093639-229b-4932-9265-85acc07c066a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:27.842739 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1369/2717] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:22:27.847664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193ea5d-69e6-49a6-afbf-8ba152cc8bf5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:27.859009 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193ea5d-69e6-49a6-afbf-8ba152cc8bf5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:27.864375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cacd11-af9e-42db-8439-07fd9ec7b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:27.865253 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cacd11-af9e-42db-8439-07fd9ec7b17b admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.865530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cacd11-af9e-42db-8439-07fd9ec7b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.865790 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cacd11-af9e-42db-8439-07fd9ec7b17b admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.866604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cacd11-af9e-42db-8439-07fd9ec7b17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:27.869101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cacd11-af9e-42db-8439-07fd9ec7b17b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:27.880260 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1349/2718] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:22:27.885909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45093639-229b-4932-9265-85acc07c066a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:27.896422 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45093639-229b-4932-9265-85acc07c066a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:27.901822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec3789-e636-4e0f-9e42-076bae4b6f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:27.902471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec3789-e636-4e0f-9e42-076bae4b6f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.902742 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec3789-e636-4e0f-9e42-076bae4b6f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.903006 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec3789-e636-4e0f-9e42-076bae4b6f8a admin admin] PATH_INFO: `/v3/projects/77a4e9e11982403ea0370c84ce48d579/users/2c6d33d66f8848efbccacf129970d9cd/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.918366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec3789-e636-4e0f-9e42-076bae4b6f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a4e9e11982403ea0370c84ce48d579, user_id=2c6d33d66f8848efbccacf129970d9cd, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:27.921118 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec3789-e636-4e0f-9e42-076bae4b6f8a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:27.936207 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1370/2719] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:22:27 2022] PUT /identity/v3/projects/77a4e9e11982403ea0370c84ce48d579/users/2c6d33d66f8848efbccacf129970d9cd/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:22:27.947229 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51871d6-4407-4cdc-99a8-9218ab6d953a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:27.947515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51871d6-4407-4cdc-99a8-9218ab6d953a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:27.947791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51871d6-4407-4cdc-99a8-9218ab6d953a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:27.985531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c51871d6-4407-4cdc-99a8-9218ab6d953a None None] MFA Rules not processed for user `2c6d33d66f8848efbccacf129970d9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:22:27.986949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c51871d6-4407-4cdc-99a8-9218ab6d953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:28.064139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1350/2720] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:22:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:22:28.068831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec3789-e636-4e0f-9e42-076bae4b6f8a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:28.131418 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec3789-e636-4e0f-9e42-076bae4b6f8a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:28.136849 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26566005-0fea-4ca0-bbb0-cd8149e614b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:28.137459 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26566005-0fea-4ca0-bbb0-cd8149e614b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:28.137730 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26566005-0fea-4ca0-bbb0-cd8149e614b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:28.137993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26566005-0fea-4ca0-bbb0-cd8149e614b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:28.138623 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26566005-0fea-4ca0-bbb0-cd8149e614b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:28.140597 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26566005-0fea-4ca0-bbb0-cd8149e614b8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:28.152041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:28.173230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1371/2721] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:22:28 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:22:28.177538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51871d6-4407-4cdc-99a8-9218ab6d953a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:28.189243 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51871d6-4407-4cdc-99a8-9218ab6d953a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:28.219294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:28.254383 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8877c46-5bb0-4cdc-b11b-02c3a8e771ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:28.255290 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8877c46-5bb0-4cdc-b11b-02c3a8e771ce admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:28.255567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8877c46-5bb0-4cdc-b11b-02c3a8e771ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:28.255836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8877c46-5bb0-4cdc-b11b-02c3a8e771ce admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:28.256529 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8877c46-5bb0-4cdc-b11b-02c3a8e771ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:28.259258 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8877c46-5bb0-4cdc-b11b-02c3a8e771ce admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:28.286996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1351/2722] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:22:28 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:22:28.290972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26566005-0fea-4ca0-bbb0-cd8149e614b8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:28.304063 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26566005-0fea-4ca0-bbb0-cd8149e614b8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:28.309338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf3b0f-d9cd-4292-8c47-6b15759a1d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:28.310173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3b0f-d9cd-4292-8c47-6b15759a1d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:28.310643 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3b0f-d9cd-4292-8c47-6b15759a1d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:28.311243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3b0f-d9cd-4292-8c47-6b15759a1d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:28.312843 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf3b0f-d9cd-4292-8c47-6b15759a1d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:28.315011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf3b0f-d9cd-4292-8c47-6b15759a1d5b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:28.329625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1372/2723] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:22:28.333276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8877c46-5bb0-4cdc-b11b-02c3a8e771ce admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:28.347595 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8877c46-5bb0-4cdc-b11b-02c3a8e771ce admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:28.354854 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca321d7b-2c06-445b-8075-68854c85a11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:28.355745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca321d7b-2c06-445b-8075-68854c85a11f admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:28.356092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca321d7b-2c06-445b-8075-68854c85a11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:28.356386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca321d7b-2c06-445b-8075-68854c85a11f admin admin] PATH_INFO: `/v3/projects/c11d7799b97e449bb0f35b7ec30d91e9/users/5a1c234f1f4c47a0914216780e020a6e/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:28.373872 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca321d7b-2c06-445b-8075-68854c85a11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11d7799b97e449bb0f35b7ec30d91e9, user_id=5a1c234f1f4c47a0914216780e020a6e, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:28.376662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca321d7b-2c06-445b-8075-68854c85a11f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:28.396428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1352/2724] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:22:28 2022] PUT /identity/v3/projects/c11d7799b97e449bb0f35b7ec30d91e9/users/5a1c234f1f4c47a0914216780e020a6e/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:22:28.398220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf3b0f-d9cd-4292-8c47-6b15759a1d5b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:28.409927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf3b0f-d9cd-4292-8c47-6b15759a1d5b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:28.469304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6202241-5e22-46a7-b302-3b962e0d039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:28.469914 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6202241-5e22-46a7-b302-3b962e0d039d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:28.470185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6202241-5e22-46a7-b302-3b962e0d039d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:28.470450 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6202241-5e22-46a7-b302-3b962e0d039d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:28.471083 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6202241-5e22-46a7-b302-3b962e0d039d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:28.472755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6202241-5e22-46a7-b302-3b962e0d039d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:28.483178 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1373/2725] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:22:28.487260 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca321d7b-2c06-445b-8075-68854c85a11f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:28.499188 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca321d7b-2c06-445b-8075-68854c85a11f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:28.505077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa22095-deb9-4774-8fa7-d8ef95f14e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:28.505754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa22095-deb9-4774-8fa7-d8ef95f14e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:28.506051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa22095-deb9-4774-8fa7-d8ef95f14e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:28.506326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa22095-deb9-4774-8fa7-d8ef95f14e71 admin admin] PATH_INFO: `/v3/projects/c11d7799b97e449bb0f35b7ec30d91e9/users/5a1c234f1f4c47a0914216780e020a6e/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:28.509577 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa22095-deb9-4774-8fa7-d8ef95f14e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11d7799b97e449bb0f35b7ec30d91e9, user_id=5a1c234f1f4c47a0914216780e020a6e, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:28.512283 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa22095-deb9-4774-8fa7-d8ef95f14e71 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:28.524104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1353/2726] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:22:28 2022] PUT /identity/v3/projects/c11d7799b97e449bb0f35b7ec30d91e9/users/5a1c234f1f4c47a0914216780e020a6e/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:22:28.534594 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500089e-41d9-4991-bc3d-520dc50c1f0c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:28.534884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500089e-41d9-4991-bc3d-520dc50c1f0c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:28.535151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500089e-41d9-4991-bc3d-520dc50c1f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:28.564339 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8500089e-41d9-4991-bc3d-520dc50c1f0c None None] MFA Rules not processed for user `5a1c234f1f4c47a0914216780e020a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:22:28.565573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8500089e-41d9-4991-bc3d-520dc50c1f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:28.641336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1374/2727] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:22:28.649027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa22095-deb9-4774-8fa7-d8ef95f14e71 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:28.650813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6aa22095-deb9-4774-8fa7-d8ef95f14e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:28.713915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa22095-deb9-4774-8fa7-d8ef95f14e71 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:28.717626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac04b32-d2ec-4195-b06f-6b7fa583ea70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:28.718266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac04b32-d2ec-4195-b06f-6b7fa583ea70 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:28.718532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac04b32-d2ec-4195-b06f-6b7fa583ea70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:28.718795 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac04b32-d2ec-4195-b06f-6b7fa583ea70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:28.775753 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac04b32-d2ec-4195-b06f-6b7fa583ea70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:28.777263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac04b32-d2ec-4195-b06f-6b7fa583ea70 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:28.786516 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1354/2728] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:22:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:22:30.365941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500089e-41d9-4991-bc3d-520dc50c1f0c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:30.367672 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8500089e-41d9-4991-bc3d-520dc50c1f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:30.380398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500089e-41d9-4991-bc3d-520dc50c1f0c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:30.385407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dc691-645e-4060-baf2-a4fd7f113c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:30.386292 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dc691-645e-4060-baf2-a4fd7f113c06 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:30.386635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dc691-645e-4060-baf2-a4fd7f113c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:30.386995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dc691-645e-4060-baf2-a4fd7f113c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:30.450850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dc691-645e-4060-baf2-a4fd7f113c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:30.452404 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dc691-645e-4060-baf2-a4fd7f113c06 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:30.460383 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:30.479941 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1375/2729] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:22:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:22:31.118863 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac04b32-d2ec-4195-b06f-6b7fa583ea70 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:31.127782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac04b32-d2ec-4195-b06f-6b7fa583ea70 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:31.132275 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9033de9-01ab-477c-a938-34158a38e766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:31.132970 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9033de9-01ab-477c-a938-34158a38e766 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:31.133231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9033de9-01ab-477c-a938-34158a38e766 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:31.133499 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9033de9-01ab-477c-a938-34158a38e766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:31.142796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9033de9-01ab-477c-a938-34158a38e766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:31.144276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9033de9-01ab-477c-a938-34158a38e766 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:31.155540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1355/2730] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:22:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:22:35.122610 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dc691-645e-4060-baf2-a4fd7f113c06 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:35.191113 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dc691-645e-4060-baf2-a4fd7f113c06 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:35.196698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:35.197317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:35.197585 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:35.197851 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] PATH_INFO: `/v3/users/750d55f4774c4c0eae634ac55572dbd9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:35.199231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=750d55f4774c4c0eae634ac55572dbd9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:35.201465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:35.253944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '750d55f4774c4c0eae634ac55572dbd9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:35.254630 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '750d55f4774c4c0eae634ac55572dbd9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:35.263887 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '750d55f4774c4c0eae634ac55572dbd9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:35.272276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '750d55f4774c4c0eae634ac55572dbd9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:35.273260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '750d55f4774c4c0eae634ac55572dbd9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:35.293176 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1376/2731] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:22:35 2022] DELETE /identity/v3/users/750d55f4774c4c0eae634ac55572dbd9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:22:35.297940 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8da4-ad21-42a7-9b7b-08bfd45e540d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:35.298414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8da4-ad21-42a7-9b7b-08bfd45e540d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:35.298414 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8da4-ad21-42a7-9b7b-08bfd45e540d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:35.319162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-aa0a8da4-ad21-42a7-9b7b-08bfd45e540d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:22:35.320406 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-aa0a8da4-ad21-42a7-9b7b-08bfd45e540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:35.343616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:35.393811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1356/2732] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:22:35.404009 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:35.405538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:35.466871 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbca15c-5a7e-46ae-849f-b8b09c1b0030 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:35.472514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c44c3c-a5be-4b7e-a43d-fa456f438c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:35.473107 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c44c3c-a5be-4b7e-a43d-fa456f438c69 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:35.473388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c44c3c-a5be-4b7e-a43d-fa456f438c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:35.473648 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c44c3c-a5be-4b7e-a43d-fa456f438c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:35.486993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c44c3c-a5be-4b7e-a43d-fa456f438c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:35.489376 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c44c3c-a5be-4b7e-a43d-fa456f438c69 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:35.503175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1377/2733] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:22:35.573953 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a8da4-ad21-42a7-9b7b-08bfd45e540d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:35.587435 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a8da4-ad21-42a7-9b7b-08bfd45e540d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:35.591728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b5645-99c9-4206-9769-504fa98a6c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:35.592452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b5645-99c9-4206-9769-504fa98a6c53 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:35.592810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b5645-99c9-4206-9769-504fa98a6c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:35.593143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b5645-99c9-4206-9769-504fa98a6c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:35.595255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bb4b5645-99c9-4206-9769-504fa98a6c53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:35.671907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b5645-99c9-4206-9769-504fa98a6c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:35.673486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b5645-99c9-4206-9769-504fa98a6c53 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:35.685326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1357/2734] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:22:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:22:35.896450 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c44c3c-a5be-4b7e-a43d-fa456f438c69 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:35.898117 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-15c44c3c-a5be-4b7e-a43d-fa456f438c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:35.914106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c44c3c-a5be-4b7e-a43d-fa456f438c69 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:35.918530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:35.919288 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:35.920869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:35.921345 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] PATH_INFO: `/v3/projects/5011c4f0b8fe45be9d267e6ad1b48e9b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:35.923125 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5011c4f0b8fe45be9d267e6ad1b48e9b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:35.926758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:35.945349 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:35.978609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5011c4f0b8fe45be9d267e6ad1b48e9b', 'request_id': 'req-4daab4d7-b697-41a3-9cf2-33a80ebccb36'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:35.985681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5011c4f0b8fe45be9d267e6ad1b48e9b', 'request_id': 'req-4daab4d7-b697-41a3-9cf2-33a80ebccb36'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:35.992655 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5011c4f0b8fe45be9d267e6ad1b48e9b', 'request_id': 'req-4daab4d7-b697-41a3-9cf2-33a80ebccb36'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.007456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] The token cache is being invalidate because project 5011c4f0b8fe45be9d267e6ad1b48e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:22:36.007736 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.008385 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.009888 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1378/2735] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:22:35 2022] DELETE /identity/v3/projects/5011c4f0b8fe45be9d267e6ad1b48e9b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:22:36.014023 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b5645-99c9-4206-9769-504fa98a6c53 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:36.024785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b5645-99c9-4206-9769-504fa98a6c53 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:36.085265 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:36.085898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:36.086172 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:36.086443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] PATH_INFO: `/v3/users/2c6d33d66f8848efbccacf129970d9cd` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:36.087546 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6d33d66f8848efbccacf129970d9cd)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:36.089540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:36.141261 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6d33d66f8848efbccacf129970d9cd'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.141852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6d33d66f8848efbccacf129970d9cd'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.143884 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:36.150130 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6d33d66f8848efbccacf129970d9cd'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.150911 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6d33d66f8848efbccacf129970d9cd'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.163467 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6d33d66f8848efbccacf129970d9cd'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.178197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1358/2736] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:22:36 2022] DELETE /identity/v3/users/2c6d33d66f8848efbccacf129970d9cd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:22:36.455299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:36.456876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:36.473711 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daab4d7-b697-41a3-9cf2-33a80ebccb36 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:36.539927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:36.540592 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:36.540867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:36.541135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] PATH_INFO: `/v3/projects/77a4e9e11982403ea0370c84ce48d579` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:36.542243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a4e9e11982403ea0370c84ce48d579)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:36.544225 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:36.592861 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a4e9e11982403ea0370c84ce48d579', 'request_id': 'req-91d1d6cf-d624-4674-b431-35f4303ae96b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.598568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a4e9e11982403ea0370c84ce48d579', 'request_id': 'req-91d1d6cf-d624-4674-b431-35f4303ae96b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.605350 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a4e9e11982403ea0370c84ce48d579', 'request_id': 'req-91d1d6cf-d624-4674-b431-35f4303ae96b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.622455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] The token cache is being invalidate because project 77a4e9e11982403ea0370c84ce48d579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:22:36.622761 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.623429 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.625080 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1379/2737] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:22:36 2022] DELETE /identity/v3/projects/77a4e9e11982403ea0370c84ce48d579 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:22:36.629245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:36.630845 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:36.644254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432448d5-6d96-48b8-98f8-d51d825b9d77 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:36.701092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5b8cc-93ca-4811-a04e-6eb6214326fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:36.701738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5b8cc-93ca-4811-a04e-6eb6214326fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:36.702020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5b8cc-93ca-4811-a04e-6eb6214326fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:36.702297 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5b8cc-93ca-4811-a04e-6eb6214326fa admin admin] PATH_INFO: `/v3/users/5a1c234f1f4c47a0914216780e020a6e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:36.703532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5b8cc-93ca-4811-a04e-6eb6214326fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1c234f1f4c47a0914216780e020a6e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:36.705531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5b8cc-93ca-4811-a04e-6eb6214326fa admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:36.757419 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aea5b8cc-93ca-4811-a04e-6eb6214326fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1c234f1f4c47a0914216780e020a6e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.758176 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aea5b8cc-93ca-4811-a04e-6eb6214326fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1c234f1f4c47a0914216780e020a6e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.765594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aea5b8cc-93ca-4811-a04e-6eb6214326fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1c234f1f4c47a0914216780e020a6e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.766236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aea5b8cc-93ca-4811-a04e-6eb6214326fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1c234f1f4c47a0914216780e020a6e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.779153 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aea5b8cc-93ca-4811-a04e-6eb6214326fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1c234f1f4c47a0914216780e020a6e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:36.792254 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1359/2738] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:22:36 2022] DELETE /identity/v3/users/5a1c234f1f4c47a0914216780e020a6e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:22:37.072467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:37.073884 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:37.088340 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1d6cf-d624-4674-b431-35f4303ae96b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:37.122364 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:37.149221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbd164-1414-475b-914c-30a518dd1206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:37.149770 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbd164-1414-475b-914c-30a518dd1206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:37.150044 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbd164-1414-475b-914c-30a518dd1206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:37.150283 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbd164-1414-475b-914c-30a518dd1206 admin admin] PATH_INFO: `/v3/projects/c11d7799b97e449bb0f35b7ec30d91e9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:37.151425 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbd164-1414-475b-914c-30a518dd1206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11d7799b97e449bb0f35b7ec30d91e9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:37.153788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbd164-1414-475b-914c-30a518dd1206 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:37.201556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-73cbd164-1414-475b-914c-30a518dd1206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11d7799b97e449bb0f35b7ec30d91e9', 'request_id': 'req-73cbd164-1414-475b-914c-30a518dd1206'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:37.207011 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-73cbd164-1414-475b-914c-30a518dd1206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11d7799b97e449bb0f35b7ec30d91e9', 'request_id': 'req-73cbd164-1414-475b-914c-30a518dd1206'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:37.213064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-73cbd164-1414-475b-914c-30a518dd1206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11d7799b97e449bb0f35b7ec30d91e9', 'request_id': 'req-73cbd164-1414-475b-914c-30a518dd1206'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:37.226959 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-73cbd164-1414-475b-914c-30a518dd1206 admin admin] The token cache is being invalidate because project c11d7799b97e449bb0f35b7ec30d91e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:22:37.227236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-73cbd164-1414-475b-914c-30a518dd1206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:37.227880 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-73cbd164-1414-475b-914c-30a518dd1206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:22:37.229410 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1380/2739] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:22:37 2022] DELETE /identity/v3/projects/c11d7799b97e449bb0f35b7ec30d91e9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:22:37.235358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b300-5b68-44d7-871a-d71ee4ef575b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:37.235705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b300-5b68-44d7-871a-d71ee4ef575b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:37.235985 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b300-5b68-44d7-871a-d71ee4ef575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:37.258377 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2170b300-5b68-44d7-871a-d71ee4ef575b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:22:37.259578 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2170b300-5b68-44d7-871a-d71ee4ef575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:37.435469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:37.464899 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1360/2740] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:22:37.531699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad36b43-58f2-43cc-ad1a-50b1b95af10d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:37.532264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad36b43-58f2-43cc-ad1a-50b1b95af10d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:37.532264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad36b43-58f2-43cc-ad1a-50b1b95af10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:37.553426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7ad36b43-58f2-43cc-ad1a-50b1b95af10d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:22:37.554618 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7ad36b43-58f2-43cc-ad1a-50b1b95af10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:37.563048 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1381/2741] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:22:37.568738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b300-5b68-44d7-871a-d71ee4ef575b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:37.579620 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b300-5b68-44d7-871a-d71ee4ef575b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:37.585445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be0edf-5bfe-4797-acfc-5685713b9420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:37.586055 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0edf-5bfe-4797-acfc-5685713b9420 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:37.586358 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0edf-5bfe-4797-acfc-5685713b9420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:37.586627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0edf-5bfe-4797-acfc-5685713b9420 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:37.587293 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be0edf-5bfe-4797-acfc-5685713b9420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:22:37.587596 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be0edf-5bfe-4797-acfc-5685713b9420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:37.589298 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be0edf-5bfe-4797-acfc-5685713b9420 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:37.603129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1361/2742] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:22:37.608653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad36b43-58f2-43cc-ad1a-50b1b95af10d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:37.620032 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad36b43-58f2-43cc-ad1a-50b1b95af10d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:37.625792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcbccb-03db-4f3e-9eea-7f75985ce8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:37.626423 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcbccb-03db-4f3e-9eea-7f75985ce8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:37.626704 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcbccb-03db-4f3e-9eea-7f75985ce8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:37.626968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcbccb-03db-4f3e-9eea-7f75985ce8d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:37.627615 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcbccb-03db-4f3e-9eea-7f75985ce8d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:37.629596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcbccb-03db-4f3e-9eea-7f75985ce8d9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:37.661153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1382/2743] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:22:37 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:22:37.665528 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be0edf-5bfe-4797-acfc-5685713b9420 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:37.675974 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be0edf-5bfe-4797-acfc-5685713b9420 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:37.735124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56c08e-d176-49ce-91c4-61ea5c688100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:37.735679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56c08e-d176-49ce-91c4-61ea5c688100 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:37.735962 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56c08e-d176-49ce-91c4-61ea5c688100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:37.736234 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56c08e-d176-49ce-91c4-61ea5c688100 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:37.736918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56c08e-d176-49ce-91c4-61ea5c688100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:37.738887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56c08e-d176-49ce-91c4-61ea5c688100 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:37.762922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1362/2744] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:22:37 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:22:37.767224 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcbccb-03db-4f3e-9eea-7f75985ce8d9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:37.778295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcbccb-03db-4f3e-9eea-7f75985ce8d9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:37.783384 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56057c-9648-48b6-9179-bef6e076d1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:37.784041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56057c-9648-48b6-9179-bef6e076d1be admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:37.784357 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56057c-9648-48b6-9179-bef6e076d1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:37.784624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56057c-9648-48b6-9179-bef6e076d1be admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:37.785267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56057c-9648-48b6-9179-bef6e076d1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:37.786924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56057c-9648-48b6-9179-bef6e076d1be admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:37.797183 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1383/2745] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:22:37.801468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56c08e-d176-49ce-91c4-61ea5c688100 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:37.812418 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56c08e-d176-49ce-91c4-61ea5c688100 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:37.818196 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b2342-41e9-40ec-8d0b-af6949f349cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:37.818894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b2342-41e9-40ec-8d0b-af6949f349cd admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:37.819167 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b2342-41e9-40ec-8d0b-af6949f349cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:37.819438 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b2342-41e9-40ec-8d0b-af6949f349cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:37.820080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b2342-41e9-40ec-8d0b-af6949f349cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:37.821756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b2342-41e9-40ec-8d0b-af6949f349cd admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:37.833585 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1363/2746] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:22:37.837894 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56057c-9648-48b6-9179-bef6e076d1be admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:37.848213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56057c-9648-48b6-9179-bef6e076d1be admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:37.853070 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e1df-87a6-49e6-9674-5e3579e910db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:37.853717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e1df-87a6-49e6-9674-5e3579e910db admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:37.853991 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e1df-87a6-49e6-9674-5e3579e910db admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:37.854266 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e1df-87a6-49e6-9674-5e3579e910db admin admin] PATH_INFO: `/v3/projects/56ae4c173f69438b912b2cc1b18b71b7/users/5948aad595374d82950b9c00feae6e53/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:37.868856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97e1df-87a6-49e6-9674-5e3579e910db admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ae4c173f69438b912b2cc1b18b71b7, user_id=5948aad595374d82950b9c00feae6e53, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:37.871550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97e1df-87a6-49e6-9674-5e3579e910db admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:37.887231 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1384/2747] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:22:37 2022] PUT /identity/v3/projects/56ae4c173f69438b912b2cc1b18b71b7/users/5948aad595374d82950b9c00feae6e53/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:22:37.897715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30daf4-1d3c-4335-ab71-d7cea1c45756 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:37.897999 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30daf4-1d3c-4335-ab71-d7cea1c45756 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:37.898268 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30daf4-1d3c-4335-ab71-d7cea1c45756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:37.927025 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6c30daf4-1d3c-4335-ab71-d7cea1c45756 None None] MFA Rules not processed for user `5948aad595374d82950b9c00feae6e53`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:22:37.928245 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6c30daf4-1d3c-4335-ab71-d7cea1c45756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:37.994864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1364/2748] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:22:38.007284 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e1df-87a6-49e6-9674-5e3579e910db admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:38.009042 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7a97e1df-87a6-49e6-9674-5e3579e910db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:38.069223 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e1df-87a6-49e6-9674-5e3579e910db admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:38.073016 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff0f71-2ff6-449b-bdfc-07536919611b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31ebbadd69da4bc6ad25b5c882962ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:38.073916 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff0f71-2ff6-449b-bdfc-07536919611b service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:38.074200 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff0f71-2ff6-449b-bdfc-07536919611b service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:38.074473 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff0f71-2ff6-449b-bdfc-07536919611b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:38.083439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff0f71-2ff6-449b-bdfc-07536919611b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:38.085510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff0f71-2ff6-449b-bdfc-07536919611b service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:38.095187 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1385/2749] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:22:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:22:38.133460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30daf4-1d3c-4335-ab71-d7cea1c45756 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:22:38.134958 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6c30daf4-1d3c-4335-ab71-d7cea1c45756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:38.181325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:38.201709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30daf4-1d3c-4335-ab71-d7cea1c45756 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:22:38.205300 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32262c3d-a8b7-467f-8ef2-d0b075a42d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:22:38.205905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32262c3d-a8b7-467f-8ef2-d0b075a42d29 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:22:38.206177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32262c3d-a8b7-467f-8ef2-d0b075a42d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:22:38.206415 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32262c3d-a8b7-467f-8ef2-d0b075a42d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:22:38.208171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-32262c3d-a8b7-467f-8ef2-d0b075a42d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:22:38.281478 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32262c3d-a8b7-467f-8ef2-d0b075a42d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:22:38.282951 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32262c3d-a8b7-467f-8ef2-d0b075a42d29 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:22:38.295877 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1365/2750] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:22:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:22:48.090981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:48.291013 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=35 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:23:07.668468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff0f71-2ff6-449b-bdfc-07536919611b service glance] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:07.739175 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff0f71-2ff6-449b-bdfc-07536919611b service glance] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:07.745444 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:07.746066 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:07.746336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:07.746600 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] PATH_INFO: `/v3/users/5948aad595374d82950b9c00feae6e53` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:07.747831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5948aad595374d82950b9c00feae6e53)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:07.749858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:07.803371 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5948aad595374d82950b9c00feae6e53'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:23:07.804004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5948aad595374d82950b9c00feae6e53'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:23:07.814363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5948aad595374d82950b9c00feae6e53'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:23:07.821504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5948aad595374d82950b9c00feae6e53'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:23:07.822137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5948aad595374d82950b9c00feae6e53'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:23:07.842758 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1386/2751] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:23:07 2022] DELETE /identity/v3/users/5948aad595374d82950b9c00feae6e53 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:23:07.847247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de386614-2496-4ebf-ac55-e04780876e0e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:07.847760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de386614-2496-4ebf-ac55-e04780876e0e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:07.847861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de386614-2496-4ebf-ac55-e04780876e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:07.866756 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-de386614-2496-4ebf-ac55-e04780876e0e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:23:07.867949 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-de386614-2496-4ebf-ac55-e04780876e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:07.931704 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1366/2752] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:23:07.941718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:07.943277 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:08.001611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803de8c-0e19-4f94-a7a2-3a90eac3a099 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:08.005852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711333dd-6875-410d-8874-580f253e7e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:08.006798 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711333dd-6875-410d-8874-580f253e7e2a service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:08.007076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711333dd-6875-410d-8874-580f253e7e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:08.007335 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711333dd-6875-410d-8874-580f253e7e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:08.016937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711333dd-6875-410d-8874-580f253e7e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:08.018407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711333dd-6875-410d-8874-580f253e7e2a service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:08.027902 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1387/2753] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:23:08.298071 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de386614-2496-4ebf-ac55-e04780876e0e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:08.299526 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-de386614-2496-4ebf-ac55-e04780876e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:08.322066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de386614-2496-4ebf-ac55-e04780876e0e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:08.328019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:08.328708 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:08.328980 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:08.329247 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f admin admin] PATH_INFO: `/v3/projects/56ae4c173f69438b912b2cc1b18b71b7` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:08.330449 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ae4c173f69438b912b2cc1b18b71b7)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:08.332482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:08.382752 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ae4c173f69438b912b2cc1b18b71b7', 'request_id': 'req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:23:08.389409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ae4c173f69438b912b2cc1b18b71b7', 'request_id': 'req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:23:08.399813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ae4c173f69438b912b2cc1b18b71b7', 'request_id': 'req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:23:08.410069 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f admin admin] The token cache is being invalidate because project 56ae4c173f69438b912b2cc1b18b71b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:23:08.410351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:23:08.410981 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ff04e97-97e6-48b2-86e2-55eca75bdd4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:23:08.412504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1367/2754] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:23:08 2022] DELETE /identity/v3/projects/56ae4c173f69438b912b2cc1b18b71b7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:23:08.417670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910755a6-090c-4e95-8833-31c54913d4a4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:08.418025 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910755a6-090c-4e95-8833-31c54913d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:08.418301 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910755a6-090c-4e95-8833-31c54913d4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:08.438788 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-910755a6-090c-4e95-8833-31c54913d4a4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:23:08.440077 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-910755a6-090c-4e95-8833-31c54913d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:08.457716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:23:08.501761 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1388/2755] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:23:08.511300 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96449d-e33f-4f68-a401-cbc753ae331c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:08.511641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96449d-e33f-4f68-a401-cbc753ae331c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:08.511939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96449d-e33f-4f68-a401-cbc753ae331c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:08.532925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-bb96449d-e33f-4f68-a401-cbc753ae331c None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:23:08.534114 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bb96449d-e33f-4f68-a401-cbc753ae331c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:08.541992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1368/2756] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:23:08.547132 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910755a6-090c-4e95-8833-31c54913d4a4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:08.562465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910755a6-090c-4e95-8833-31c54913d4a4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:08.571254 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9b3f1-7d39-46d8-a832-64d469e65709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:08.572090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9b3f1-7d39-46d8-a832-64d469e65709 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:08.572474 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9b3f1-7d39-46d8-a832-64d469e65709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:08.572804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9b3f1-7d39-46d8-a832-64d469e65709 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:08.573481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9b3f1-7d39-46d8-a832-64d469e65709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:23:08.573747 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9b3f1-7d39-46d8-a832-64d469e65709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:08.575406 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9b3f1-7d39-46d8-a832-64d469e65709 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:08.587185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1389/2757] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:23:08.591642 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96449d-e33f-4f68-a401-cbc753ae331c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:08.601617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96449d-e33f-4f68-a401-cbc753ae331c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:08.607769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d37866-e89c-4a88-b168-75997ba3361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:08.608544 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d37866-e89c-4a88-b168-75997ba3361c admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:08.608874 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d37866-e89c-4a88-b168-75997ba3361c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:08.609219 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d37866-e89c-4a88-b168-75997ba3361c admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:08.609893 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d37866-e89c-4a88-b168-75997ba3361c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:08.611926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d37866-e89c-4a88-b168-75997ba3361c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:08.642672 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1369/2758] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:23:08 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:23:08.646980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9b3f1-7d39-46d8-a832-64d469e65709 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:08.657445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9b3f1-7d39-46d8-a832-64d469e65709 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:08.714989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de7906-4c91-4f6e-80a4-2ad3a5b1ce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:08.715691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de7906-4c91-4f6e-80a4-2ad3a5b1ce00 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:08.715814 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de7906-4c91-4f6e-80a4-2ad3a5b1ce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:08.716100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de7906-4c91-4f6e-80a4-2ad3a5b1ce00 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:08.716759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de7906-4c91-4f6e-80a4-2ad3a5b1ce00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:08.718727 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de7906-4c91-4f6e-80a4-2ad3a5b1ce00 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:08.741382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1390/2759] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:23:08 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:23:08.745764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d37866-e89c-4a88-b168-75997ba3361c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:08.756683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d37866-e89c-4a88-b168-75997ba3361c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:08.762713 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9844db6-b638-4023-bcdd-c517bb0e67aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:08.763315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9844db6-b638-4023-bcdd-c517bb0e67aa admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:08.763590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9844db6-b638-4023-bcdd-c517bb0e67aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:08.763858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9844db6-b638-4023-bcdd-c517bb0e67aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:08.764538 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9844db6-b638-4023-bcdd-c517bb0e67aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:08.766187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9844db6-b638-4023-bcdd-c517bb0e67aa admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:08.777012 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1370/2760] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:23:08.781154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de7906-4c91-4f6e-80a4-2ad3a5b1ce00 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:08.792022 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de7906-4c91-4f6e-80a4-2ad3a5b1ce00 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:08.797643 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ce630-68d2-4b50-9831-8ffba37ee7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:08.798243 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ce630-68d2-4b50-9831-8ffba37ee7df admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:08.798514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ce630-68d2-4b50-9831-8ffba37ee7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:08.798785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ce630-68d2-4b50-9831-8ffba37ee7df admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:08.799428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ce630-68d2-4b50-9831-8ffba37ee7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:08.801120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ce630-68d2-4b50-9831-8ffba37ee7df admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:08.812177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1391/2761] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:23:08.816444 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9844db6-b638-4023-bcdd-c517bb0e67aa admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:08.827022 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9844db6-b638-4023-bcdd-c517bb0e67aa admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:08.831989 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff2826-3d25-4eb5-a007-6b9071bd4686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:08.832677 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff2826-3d25-4eb5-a007-6b9071bd4686 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:08.832948 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff2826-3d25-4eb5-a007-6b9071bd4686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:08.833211 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff2826-3d25-4eb5-a007-6b9071bd4686 admin admin] PATH_INFO: `/v3/projects/b7b46ce5cbae44eb8a3d42a584c3273f/users/0f8c5af7a05e417692c16794f71f8f02/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:08.848532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff2826-3d25-4eb5-a007-6b9071bd4686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b46ce5cbae44eb8a3d42a584c3273f, user_id=0f8c5af7a05e417692c16794f71f8f02, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:08.851192 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff2826-3d25-4eb5-a007-6b9071bd4686 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:08.865640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1371/2762] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:23:08 2022] PUT /identity/v3/projects/b7b46ce5cbae44eb8a3d42a584c3273f/users/0f8c5af7a05e417692c16794f71f8f02/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:23:08.870731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c69144-c741-47d8-ab86-d589f816bb2d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:08.871014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c69144-c741-47d8-ab86-d589f816bb2d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:08.871286 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c69144-c741-47d8-ab86-d589f816bb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:08.891213 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-50c69144-c741-47d8-ab86-d589f816bb2d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:23:08.892476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-50c69144-c741-47d8-ab86-d589f816bb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:08.955164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1392/2763] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:23:08.966744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff2826-3d25-4eb5-a007-6b9071bd4686 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:08.968641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-41ff2826-3d25-4eb5-a007-6b9071bd4686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:08.990975 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:23:09.029158 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff2826-3d25-4eb5-a007-6b9071bd4686 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:09.032840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0f4fb-9702-4d0b-99ea-bfbcbde3a9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:09.033440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0f4fb-9702-4d0b-99ea-bfbcbde3a9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:09.033714 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0f4fb-9702-4d0b-99ea-bfbcbde3a9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:09.033981 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0f4fb-9702-4d0b-99ea-bfbcbde3a9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:09.043006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0f4fb-9702-4d0b-99ea-bfbcbde3a9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:09.044492 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0f4fb-9702-4d0b-99ea-bfbcbde3a9e3 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:09.053769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1372/2764] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:23:09.700002 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a55a5-7d66-40a6-9c7d-a5a852ed299d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:09.700331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a55a5-7d66-40a6-9c7d-a5a852ed299d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:09.700580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a55a5-7d66-40a6-9c7d-a5a852ed299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:09.730254 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0e4a55a5-7d66-40a6-9c7d-a5a852ed299d None None] MFA Rules not processed for user `0f8c5af7a05e417692c16794f71f8f02`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:23:09.731625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0e4a55a5-7d66-40a6-9c7d-a5a852ed299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:09.749142 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:23:09.801622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1393/2765] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:23:09.812683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0f4fb-9702-4d0b-99ea-bfbcbde3a9e3 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:09.814042 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-adb0f4fb-9702-4d0b-99ea-bfbcbde3a9e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:09.876739 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0f4fb-9702-4d0b-99ea-bfbcbde3a9e3 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:09.881777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ba0ee-b09e-4aea-817a-bd3e43ca8309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:09.882391 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ba0ee-b09e-4aea-817a-bd3e43ca8309 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:09.882683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ba0ee-b09e-4aea-817a-bd3e43ca8309 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:09.882926 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ba0ee-b09e-4aea-817a-bd3e43ca8309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:09.891839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ba0ee-b09e-4aea-817a-bd3e43ca8309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:09.893334 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ba0ee-b09e-4aea-817a-bd3e43ca8309 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:09.902048 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1373/2766] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:23:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:23:11.294842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a59bb-6e34-4992-8d7a-95ee79915bb2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:11.295382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a59bb-6e34-4992-8d7a-95ee79915bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:11.295382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a59bb-6e34-4992-8d7a-95ee79915bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:11.315968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-da4a59bb-6e34-4992-8d7a-95ee79915bb2 None None] MFA Rules not processed for user `0f8c5af7a05e417692c16794f71f8f02`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:23:11.317124 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-da4a59bb-6e34-4992-8d7a-95ee79915bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:11.327053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1394/2767] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:23:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:23:11.901470 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ba0ee-b09e-4aea-817a-bd3e43ca8309 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:11.903197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5d1ba0ee-b09e-4aea-817a-bd3e43ca8309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:11.975658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ba0ee-b09e-4aea-817a-bd3e43ca8309 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:11.981492 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682d105-b808-41dc-9d3c-b041d6ac6475 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:11.982137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682d105-b808-41dc-9d3c-b041d6ac6475 service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:11.982421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682d105-b808-41dc-9d3c-b041d6ac6475 service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:11.982689 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682d105-b808-41dc-9d3c-b041d6ac6475 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:11.984831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b682d105-b808-41dc-9d3c-b041d6ac6475 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:11.996945 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682d105-b808-41dc-9d3c-b041d6ac6475 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:11.998574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682d105-b808-41dc-9d3c-b041d6ac6475 service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:12.008979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1374/2768] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:23:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:23:13.895392 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a59bb-6e34-4992-8d7a-95ee79915bb2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:13.896909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-da4a59bb-6e34-4992-8d7a-95ee79915bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:13.909505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a59bb-6e34-4992-8d7a-95ee79915bb2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:13.913186 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c777a0-1a8b-4b64-ae8e-44cdfebad2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:13.913799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c777a0-1a8b-4b64-ae8e-44cdfebad2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:13.914053 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c777a0-1a8b-4b64-ae8e-44cdfebad2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:13.914316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c777a0-1a8b-4b64-ae8e-44cdfebad2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:13.916900 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-79c777a0-1a8b-4b64-ae8e-44cdfebad2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:13.928477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c777a0-1a8b-4b64-ae8e-44cdfebad2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:13.930486 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c777a0-1a8b-4b64-ae8e-44cdfebad2f9 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:13.939712 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1395/2769] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:23:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:23:22.004458 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=75 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:23:23.935898 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=28 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:23:45.282747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c742d5-05cc-46c6-9777-87d0ac1e7bc8 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:45.283324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c742d5-05cc-46c6-9777-87d0ac1e7bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:45.283324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c742d5-05cc-46c6-9777-87d0ac1e7bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:45.305144 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-51c742d5-05cc-46c6-9777-87d0ac1e7bc8 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:23:45.306604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-51c742d5-05cc-46c6-9777-87d0ac1e7bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:45.315338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1375/2770] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 6 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:23:45.333081 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c777a0-1a8b-4b64-ae8e-44cdfebad2f9 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:45.335481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-79c777a0-1a8b-4b64-ae8e-44cdfebad2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:45.418381 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c777a0-1a8b-4b64-ae8e-44cdfebad2f9 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:45.427806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39481397-0951-44f3-bb3e-77c68c10de4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:45.428745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481397-0951-44f3-bb3e-77c68c10de4d service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:45.429114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481397-0951-44f3-bb3e-77c68c10de4d service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:45.429498 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481397-0951-44f3-bb3e-77c68c10de4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:45.441807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39481397-0951-44f3-bb3e-77c68c10de4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:45.443415 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39481397-0951-44f3-bb3e-77c68c10de4d service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:45.452948 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1396/2771] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:23:49.391706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695b8f2-f271-4d17-ab05-8db615d30594 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:49.392282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695b8f2-f271-4d17-ab05-8db615d30594 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:49.392282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695b8f2-f271-4d17-ab05-8db615d30594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:49.412552 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c695b8f2-f271-4d17-ab05-8db615d30594 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:23:49.413740 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c695b8f2-f271-4d17-ab05-8db615d30594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:49.422738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1376/2772] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 6 01:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:23:49.437681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39481397-0951-44f3-bb3e-77c68c10de4d service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:49.439591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-39481397-0951-44f3-bb3e-77c68c10de4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:49.455631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39481397-0951-44f3-bb3e-77c68c10de4d service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:49.462396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd97bf-6059-47aa-8c83-b57491d90fc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:49.462991 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd97bf-6059-47aa-8c83-b57491d90fc7 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:49.463259 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd97bf-6059-47aa-8c83-b57491d90fc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:49.463521 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd97bf-6059-47aa-8c83-b57491d90fc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:49.472236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd97bf-6059-47aa-8c83-b57491d90fc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:49.474148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd97bf-6059-47aa-8c83-b57491d90fc7 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:49.483453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1397/2773] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:23:58.924479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3b41a-5ed6-4dc9-aa3a-f83b230b62f1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:58.925066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3b41a-5ed6-4dc9-aa3a-f83b230b62f1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:58.925066 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3b41a-5ed6-4dc9-aa3a-f83b230b62f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:58.950554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3bc3b41a-5ed6-4dc9-aa3a-f83b230b62f1 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:23:58.951754 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3bc3b41a-5ed6-4dc9-aa3a-f83b230b62f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:23:58.960380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1377/2774] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 6 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:23:58.981331 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd97bf-6059-47aa-8c83-b57491d90fc7 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:23:58.993773 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd97bf-6059-47aa-8c83-b57491d90fc7 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:23:58.999638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481467c8-dad5-4abd-bdd2-bbddc0addb8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:23:59.000235 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481467c8-dad5-4abd-bdd2-bbddc0addb8a service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:23:59.000541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481467c8-dad5-4abd-bdd2-bbddc0addb8a service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:23:59.000786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481467c8-dad5-4abd-bdd2-bbddc0addb8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:23:59.010701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481467c8-dad5-4abd-bdd2-bbddc0addb8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:23:59.012461 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481467c8-dad5-4abd-bdd2-bbddc0addb8a service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:23:59.022439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1398/2775] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:24:03.070919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba05f-540a-40a1-bd81-b3c69b7a3ba2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:03.071408 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba05f-540a-40a1-bd81-b3c69b7a3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:03.071530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba05f-540a-40a1-bd81-b3c69b7a3ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:03.092439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3f0ba05f-540a-40a1-bd81-b3c69b7a3ba2 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:24:03.093646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3f0ba05f-540a-40a1-bd81-b3c69b7a3ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:03.102440 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1378/2776] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 6 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:24:03.125465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481467c8-dad5-4abd-bdd2-bbddc0addb8a service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:24:03.137206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481467c8-dad5-4abd-bdd2-bbddc0addb8a service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:24:03.143222 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ed39-eeaa-4cfd-b85e-1973e98b7fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:24:03.143840 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ed39-eeaa-4cfd-b85e-1973e98b7fbd service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:03.144116 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ed39-eeaa-4cfd-b85e-1973e98b7fbd service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:03.144424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ed39-eeaa-4cfd-b85e-1973e98b7fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:03.153209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98ed39-eeaa-4cfd-b85e-1973e98b7fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:24:03.154823 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98ed39-eeaa-4cfd-b85e-1973e98b7fbd service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:24:03.164321 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1399/2777] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:24:07.290004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853d89a-4f16-45a0-b13b-bd817d056cf1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:07.290540 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853d89a-4f16-45a0-b13b-bd817d056cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:07.290706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853d89a-4f16-45a0-b13b-bd817d056cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:07.311703 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1853d89a-4f16-45a0-b13b-bd817d056cf1 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:24:07.312892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1853d89a-4f16-45a0-b13b-bd817d056cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:07.320876 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1379/2778] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 6 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:24:07.337028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ed39-eeaa-4cfd-b85e-1973e98b7fbd service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:24:07.348748 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ed39-eeaa-4cfd-b85e-1973e98b7fbd service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:24:07.355309 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f792a-ac2f-4f3b-b7af-5b512511fce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:24:07.355908 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f792a-ac2f-4f3b-b7af-5b512511fce4 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:07.356181 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f792a-ac2f-4f3b-b7af-5b512511fce4 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:07.356496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f792a-ac2f-4f3b-b7af-5b512511fce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:07.364837 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f792a-ac2f-4f3b-b7af-5b512511fce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:24:07.366455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f792a-ac2f-4f3b-b7af-5b512511fce4 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:24:07.376177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1400/2779] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:24:10.320825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853d89a-4f16-45a0-b13b-bd817d056cf1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:24:10.338369 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853d89a-4f16-45a0-b13b-bd817d056cf1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:24:10.346222 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a20ba2-b6f5-4020-ab08-a92a396fb041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:24:10.346825 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a20ba2-b6f5-4020-ab08-a92a396fb041 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:10.347123 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a20ba2-b6f5-4020-ab08-a92a396fb041 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:10.347389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a20ba2-b6f5-4020-ab08-a92a396fb041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:10.349395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d5a20ba2-b6f5-4020-ab08-a92a396fb041 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:10.412328 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a20ba2-b6f5-4020-ab08-a92a396fb041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:24:10.414086 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a20ba2-b6f5-4020-ab08-a92a396fb041 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:24:10.423546 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1380/2780] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:24:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:24:11.534366 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b6de9-14e3-4060-9ce6-749491ebea5b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:11.534838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b6de9-14e3-4060-9ce6-749491ebea5b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:11.534958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b6de9-14e3-4060-9ce6-749491ebea5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:11.555759 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-169b6de9-14e3-4060-9ce6-749491ebea5b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:24:11.556989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-169b6de9-14e3-4060-9ce6-749491ebea5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:11.565538 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1401/2781] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 6 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:24:11.581411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a20ba2-b6f5-4020-ab08-a92a396fb041 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:24:11.593986 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a20ba2-b6f5-4020-ab08-a92a396fb041 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:24:11.601206 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fdd09-fbff-4b79-a604-9af650605d14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:24:11.601803 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fdd09-fbff-4b79-a604-9af650605d14 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:11.602080 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fdd09-fbff-4b79-a604-9af650605d14 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:11.602352 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fdd09-fbff-4b79-a604-9af650605d14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:11.611177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fdd09-fbff-4b79-a604-9af650605d14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:24:11.612829 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fdd09-fbff-4b79-a604-9af650605d14 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:24:11.625255 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1381/2782] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:24:21.550806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=61 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:21.618777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=49 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:24.120980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b6de9-14e3-4060-9ce6-749491ebea5b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:24:24.133936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b6de9-14e3-4060-9ce6-749491ebea5b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:24:24.140730 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a19c1-a8e2-4585-90c9-54302c4b6c73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:24:24.141637 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a19c1-a8e2-4585-90c9-54302c4b6c73 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:24.142180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a19c1-a8e2-4585-90c9-54302c4b6c73 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:24.142490 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a19c1-a8e2-4585-90c9-54302c4b6c73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:24.144573 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-641a19c1-a8e2-4585-90c9-54302c4b6c73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:24.157710 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a19c1-a8e2-4585-90c9-54302c4b6c73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:24:24.159435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a19c1-a8e2-4585-90c9-54302c4b6c73 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:24:24.171336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1402/2783] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:24:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:24:24.713685 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fdd09-fbff-4b79-a604-9af650605d14 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:24:24.728274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fdd09-fbff-4b79-a604-9af650605d14 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:24:24.735546 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada38de-1f0e-46aa-89cf-68dae04c9e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:24:24.736454 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada38de-1f0e-46aa-89cf-68dae04c9e82 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:24.736855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada38de-1f0e-46aa-89cf-68dae04c9e82 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:24.737363 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada38de-1f0e-46aa-89cf-68dae04c9e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:24.739335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-eada38de-1f0e-46aa-89cf-68dae04c9e82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:24.753163 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada38de-1f0e-46aa-89cf-68dae04c9e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:24:24.755315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada38de-1f0e-46aa-89cf-68dae04c9e82 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:24:24.769550 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1382/2784] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:24:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:24:28.111730 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98179713-0224-44ff-9ee5-9cb0d2a9bc23 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:28.112208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98179713-0224-44ff-9ee5-9cb0d2a9bc23 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:28.112467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98179713-0224-44ff-9ee5-9cb0d2a9bc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:28.133007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-98179713-0224-44ff-9ee5-9cb0d2a9bc23 None None] MFA Rules not processed for user `a6103fdbcc6d41acb0d113400b3617ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:24:28.134382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-98179713-0224-44ff-9ee5-9cb0d2a9bc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:28.141799 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1403/2785] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:24:28.484584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada38de-1f0e-46aa-89cf-68dae04c9e82 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:24:28.495128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada38de-1f0e-46aa-89cf-68dae04c9e82 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:24:28.499925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c7ec2-34c7-4ae0-82e8-a5186bf22875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:24:28.500567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c7ec2-34c7-4ae0-82e8-a5186bf22875 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:28.500821 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c7ec2-34c7-4ae0-82e8-a5186bf22875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:28.501099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c7ec2-34c7-4ae0-82e8-a5186bf22875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:28.503058 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a48c7ec2-34c7-4ae0-82e8-a5186bf22875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:28.517876 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c7ec2-34c7-4ae0-82e8-a5186bf22875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:24:28.519938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c7ec2-34c7-4ae0-82e8-a5186bf22875 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:24:28.528322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1383/2786] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:24:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:24:29.104833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e71813-879b-4af5-8c12-97d9f678a3d5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:29.105114 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e71813-879b-4af5-8c12-97d9f678a3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:29.105387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e71813-879b-4af5-8c12-97d9f678a3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:29.125646 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-98e71813-879b-4af5-8c12-97d9f678a3d5 None None] MFA Rules not processed for user `0f8c5af7a05e417692c16794f71f8f02`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:24:29.126855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-98e71813-879b-4af5-8c12-97d9f678a3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:29.134600 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1404/2787] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:24:38.524488 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=12 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:39.119995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=12 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:39.157654 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c7ec2-34c7-4ae0-82e8-a5186bf22875 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:24:39.173602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c7ec2-34c7-4ae0-82e8-a5186bf22875 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:24:39.181811 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf7f4-68ae-4ea2-9e1e-06f3f1acd0c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:24:39.182524 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf7f4-68ae-4ea2-9e1e-06f3f1acd0c7 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:39.182934 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf7f4-68ae-4ea2-9e1e-06f3f1acd0c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:39.183277 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf7f4-68ae-4ea2-9e1e-06f3f1acd0c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:39.185178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c8daf7f4-68ae-4ea2-9e1e-06f3f1acd0c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:39.199024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8daf7f4-68ae-4ea2-9e1e-06f3f1acd0c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:24:39.200780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8daf7f4-68ae-4ea2-9e1e-06f3f1acd0c7 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:24:39.212936 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1384/2788] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:24:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:24:46.946630 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76606573-89b5-431e-8878-f6831a750e88 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:46.947253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76606573-89b5-431e-8878-f6831a750e88 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:46.947253 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76606573-89b5-431e-8878-f6831a750e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:46.967075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-76606573-89b5-431e-8878-f6831a750e88 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:24:46.968280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-76606573-89b5-431e-8878-f6831a750e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:46.976721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1405/2789] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 6 01:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:24:46.995892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf7f4-68ae-4ea2-9e1e-06f3f1acd0c7 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:24:47.008434 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf7f4-68ae-4ea2-9e1e-06f3f1acd0c7 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:24:47.015522 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b342bf6-bc79-4b87-b1e9-bc5be8f0af80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:24:47.016132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b342bf6-bc79-4b87-b1e9-bc5be8f0af80 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:47.016450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b342bf6-bc79-4b87-b1e9-bc5be8f0af80 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:47.016711 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b342bf6-bc79-4b87-b1e9-bc5be8f0af80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:47.025452 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b342bf6-bc79-4b87-b1e9-bc5be8f0af80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:24:47.027077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b342bf6-bc79-4b87-b1e9-bc5be8f0af80 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:24:47.036324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1385/2790] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:24:50.253643 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45978a1e-46e0-4042-bda5-ba34420dfd3a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:50.254215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45978a1e-46e0-4042-bda5-ba34420dfd3a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:50.254215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45978a1e-46e0-4042-bda5-ba34420dfd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:50.275699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-45978a1e-46e0-4042-bda5-ba34420dfd3a None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:24:50.276953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-45978a1e-46e0-4042-bda5-ba34420dfd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:50.285374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1406/2791] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 6 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:24:50.304764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b342bf6-bc79-4b87-b1e9-bc5be8f0af80 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:24:50.316322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b342bf6-bc79-4b87-b1e9-bc5be8f0af80 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:24:50.322241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5780b6-34a5-4277-83e3-e2a002252a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:24:50.322879 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5780b6-34a5-4277-83e3-e2a002252a96 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:50.323159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5780b6-34a5-4277-83e3-e2a002252a96 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:50.323429 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5780b6-34a5-4277-83e3-e2a002252a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:50.332504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5780b6-34a5-4277-83e3-e2a002252a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:24:50.334308 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5780b6-34a5-4277-83e3-e2a002252a96 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:24:50.344712 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1386/2792] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:24:54.389886 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cd935-5273-4605-a00c-de496ee61b54 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:54.390439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cd935-5273-4605-a00c-de496ee61b54 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:54.390439 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cd935-5273-4605-a00c-de496ee61b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:54.411639 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7b2cd935-5273-4605-a00c-de496ee61b54 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:24:54.412886 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7b2cd935-5273-4605-a00c-de496ee61b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:54.422400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1407/2793] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 6 01:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:24:54.440232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5780b6-34a5-4277-83e3-e2a002252a96 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:24:54.451870 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5780b6-34a5-4277-83e3-e2a002252a96 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:24:54.458373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515a053-4c85-4754-9467-b265c76f7c9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:24:54.458962 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a053-4c85-4754-9467-b265c76f7c9c service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:54.459236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a053-4c85-4754-9467-b265c76f7c9c service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:54.459530 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a053-4c85-4754-9467-b265c76f7c9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:54.468108 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515a053-4c85-4754-9467-b265c76f7c9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:24:54.469828 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515a053-4c85-4754-9467-b265c76f7c9c service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:24:54.479201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1387/2794] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:24:58.585358 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3ce9-82f0-4ec4-938f-ffcd581913f7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:58.585864 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3ce9-82f0-4ec4-938f-ffcd581913f7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:58.585976 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3ce9-82f0-4ec4-938f-ffcd581913f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:58.607584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ff2d3ce9-82f0-4ec4-938f-ffcd581913f7 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:24:58.609282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ff2d3ce9-82f0-4ec4-938f-ffcd581913f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:24:58.618901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1408/2795] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 6 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:24:58.639111 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515a053-4c85-4754-9467-b265c76f7c9c service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:24:58.651968 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515a053-4c85-4754-9467-b265c76f7c9c service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:24:58.659314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dcb82-143c-4a14-9e66-d810cf5be4fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:24:58.659921 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dcb82-143c-4a14-9e66-d810cf5be4fc service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:24:58.660195 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dcb82-143c-4a14-9e66-d810cf5be4fc service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:24:58.660504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dcb82-143c-4a14-9e66-d810cf5be4fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:24:58.668914 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dcb82-143c-4a14-9e66-d810cf5be4fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:24:58.670668 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dcb82-143c-4a14-9e66-d810cf5be4fc service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:24:58.680345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1388/2796] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:25:03.829407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566492cb-4d08-4e44-bb7c-449d5bfb16f7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:03.829985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566492cb-4d08-4e44-bb7c-449d5bfb16f7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:03.829985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566492cb-4d08-4e44-bb7c-449d5bfb16f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:03.850563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-566492cb-4d08-4e44-bb7c-449d5bfb16f7 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:25:03.851689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-566492cb-4d08-4e44-bb7c-449d5bfb16f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:03.860678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1409/2797] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 6 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:25:03.881730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dcb82-143c-4a14-9e66-d810cf5be4fc service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:03.896971 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dcb82-143c-4a14-9e66-d810cf5be4fc service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:03.904052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa283f0-aa81-4ec6-959f-bfb62e617a74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:03.904689 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa283f0-aa81-4ec6-959f-bfb62e617a74 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:03.904964 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa283f0-aa81-4ec6-959f-bfb62e617a74 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:03.905232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa283f0-aa81-4ec6-959f-bfb62e617a74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:03.914484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa283f0-aa81-4ec6-959f-bfb62e617a74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:03.916107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa283f0-aa81-4ec6-959f-bfb62e617a74 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:03.925996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1389/2798] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:25:04.464435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b47517-ad67-4f12-85b5-97287e1976c5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:04.464716 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b47517-ad67-4f12-85b5-97287e1976c5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:04.464986 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b47517-ad67-4f12-85b5-97287e1976c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:04.516791 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-94b47517-ad67-4f12-85b5-97287e1976c5 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:25:04.518020 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-94b47517-ad67-4f12-85b5-97287e1976c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:04.592670 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1410/2799] 10.222.0.25 () {58 vars in 967 bytes} [Tue Sep 6 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:25:04.636152 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa283f0-aa81-4ec6-959f-bfb62e617a74 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:04.638096 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4fa283f0-aa81-4ec6-959f-bfb62e617a74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:04.738322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa283f0-aa81-4ec6-959f-bfb62e617a74 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:04.744321 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff961d5d-39ae-4eda-8f10-962cd3f1a77d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:04.744941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff961d5d-39ae-4eda-8f10-962cd3f1a77d service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:04.745219 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff961d5d-39ae-4eda-8f10-962cd3f1a77d service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:04.745486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff961d5d-39ae-4eda-8f10-962cd3f1a77d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:04.754941 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff961d5d-39ae-4eda-8f10-962cd3f1a77d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:04.756589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff961d5d-39ae-4eda-8f10-962cd3f1a77d service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:04.765509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1390/2800] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:25:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:25:11.538028 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b47517-ad67-4f12-85b5-97287e1976c5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:11.540587 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-94b47517-ad67-4f12-85b5-97287e1976c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:11.550926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=56 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:11.557634 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b47517-ad67-4f12-85b5-97287e1976c5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:11.563915 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240e20f-2bc6-412a-903a-9aa7a688e5f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:11.564586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240e20f-2bc6-412a-903a-9aa7a688e5f2 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:11.564835 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240e20f-2bc6-412a-903a-9aa7a688e5f2 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:11.565104 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240e20f-2bc6-412a-903a-9aa7a688e5f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:11.567049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7240e20f-2bc6-412a-903a-9aa7a688e5f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:11.580515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240e20f-2bc6-412a-903a-9aa7a688e5f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:11.582602 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240e20f-2bc6-412a-903a-9aa7a688e5f2 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:11.599077 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1411/2801] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:25:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:25:11.601147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff961d5d-39ae-4eda-8f10-962cd3f1a77d service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:11.603779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ff961d5d-39ae-4eda-8f10-962cd3f1a77d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:11.613399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=78 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:11.628397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff961d5d-39ae-4eda-8f10-962cd3f1a77d service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:11.636531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:11.637601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:11.637773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:11.638036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] PATH_INFO: `/v3/users/c4654da1a4704aa194abcb92cf857619` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:11.639151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4654da1a4704aa194abcb92cf857619)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:11.641248 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:11.695366 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4654da1a4704aa194abcb92cf857619'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:11.696036 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4654da1a4704aa194abcb92cf857619'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:11.704626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4654da1a4704aa194abcb92cf857619'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:11.705723 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4654da1a4704aa194abcb92cf857619'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:11.718491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4654da1a4704aa194abcb92cf857619'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:11.734087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1391/2802] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:25:11 2022] DELETE /identity/v3/users/c4654da1a4704aa194abcb92cf857619 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:25:11.919274 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240e20f-2bc6-412a-903a-9aa7a688e5f2 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:11.933206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240e20f-2bc6-412a-903a-9aa7a688e5f2 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:11.996100 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:11.996764 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:11.997034 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:11.997300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] PATH_INFO: `/v3/projects/18432799891b456dbf4540c63c4fceb4` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:11.998440 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18432799891b456dbf4540c63c4fceb4)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:12.000568 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:12.051499 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18432799891b456dbf4540c63c4fceb4', 'request_id': 'req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.057992 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18432799891b456dbf4540c63c4fceb4', 'request_id': 'req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.064586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18432799891b456dbf4540c63c4fceb4', 'request_id': 'req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.079965 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] The token cache is being invalidate because project 18432799891b456dbf4540c63c4fceb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:25:12.080252 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.080930 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.082458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1412/2803] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:25:11 2022] DELETE /identity/v3/projects/18432799891b456dbf4540c63c4fceb4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:25:12.086627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:12.088149 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:12.102937 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087e0c1-3076-42fa-9529-bf97554fdf13 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:12.172331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab086b-2823-4e8f-9625-e6322b6d6b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:12.172331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab086b-2823-4e8f-9625-e6322b6d6b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:12.172331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab086b-2823-4e8f-9625-e6322b6d6b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:12.172331 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab086b-2823-4e8f-9625-e6322b6d6b38 admin admin] PATH_INFO: `/v3/users/bf0720b6e4ce491b9e24f8186f0930df` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:12.173509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab086b-2823-4e8f-9625-e6322b6d6b38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf0720b6e4ce491b9e24f8186f0930df)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:12.173509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab086b-2823-4e8f-9625-e6322b6d6b38 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:12.238727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-98ab086b-2823-4e8f-9625-e6322b6d6b38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf0720b6e4ce491b9e24f8186f0930df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.239594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-98ab086b-2823-4e8f-9625-e6322b6d6b38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf0720b6e4ce491b9e24f8186f0930df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.247271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-98ab086b-2823-4e8f-9625-e6322b6d6b38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf0720b6e4ce491b9e24f8186f0930df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.248075 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-98ab086b-2823-4e8f-9625-e6322b6d6b38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf0720b6e4ce491b9e24f8186f0930df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.265184 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-98ab086b-2823-4e8f-9625-e6322b6d6b38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf0720b6e4ce491b9e24f8186f0930df'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.268521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:12.285683 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1392/2804] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:25:12 2022] DELETE /identity/v3/users/bf0720b6e4ce491b9e24f8186f0930df => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:25:12.464691 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:12.466212 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:12.480274 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2257c84-9b46-45fb-8223-18ba5dd2a1b6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:12.543968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:12.544752 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:12.544877 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:12.545152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e admin admin] PATH_INFO: `/v3/projects/cde4e31a9ba14e449b37aea464b3fb53` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:12.546268 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde4e31a9ba14e449b37aea464b3fb53)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:12.548228 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:12.570621 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:12.599588 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde4e31a9ba14e449b37aea464b3fb53', 'request_id': 'req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.607659 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde4e31a9ba14e449b37aea464b3fb53', 'request_id': 'req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.617062 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde4e31a9ba14e449b37aea464b3fb53', 'request_id': 'req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.635846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e admin admin] The token cache is being invalidate because project cde4e31a9ba14e449b37aea464b3fb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:25:12.636149 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.636880 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ea191bc5-d3ff-4208-b5ff-3131f6ad718e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:12.638797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1413/2805] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:25:12 2022] DELETE /identity/v3/projects/cde4e31a9ba14e449b37aea464b3fb53 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:25:12.644192 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224285f8-cec9-4309-9c8f-54c12ceee019 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:12.644700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224285f8-cec9-4309-9c8f-54c12ceee019 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:12.644794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224285f8-cec9-4309-9c8f-54c12ceee019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:12.665422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-224285f8-cec9-4309-9c8f-54c12ceee019 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:25:12.666617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-224285f8-cec9-4309-9c8f-54c12ceee019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:12.742699 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1393/2806] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:25:12.750957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eea10-8b31-4796-846e-6a9ae9819400 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:12.751238 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eea10-8b31-4796-846e-6a9ae9819400 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:12.751511 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eea10-8b31-4796-846e-6a9ae9819400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:12.773262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fe9eea10-8b31-4796-846e-6a9ae9819400 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:25:12.774509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fe9eea10-8b31-4796-846e-6a9ae9819400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:12.783099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1414/2807] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:25:12.787421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224285f8-cec9-4309-9c8f-54c12ceee019 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:12.798375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224285f8-cec9-4309-9c8f-54c12ceee019 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:12.803810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a7e81-452e-495e-a47e-19a1bf20eafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:12.804461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a7e81-452e-495e-a47e-19a1bf20eafd admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:12.804736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a7e81-452e-495e-a47e-19a1bf20eafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:12.805006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a7e81-452e-495e-a47e-19a1bf20eafd admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:12.805647 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a7e81-452e-495e-a47e-19a1bf20eafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:25:12.805944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a7e81-452e-495e-a47e-19a1bf20eafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:12.807596 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a7e81-452e-495e-a47e-19a1bf20eafd admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:12.819998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1394/2808] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:25:12.824593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eea10-8b31-4796-846e-6a9ae9819400 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:12.834346 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eea10-8b31-4796-846e-6a9ae9819400 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:12.839304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03293c63-5707-46f9-afeb-763026bc8bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:12.840097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03293c63-5707-46f9-afeb-763026bc8bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:12.840405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03293c63-5707-46f9-afeb-763026bc8bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:12.840688 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03293c63-5707-46f9-afeb-763026bc8bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:12.841328 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03293c63-5707-46f9-afeb-763026bc8bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:12.843280 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03293c63-5707-46f9-afeb-763026bc8bd6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:12.874273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1415/2809] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:25:12 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:25:12.878562 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a7e81-452e-495e-a47e-19a1bf20eafd admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:12.889423 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a7e81-452e-495e-a47e-19a1bf20eafd admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:12.949658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf35c1d-678e-4120-85b1-7c84242ea4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:12.950270 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf35c1d-678e-4120-85b1-7c84242ea4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:12.950546 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf35c1d-678e-4120-85b1-7c84242ea4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:12.950814 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf35c1d-678e-4120-85b1-7c84242ea4d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:12.951471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf35c1d-678e-4120-85b1-7c84242ea4d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:12.953633 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf35c1d-678e-4120-85b1-7c84242ea4d0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:12.979283 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1395/2810] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:25:12 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:25:12.983781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03293c63-5707-46f9-afeb-763026bc8bd6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:12.995061 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03293c63-5707-46f9-afeb-763026bc8bd6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:12.999822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbfc0a-701f-4648-96aa-43ae1b3c680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:13.000801 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbfc0a-701f-4648-96aa-43ae1b3c680e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:13.000944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbfc0a-701f-4648-96aa-43ae1b3c680e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:13.001202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbfc0a-701f-4648-96aa-43ae1b3c680e admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:13.001879 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbfc0a-701f-4648-96aa-43ae1b3c680e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:13.003536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbfc0a-701f-4648-96aa-43ae1b3c680e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:13.013906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1416/2811] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:25:13.018322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf35c1d-678e-4120-85b1-7c84242ea4d0 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:13.029135 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf35c1d-678e-4120-85b1-7c84242ea4d0 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:13.037129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f559d59-ffba-4b2c-850c-0a4d6a7aee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:13.037727 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f559d59-ffba-4b2c-850c-0a4d6a7aee77 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:13.038005 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f559d59-ffba-4b2c-850c-0a4d6a7aee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:13.038274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f559d59-ffba-4b2c-850c-0a4d6a7aee77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:13.038932 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f559d59-ffba-4b2c-850c-0a4d6a7aee77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:13.040716 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f559d59-ffba-4b2c-850c-0a4d6a7aee77 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:13.051996 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1396/2812] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 01:25:13.056261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbfc0a-701f-4648-96aa-43ae1b3c680e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:13.067595 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbfc0a-701f-4648-96aa-43ae1b3c680e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:13.073074 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef0c26-7d11-4fa3-aca5-40348c46df31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:13.073730 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef0c26-7d11-4fa3-aca5-40348c46df31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:13.074004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef0c26-7d11-4fa3-aca5-40348c46df31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:13.074273 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef0c26-7d11-4fa3-aca5-40348c46df31 admin admin] PATH_INFO: `/v3/projects/17ef3e5fc9b244f3b5ae58ec313b9eaf/users/1fbbb58e018442c38b89a18beefafc37/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:13.089314 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef0c26-7d11-4fa3-aca5-40348c46df31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ef3e5fc9b244f3b5ae58ec313b9eaf, user_id=1fbbb58e018442c38b89a18beefafc37, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:13.092037 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef0c26-7d11-4fa3-aca5-40348c46df31 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:13.109563 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1417/2813] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:25:13 2022] PUT /identity/v3/projects/17ef3e5fc9b244f3b5ae58ec313b9eaf/users/1fbbb58e018442c38b89a18beefafc37/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:25:13.114925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0abb88-d5c4-4475-8d80-7e60101c9233 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:13.115199 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0abb88-d5c4-4475-8d80-7e60101c9233 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:13.115468 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0abb88-d5c4-4475-8d80-7e60101c9233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:13.135068 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2d0abb88-d5c4-4475-8d80-7e60101c9233 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:25:13.136170 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2d0abb88-d5c4-4475-8d80-7e60101c9233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:13.187626 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:13.197293 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1397/2814] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:25:13.207445 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef0c26-7d11-4fa3-aca5-40348c46df31 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:13.209358 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7bef0c26-7d11-4fa3-aca5-40348c46df31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:13.266944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef0c26-7d11-4fa3-aca5-40348c46df31 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:13.271094 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfb245-ec6a-4a3b-af27-5cc90efecdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:13.271302 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfb245-ec6a-4a3b-af27-5cc90efecdbd service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:13.271584 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfb245-ec6a-4a3b-af27-5cc90efecdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:13.271855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfb245-ec6a-4a3b-af27-5cc90efecdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:13.281708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfb245-ec6a-4a3b-af27-5cc90efecdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:13.283402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfb245-ec6a-4a3b-af27-5cc90efecdbd service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:13.293977 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1418/2815] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:25:17.907676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be006bf0-d518-4879-9ec9-b4ca9ae76f9f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:17.908472 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be006bf0-d518-4879-9ec9-b4ca9ae76f9f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:17.908472 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be006bf0-d518-4879-9ec9-b4ca9ae76f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:17.940177 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-be006bf0-d518-4879-9ec9-b4ca9ae76f9f None None] MFA Rules not processed for user `1fbbb58e018442c38b89a18beefafc37`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:25:17.945239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-be006bf0-d518-4879-9ec9-b4ca9ae76f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:18.014909 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1398/2816] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:25:18.019588 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfb245-ec6a-4a3b-af27-5cc90efecdbd service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:18.029720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfb245-ec6a-4a3b-af27-5cc90efecdbd service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:18.034533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78003905-b601-4a0b-804b-99176d1d28a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:18.035154 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78003905-b601-4a0b-804b-99176d1d28a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:18.035432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78003905-b601-4a0b-804b-99176d1d28a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:18.035707 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78003905-b601-4a0b-804b-99176d1d28a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:18.036425 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78003905-b601-4a0b-804b-99176d1d28a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:18.038435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78003905-b601-4a0b-804b-99176d1d28a5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:18.071468 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1419/2817] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:25:18 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:25:18.075717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be006bf0-d518-4879-9ec9-b4ca9ae76f9f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:18.087505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be006bf0-d518-4879-9ec9-b4ca9ae76f9f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:18.151197 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c2f78-bf72-439b-9d34-8bda4999a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:18.151876 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c2f78-bf72-439b-9d34-8bda4999a2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:18.152155 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c2f78-bf72-439b-9d34-8bda4999a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:18.152460 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c2f78-bf72-439b-9d34-8bda4999a2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:18.153110 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c2f78-bf72-439b-9d34-8bda4999a2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:18.155232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c2f78-bf72-439b-9d34-8bda4999a2f8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:18.181883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1399/2818] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:25:18 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:25:18.185824 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78003905-b601-4a0b-804b-99176d1d28a5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:18.197761 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78003905-b601-4a0b-804b-99176d1d28a5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:18.203562 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56101e5-7816-4f45-adcb-3dff046751bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:18.204215 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56101e5-7816-4f45-adcb-3dff046751bc admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:18.204529 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56101e5-7816-4f45-adcb-3dff046751bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:18.204802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56101e5-7816-4f45-adcb-3dff046751bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:18.205457 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56101e5-7816-4f45-adcb-3dff046751bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:18.207118 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56101e5-7816-4f45-adcb-3dff046751bc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:18.219230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1420/2819] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:25:18.223589 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c2f78-bf72-439b-9d34-8bda4999a2f8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:18.234192 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c2f78-bf72-439b-9d34-8bda4999a2f8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:18.240698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda34981-d1cb-4683-9fe8-b997fbe22507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:18.242106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda34981-d1cb-4683-9fe8-b997fbe22507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:18.242434 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda34981-d1cb-4683-9fe8-b997fbe22507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:18.242706 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda34981-d1cb-4683-9fe8-b997fbe22507 admin admin] PATH_INFO: `/v3/projects/7795649abf7a4f979f5dc068c78735a9/users/6d836b15e2d449dbb53fe086a9cc9b19/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:18.259860 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda34981-d1cb-4683-9fe8-b997fbe22507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7795649abf7a4f979f5dc068c78735a9, user_id=6d836b15e2d449dbb53fe086a9cc9b19, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:18.263724 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda34981-d1cb-4683-9fe8-b997fbe22507 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:18.279866 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1400/2820] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:25:18 2022] PUT /identity/v3/projects/7795649abf7a4f979f5dc068c78735a9/users/6d836b15e2d449dbb53fe086a9cc9b19/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:25:18.283876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56101e5-7816-4f45-adcb-3dff046751bc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:18.294580 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56101e5-7816-4f45-adcb-3dff046751bc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:18.307612 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:18.370143 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dc348-e6b5-441f-8f9f-2ae3ac42ae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:18.370858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dc348-e6b5-441f-8f9f-2ae3ac42ae2b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:18.371195 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dc348-e6b5-441f-8f9f-2ae3ac42ae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:18.371544 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dc348-e6b5-441f-8f9f-2ae3ac42ae2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:18.372332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dc348-e6b5-441f-8f9f-2ae3ac42ae2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:18.374054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dc348-e6b5-441f-8f9f-2ae3ac42ae2b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:18.389701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1421/2821] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:25:18.391107 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda34981-d1cb-4683-9fe8-b997fbe22507 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:18.401892 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda34981-d1cb-4683-9fe8-b997fbe22507 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:18.408510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66118a6b-569a-4dcc-bab5-a18739850c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:18.409249 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66118a6b-569a-4dcc-bab5-a18739850c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:18.409586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66118a6b-569a-4dcc-bab5-a18739850c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:18.409924 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66118a6b-569a-4dcc-bab5-a18739850c3c admin admin] PATH_INFO: `/v3/projects/7795649abf7a4f979f5dc068c78735a9/users/6d836b15e2d449dbb53fe086a9cc9b19/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:18.411898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66118a6b-569a-4dcc-bab5-a18739850c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7795649abf7a4f979f5dc068c78735a9, user_id=6d836b15e2d449dbb53fe086a9cc9b19, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:18.414658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66118a6b-569a-4dcc-bab5-a18739850c3c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:18.425694 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1401/2822] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:25:18 2022] PUT /identity/v3/projects/7795649abf7a4f979f5dc068c78735a9/users/6d836b15e2d449dbb53fe086a9cc9b19/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:25:23.033745 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe2416-075e-4140-a25a-c62de53f3f20 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:23.034275 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe2416-075e-4140-a25a-c62de53f3f20 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:23.034275 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe2416-075e-4140-a25a-c62de53f3f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:23.074956 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bdbe2416-075e-4140-a25a-c62de53f3f20 None None] MFA Rules not processed for user `6d836b15e2d449dbb53fe086a9cc9b19`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:25:23.076206 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bdbe2416-075e-4140-a25a-c62de53f3f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:23.197177 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1422/2823] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:25:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:25:23.208281 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66118a6b-569a-4dcc-bab5-a18739850c3c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:23.210142 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-66118a6b-569a-4dcc-bab5-a18739850c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:23.265099 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:23.299169 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66118a6b-569a-4dcc-bab5-a18739850c3c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:23.313427 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc755c-a076-4446-b20d-f2e8273f006d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:23.314433 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc755c-a076-4446-b20d-f2e8273f006d service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:23.314710 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc755c-a076-4446-b20d-f2e8273f006d service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:23.314982 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc755c-a076-4446-b20d-f2e8273f006d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:23.374354 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc755c-a076-4446-b20d-f2e8273f006d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:23.375939 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc755c-a076-4446-b20d-f2e8273f006d service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:23.385515 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1402/2824] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:25:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:25:24.489934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d673-3b5a-41fd-981d-3105e8a09d65 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:24.490477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d673-3b5a-41fd-981d-3105e8a09d65 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:24.490477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d673-3b5a-41fd-981d-3105e8a09d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:24.514329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a577d673-3b5a-41fd-981d-3105e8a09d65 None None] MFA Rules not processed for user `1fbbb58e018442c38b89a18beefafc37`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:25:24.515869 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a577d673-3b5a-41fd-981d-3105e8a09d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:24.525382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1423/2825] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:25:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:25:33.381343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=37 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:34.506729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=59 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:35.022400 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc755c-a076-4446-b20d-f2e8273f006d service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:35.024271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-02cc755c-a076-4446-b20d-f2e8273f006d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:35.094915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc755c-a076-4446-b20d-f2e8273f006d service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:35.101746 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:35.102375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:35.102646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:35.102931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] PATH_INFO: `/v3/users/0f8c5af7a05e417692c16794f71f8f02` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:35.104137 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8c5af7a05e417692c16794f71f8f02)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:35.106131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:35.158960 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8c5af7a05e417692c16794f71f8f02'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:35.159635 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8c5af7a05e417692c16794f71f8f02'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:35.169348 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8c5af7a05e417692c16794f71f8f02'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:35.170363 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8c5af7a05e417692c16794f71f8f02'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:35.185146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8c5af7a05e417692c16794f71f8f02'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:35.200622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1403/2826] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:25:35 2022] DELETE /identity/v3/users/0f8c5af7a05e417692c16794f71f8f02 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:25:35.397416 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d673-3b5a-41fd-981d-3105e8a09d65 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:35.411569 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d673-3b5a-41fd-981d-3105e8a09d65 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:35.477329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:35.477870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:35.478172 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:35.478438 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] PATH_INFO: `/v3/projects/b7b46ce5cbae44eb8a3d42a584c3273f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:35.479631 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b46ce5cbae44eb8a3d42a584c3273f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:35.481657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:35.533304 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b46ce5cbae44eb8a3d42a584c3273f', 'request_id': 'req-91051320-dbd5-457f-b7ce-a4125e17a80f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:35.539469 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b46ce5cbae44eb8a3d42a584c3273f', 'request_id': 'req-91051320-dbd5-457f-b7ce-a4125e17a80f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:35.546015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b46ce5cbae44eb8a3d42a584c3273f', 'request_id': 'req-91051320-dbd5-457f-b7ce-a4125e17a80f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:35.559732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] The token cache is being invalidate because project b7b46ce5cbae44eb8a3d42a584c3273f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:25:35.560014 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:35.560662 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:25:35.562214 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1424/2827] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:25:35 2022] DELETE /identity/v3/projects/b7b46ce5cbae44eb8a3d42a584c3273f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:25:45.196695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:45.529737 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:25:45.531426 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:45.556395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:45.600140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e3d17-9110-458e-a57f-cbf1c1ad6c68 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:25:45.652723 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9a019-82b0-47c8-98bb-ca77d60901d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:25:45.653337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9a019-82b0-47c8-98bb-ca77d60901d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:25:45.653611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9a019-82b0-47c8-98bb-ca77d60901d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:25:45.653882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9a019-82b0-47c8-98bb-ca77d60901d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:25:45.655794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-57a9a019-82b0-47c8-98bb-ca77d60901d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:25:45.666309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9a019-82b0-47c8-98bb-ca77d60901d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:25:45.667815 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9a019-82b0-47c8-98bb-ca77d60901d7 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:25:45.676684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1404/2828] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:25:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:25:55.672676 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=46 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:00.453926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:00.455441 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:00.469548 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91051320-dbd5-457f-b7ce-a4125e17a80f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:00.474353 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025196f7-2f3e-41bc-affe-6d66070782ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:00.474957 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025196f7-2f3e-41bc-affe-6d66070782ae service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:00.475262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025196f7-2f3e-41bc-affe-6d66070782ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:00.475530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025196f7-2f3e-41bc-affe-6d66070782ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:00.477407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-025196f7-2f3e-41bc-affe-6d66070782ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:00.541694 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025196f7-2f3e-41bc-affe-6d66070782ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:00.543167 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025196f7-2f3e-41bc-affe-6d66070782ae service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:00.552649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1425/2829] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:26:10.548786 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=30 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:23.536238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9a019-82b0-47c8-98bb-ca77d60901d7 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:23.537912 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-57a9a019-82b0-47c8-98bb-ca77d60901d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:23.548674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9a019-82b0-47c8-98bb-ca77d60901d7 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:23.553600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a25f0-839e-4d2a-a975-ef14bd9d3cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:23.554208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a25f0-839e-4d2a-a975-ef14bd9d3cbd service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:23.554479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a25f0-839e-4d2a-a975-ef14bd9d3cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:23.554730 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a25f0-839e-4d2a-a975-ef14bd9d3cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:23.556590 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4c6a25f0-839e-4d2a-a975-ef14bd9d3cbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:23.624203 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a25f0-839e-4d2a-a975-ef14bd9d3cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:23.625696 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a25f0-839e-4d2a-a975-ef14bd9d3cbd service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:23.640510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1405/2830] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:26:26.235537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025196f7-2f3e-41bc-affe-6d66070782ae service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:26.237419 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-025196f7-2f3e-41bc-affe-6d66070782ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:26.330845 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025196f7-2f3e-41bc-affe-6d66070782ae service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:26.344476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c3259-05e4-477f-87ae-9df1badf5820 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:26.345246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c3259-05e4-477f-87ae-9df1badf5820 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:26.345526 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c3259-05e4-477f-87ae-9df1badf5820 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:26.345802 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c3259-05e4-477f-87ae-9df1badf5820 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:26.348763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-948c3259-05e4-477f-87ae-9df1badf5820 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:26.362239 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c3259-05e4-477f-87ae-9df1badf5820 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:26.364155 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c3259-05e4-477f-87ae-9df1badf5820 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:26.386097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1426/2831] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:26:26.933998 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a25f0-839e-4d2a-a975-ef14bd9d3cbd service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:26.935554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4c6a25f0-839e-4d2a-a975-ef14bd9d3cbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:26.948078 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a25f0-839e-4d2a-a975-ef14bd9d3cbd service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:26.953843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70301907-edac-485e-a932-fb08d54f94a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:26.954490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70301907-edac-485e-a932-fb08d54f94a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:26.954731 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70301907-edac-485e-a932-fb08d54f94a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:26.955027 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70301907-edac-485e-a932-fb08d54f94a1 admin admin] PATH_INFO: `/v3/users/a6103fdbcc6d41acb0d113400b3617ba` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:26.956537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70301907-edac-485e-a932-fb08d54f94a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6103fdbcc6d41acb0d113400b3617ba)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:26.958539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70301907-edac-485e-a932-fb08d54f94a1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:27.014276 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-70301907-edac-485e-a932-fb08d54f94a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6103fdbcc6d41acb0d113400b3617ba'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:27.014952 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-70301907-edac-485e-a932-fb08d54f94a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6103fdbcc6d41acb0d113400b3617ba'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:27.023855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-70301907-edac-485e-a932-fb08d54f94a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6103fdbcc6d41acb0d113400b3617ba'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:27.024646 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-70301907-edac-485e-a932-fb08d54f94a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6103fdbcc6d41acb0d113400b3617ba'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:27.038067 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-70301907-edac-485e-a932-fb08d54f94a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6103fdbcc6d41acb0d113400b3617ba'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:27.053310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1406/2832] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:26:26 2022] DELETE /identity/v3/users/a6103fdbcc6d41acb0d113400b3617ba => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:27.253807 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c3259-05e4-477f-87ae-9df1badf5820 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:27.264545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c3259-05e4-477f-87ae-9df1badf5820 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:27.326653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365ca7b-feb3-4919-b012-be62c24f09f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:27.327294 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ca7b-feb3-4919-b012-be62c24f09f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:27.327566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ca7b-feb3-4919-b012-be62c24f09f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:27.327833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ca7b-feb3-4919-b012-be62c24f09f7 admin admin] PATH_INFO: `/v3/projects/891c88950a604b63875cc147671ee0b3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:27.328934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365ca7b-feb3-4919-b012-be62c24f09f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891c88950a604b63875cc147671ee0b3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:27.331519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365ca7b-feb3-4919-b012-be62c24f09f7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:27.382150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c365ca7b-feb3-4919-b012-be62c24f09f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891c88950a604b63875cc147671ee0b3', 'request_id': 'req-c365ca7b-feb3-4919-b012-be62c24f09f7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:27.387828 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c365ca7b-feb3-4919-b012-be62c24f09f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891c88950a604b63875cc147671ee0b3', 'request_id': 'req-c365ca7b-feb3-4919-b012-be62c24f09f7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:27.394466 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c365ca7b-feb3-4919-b012-be62c24f09f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891c88950a604b63875cc147671ee0b3', 'request_id': 'req-c365ca7b-feb3-4919-b012-be62c24f09f7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:27.412575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c365ca7b-feb3-4919-b012-be62c24f09f7 admin admin] The token cache is being invalidate because project 891c88950a604b63875cc147671ee0b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:26:27.412792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c365ca7b-feb3-4919-b012-be62c24f09f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:27.413411 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c365ca7b-feb3-4919-b012-be62c24f09f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:27.414979 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1427/2833] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:26:27 2022] DELETE /identity/v3/projects/891c88950a604b63875cc147671ee0b3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:26:27.420764 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840c1e-c160-418c-be7f-c82a9772245d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:27.421050 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840c1e-c160-418c-be7f-c82a9772245d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:27.421322 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840c1e-c160-418c-be7f-c82a9772245d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:27.442299 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-16840c1e-c160-418c-be7f-c82a9772245d None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:27.443505 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-16840c1e-c160-418c-be7f-c82a9772245d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:27.505032 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1407/2834] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:27.517245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafc38d-ae2d-4efe-823e-1c24f242b0bb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:27.517581 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafc38d-ae2d-4efe-823e-1c24f242b0bb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:27.517942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafc38d-ae2d-4efe-823e-1c24f242b0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:27.539396 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6bafc38d-ae2d-4efe-823e-1c24f242b0bb None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:27.540678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6bafc38d-ae2d-4efe-823e-1c24f242b0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:27.549015 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1428/2835] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:27.553507 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840c1e-c160-418c-be7f-c82a9772245d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:27.563745 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840c1e-c160-418c-be7f-c82a9772245d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:27.568820 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b6d32-cb83-404d-8369-b70512b6ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:27.569443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b6d32-cb83-404d-8369-b70512b6ef56 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:27.569717 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b6d32-cb83-404d-8369-b70512b6ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:27.569984 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b6d32-cb83-404d-8369-b70512b6ef56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:27.570622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b6d32-cb83-404d-8369-b70512b6ef56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:26:27.570918 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b6d32-cb83-404d-8369-b70512b6ef56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:27.572566 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b6d32-cb83-404d-8369-b70512b6ef56 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:27.574029 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:27.587443 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1408/2836] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:26:27.591170 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafc38d-ae2d-4efe-823e-1c24f242b0bb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:27.600825 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafc38d-ae2d-4efe-823e-1c24f242b0bb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:27.605600 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759413fc-4bf4-4bd0-9020-552b5965ebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:27.606194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759413fc-4bf4-4bd0-9020-552b5965ebec admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:27.606467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759413fc-4bf4-4bd0-9020-552b5965ebec admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:27.606733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759413fc-4bf4-4bd0-9020-552b5965ebec admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:27.607374 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759413fc-4bf4-4bd0-9020-552b5965ebec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:27.609358 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759413fc-4bf4-4bd0-9020-552b5965ebec admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:27.621193 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:27.643971 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1429/2837] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:26:27 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:27.648386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b6d32-cb83-404d-8369-b70512b6ef56 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:27.658604 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b6d32-cb83-404d-8369-b70512b6ef56 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:27.720486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f8e66-aaec-402d-a197-dc3a08bbda71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:27.721008 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f8e66-aaec-402d-a197-dc3a08bbda71 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:27.721282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f8e66-aaec-402d-a197-dc3a08bbda71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:27.721584 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f8e66-aaec-402d-a197-dc3a08bbda71 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:27.722238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f8e66-aaec-402d-a197-dc3a08bbda71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:27.724215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f8e66-aaec-402d-a197-dc3a08bbda71 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:27.748747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1409/2838] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:26:27 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:27.753146 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759413fc-4bf4-4bd0-9020-552b5965ebec admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:27.763682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759413fc-4bf4-4bd0-9020-552b5965ebec admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:27.769682 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26329489-70b4-41c8-8031-3f7c283f57c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:27.770285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26329489-70b4-41c8-8031-3f7c283f57c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:27.770559 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26329489-70b4-41c8-8031-3f7c283f57c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:27.770823 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26329489-70b4-41c8-8031-3f7c283f57c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:27.771465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26329489-70b4-41c8-8031-3f7c283f57c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:27.773148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26329489-70b4-41c8-8031-3f7c283f57c9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:27.783233 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1430/2839] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:27.787479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f8e66-aaec-402d-a197-dc3a08bbda71 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:27.797677 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f8e66-aaec-402d-a197-dc3a08bbda71 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:27.802721 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cb29c-8efb-44f8-b52e-99cef4cf8864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:27.803395 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cb29c-8efb-44f8-b52e-99cef4cf8864 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:27.804016 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cb29c-8efb-44f8-b52e-99cef4cf8864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:27.804327 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cb29c-8efb-44f8-b52e-99cef4cf8864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:27.805064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cb29c-8efb-44f8-b52e-99cef4cf8864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:27.806738 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cb29c-8efb-44f8-b52e-99cef4cf8864 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:27.818140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1410/2840] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:27.822382 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26329489-70b4-41c8-8031-3f7c283f57c9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:27.832774 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26329489-70b4-41c8-8031-3f7c283f57c9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:27.837844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e14dfe-14a1-4763-950e-71b80ecaea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:27.838488 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e14dfe-14a1-4763-950e-71b80ecaea56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:27.838764 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e14dfe-14a1-4763-950e-71b80ecaea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:27.839041 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e14dfe-14a1-4763-950e-71b80ecaea56 admin admin] PATH_INFO: `/v3/projects/9fb04a7a8e794dafa7e57f043222446c/users/cb07094fb5414759a4e24501b8f33f3d/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:27.855852 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e14dfe-14a1-4763-950e-71b80ecaea56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb04a7a8e794dafa7e57f043222446c, user_id=cb07094fb5414759a4e24501b8f33f3d, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:27.858599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e14dfe-14a1-4763-950e-71b80ecaea56 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:27.875681 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1431/2841] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:26:27 2022] PUT /identity/v3/projects/9fb04a7a8e794dafa7e57f043222446c/users/cb07094fb5414759a4e24501b8f33f3d/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:27.886282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e07877-2528-4bb5-85b7-dfd0f74fc0ca None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:27.886568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e07877-2528-4bb5-85b7-dfd0f74fc0ca None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:27.886842 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e07877-2528-4bb5-85b7-dfd0f74fc0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:27.917306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-90e07877-2528-4bb5-85b7-dfd0f74fc0ca None None] MFA Rules not processed for user `cb07094fb5414759a4e24501b8f33f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:27.920238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-90e07877-2528-4bb5-85b7-dfd0f74fc0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:27.988124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1411/2842] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:27.992662 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e14dfe-14a1-4763-950e-71b80ecaea56 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:28.060542 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e14dfe-14a1-4763-950e-71b80ecaea56 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:28.065656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0195e-42a7-4a37-9ddd-b8a92d749efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:28.066447 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0195e-42a7-4a37-9ddd-b8a92d749efc admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:28.066721 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0195e-42a7-4a37-9ddd-b8a92d749efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:28.066990 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0195e-42a7-4a37-9ddd-b8a92d749efc admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:28.067619 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0195e-42a7-4a37-9ddd-b8a92d749efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:28.069598 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0195e-42a7-4a37-9ddd-b8a92d749efc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:28.100123 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1432/2843] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:26:27 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:28.104340 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e07877-2528-4bb5-85b7-dfd0f74fc0ca None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:28.115777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e07877-2528-4bb5-85b7-dfd0f74fc0ca None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:28.179472 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73f653-ff87-477d-b806-b2d49ffe9761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:28.180095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73f653-ff87-477d-b806-b2d49ffe9761 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:28.180422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73f653-ff87-477d-b806-b2d49ffe9761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:28.180665 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73f653-ff87-477d-b806-b2d49ffe9761 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:28.181314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73f653-ff87-477d-b806-b2d49ffe9761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:28.183302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73f653-ff87-477d-b806-b2d49ffe9761 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:28.193767 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:28.214479 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1412/2844] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:26:28 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:28.218782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0195e-42a7-4a37-9ddd-b8a92d749efc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:28.230099 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0195e-42a7-4a37-9ddd-b8a92d749efc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:28.235980 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1315ecf-ef86-47d5-8dba-042623451207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:28.236623 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1315ecf-ef86-47d5-8dba-042623451207 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:28.237018 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1315ecf-ef86-47d5-8dba-042623451207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:28.238365 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1315ecf-ef86-47d5-8dba-042623451207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:28.238622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1315ecf-ef86-47d5-8dba-042623451207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:28.240271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1315ecf-ef86-47d5-8dba-042623451207 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:28.251705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1433/2845] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:28.256030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73f653-ff87-477d-b806-b2d49ffe9761 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:28.266839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73f653-ff87-477d-b806-b2d49ffe9761 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:28.271898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ca8a5-947f-4201-9ab6-a5c176b798ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:28.272598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ca8a5-947f-4201-9ab6-a5c176b798ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:28.272868 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ca8a5-947f-4201-9ab6-a5c176b798ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:28.273230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ca8a5-947f-4201-9ab6-a5c176b798ad admin admin] PATH_INFO: `/v3/projects/3087bd93fece4db39969562c587ad2c9/users/75f4f5cff09e4ab48eb85c510d733f47/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:28.288804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ca8a5-947f-4201-9ab6-a5c176b798ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3087bd93fece4db39969562c587ad2c9, user_id=75f4f5cff09e4ab48eb85c510d733f47, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:28.291523 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ca8a5-947f-4201-9ab6-a5c176b798ad admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:28.306613 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1413/2846] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:26:28 2022] PUT /identity/v3/projects/3087bd93fece4db39969562c587ad2c9/users/75f4f5cff09e4ab48eb85c510d733f47/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:28.310684 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1315ecf-ef86-47d5-8dba-042623451207 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:28.321090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1315ecf-ef86-47d5-8dba-042623451207 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:28.380652 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d6e6d-895b-46a4-a86e-15021a803df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:28.381263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d6e6d-895b-46a4-a86e-15021a803df7 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:28.381543 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d6e6d-895b-46a4-a86e-15021a803df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:28.381818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d6e6d-895b-46a4-a86e-15021a803df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:28.382455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d6e6d-895b-46a4-a86e-15021a803df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:28.384109 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d6e6d-895b-46a4-a86e-15021a803df7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:28.394236 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1434/2847] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:28.398722 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ca8a5-947f-4201-9ab6-a5c176b798ad admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:28.409461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ca8a5-947f-4201-9ab6-a5c176b798ad admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:28.414648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d615d-98f0-456e-99bc-ef8b14697bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:28.415296 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d615d-98f0-456e-99bc-ef8b14697bae admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:28.415577 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d615d-98f0-456e-99bc-ef8b14697bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:28.415855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d615d-98f0-456e-99bc-ef8b14697bae admin admin] PATH_INFO: `/v3/projects/3087bd93fece4db39969562c587ad2c9/users/75f4f5cff09e4ab48eb85c510d733f47/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:28.417848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d615d-98f0-456e-99bc-ef8b14697bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3087bd93fece4db39969562c587ad2c9, user_id=75f4f5cff09e4ab48eb85c510d733f47, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:28.420624 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d615d-98f0-456e-99bc-ef8b14697bae admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:28.431302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1414/2848] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:26:28 2022] PUT /identity/v3/projects/3087bd93fece4db39969562c587ad2c9/users/75f4f5cff09e4ab48eb85c510d733f47/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:28.442836 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c9664-979f-42d5-9760-0a4179014da4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:28.443122 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c9664-979f-42d5-9760-0a4179014da4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:28.443389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c9664-979f-42d5-9760-0a4179014da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:28.472656 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-da6c9664-979f-42d5-9760-0a4179014da4 None None] MFA Rules not processed for user `75f4f5cff09e4ab48eb85c510d733f47`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:28.474220 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-da6c9664-979f-42d5-9760-0a4179014da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:28.486731 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:28.547763 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1435/2849] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:28.561486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d615d-98f0-456e-99bc-ef8b14697bae admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:28.563420 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-544d615d-98f0-456e-99bc-ef8b14697bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:28.633913 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d615d-98f0-456e-99bc-ef8b14697bae admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:28.637978 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb62983-676b-4f25-959e-ed95e2a6e03e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:28.638594 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb62983-676b-4f25-959e-ed95e2a6e03e service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:28.638876 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb62983-676b-4f25-959e-ed95e2a6e03e service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:28.639146 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb62983-676b-4f25-959e-ed95e2a6e03e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:28.648921 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb62983-676b-4f25-959e-ed95e2a6e03e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:28.650409 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb62983-676b-4f25-959e-ed95e2a6e03e service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:28.660568 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1415/2850] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 01:26:30.139576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c9664-979f-42d5-9760-0a4179014da4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:30.203455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c9664-979f-42d5-9760-0a4179014da4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:30.208271 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:30.208952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:30.209192 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:30.209458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] PATH_INFO: `/v3/users/cb07094fb5414759a4e24501b8f33f3d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:30.210609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb07094fb5414759a4e24501b8f33f3d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:30.212624 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:30.266907 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb07094fb5414759a4e24501b8f33f3d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:30.267550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb07094fb5414759a4e24501b8f33f3d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:30.277536 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb07094fb5414759a4e24501b8f33f3d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:30.285552 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb07094fb5414759a4e24501b8f33f3d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:30.286361 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb07094fb5414759a4e24501b8f33f3d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:30.304609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1436/2851] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:26:30 2022] DELETE /identity/v3/users/cb07094fb5414759a4e24501b8f33f3d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:30.309377 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2dac-f121-4763-80b9-0856dbec91f7 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:30.309858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2dac-f121-4763-80b9-0856dbec91f7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:30.309957 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2dac-f121-4763-80b9-0856dbec91f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:30.330109 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-487e2dac-f121-4763-80b9-0856dbec91f7 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:30.331346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-487e2dac-f121-4763-80b9-0856dbec91f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:30.393262 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1416/2852] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:30.404049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:30.406518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:30.449654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:30.474586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fbe88-dbe0-4e62-8aae-3a1fe5d21b2c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:30.478391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a6e73-15b3-4f03-a702-a9a697bc7743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:30.478995 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a6e73-15b3-4f03-a702-a9a697bc7743 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:30.479269 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a6e73-15b3-4f03-a702-a9a697bc7743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:30.479533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a6e73-15b3-4f03-a702-a9a697bc7743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:30.488749 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a6e73-15b3-4f03-a702-a9a697bc7743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:30.490230 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a6e73-15b3-4f03-a702-a9a697bc7743 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:30.499550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1437/2853] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:26:30.778351 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2dac-f121-4763-80b9-0856dbec91f7 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:30.779943 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-487e2dac-f121-4763-80b9-0856dbec91f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:30.793295 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2dac-f121-4763-80b9-0856dbec91f7 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:30.798182 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:30.798798 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:30.799638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:30.799922 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] PATH_INFO: `/v3/projects/9fb04a7a8e794dafa7e57f043222446c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:30.801310 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb04a7a8e794dafa7e57f043222446c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:30.803239 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:30.854482 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb04a7a8e794dafa7e57f043222446c', 'request_id': 'req-d640c485-ea93-4c8f-9dae-7eae2530e4ba'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:30.856433 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:30.861424 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb04a7a8e794dafa7e57f043222446c', 'request_id': 'req-d640c485-ea93-4c8f-9dae-7eae2530e4ba'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:30.870873 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb04a7a8e794dafa7e57f043222446c', 'request_id': 'req-d640c485-ea93-4c8f-9dae-7eae2530e4ba'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:30.881266 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] The token cache is being invalidate because project 9fb04a7a8e794dafa7e57f043222446c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:26:30.881548 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:30.882175 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:30.883658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1417/2854] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:26:30 2022] DELETE /identity/v3/projects/9fb04a7a8e794dafa7e57f043222446c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:30.887796 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a6e73-15b3-4f03-a702-a9a697bc7743 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:30.897703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a6e73-15b3-4f03-a702-a9a697bc7743 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:30.961743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb3b3f-b2ac-429a-aa45-e4946f03faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:30.962402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb3b3f-b2ac-429a-aa45-e4946f03faf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:30.962671 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb3b3f-b2ac-429a-aa45-e4946f03faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:30.962937 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb3b3f-b2ac-429a-aa45-e4946f03faf4 admin admin] PATH_INFO: `/v3/users/75f4f5cff09e4ab48eb85c510d733f47` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:30.964134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb3b3f-b2ac-429a-aa45-e4946f03faf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f4f5cff09e4ab48eb85c510d733f47)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:30.966183 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb3b3f-b2ac-429a-aa45-e4946f03faf4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:31.021139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7fdb3b3f-b2ac-429a-aa45-e4946f03faf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f4f5cff09e4ab48eb85c510d733f47'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:31.021850 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7fdb3b3f-b2ac-429a-aa45-e4946f03faf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f4f5cff09e4ab48eb85c510d733f47'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:31.032818 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7fdb3b3f-b2ac-429a-aa45-e4946f03faf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f4f5cff09e4ab48eb85c510d733f47'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:31.040407 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7fdb3b3f-b2ac-429a-aa45-e4946f03faf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f4f5cff09e4ab48eb85c510d733f47'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:31.041082 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7fdb3b3f-b2ac-429a-aa45-e4946f03faf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f4f5cff09e4ab48eb85c510d733f47'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:31.058332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1438/2855] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:26:30 2022] DELETE /identity/v3/users/75f4f5cff09e4ab48eb85c510d733f47 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:31.349343 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:31.351722 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:31.366554 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640c485-ea93-4c8f-9dae-7eae2530e4ba admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:31.424490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a512488-401e-428c-b99b-7c549a076273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:31.425125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a512488-401e-428c-b99b-7c549a076273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:31.425403 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a512488-401e-428c-b99b-7c549a076273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:31.425674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a512488-401e-428c-b99b-7c549a076273 admin admin] PATH_INFO: `/v3/projects/3087bd93fece4db39969562c587ad2c9` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:31.426898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a512488-401e-428c-b99b-7c549a076273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3087bd93fece4db39969562c587ad2c9)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:31.428887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a512488-401e-428c-b99b-7c549a076273 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:31.474773 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1a512488-401e-428c-b99b-7c549a076273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3087bd93fece4db39969562c587ad2c9', 'request_id': 'req-1a512488-401e-428c-b99b-7c549a076273'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:31.481076 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1a512488-401e-428c-b99b-7c549a076273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3087bd93fece4db39969562c587ad2c9', 'request_id': 'req-1a512488-401e-428c-b99b-7c549a076273'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:31.490652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1a512488-401e-428c-b99b-7c549a076273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3087bd93fece4db39969562c587ad2c9', 'request_id': 'req-1a512488-401e-428c-b99b-7c549a076273'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:31.501326 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1a512488-401e-428c-b99b-7c549a076273 admin admin] The token cache is being invalidate because project 3087bd93fece4db39969562c587ad2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:26:31.501615 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1a512488-401e-428c-b99b-7c549a076273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:31.502315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1a512488-401e-428c-b99b-7c549a076273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:31.504044 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1418/2856] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:26:31 2022] DELETE /identity/v3/projects/3087bd93fece4db39969562c587ad2c9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:31.509276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78356-e792-4099-b850-94a6231b28a2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:31.509781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78356-e792-4099-b850-94a6231b28a2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:31.509895 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78356-e792-4099-b850-94a6231b28a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:31.530465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-55e78356-e792-4099-b850-94a6231b28a2 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:31.531676 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-55e78356-e792-4099-b850-94a6231b28a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:31.589344 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:31.604574 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1439/2857] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:31.612749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff39d0-b989-4fca-914f-dd3b47a6b4bd None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:31.613060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff39d0-b989-4fca-914f-dd3b47a6b4bd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:31.613346 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff39d0-b989-4fca-914f-dd3b47a6b4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:31.633881 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4fff39d0-b989-4fca-914f-dd3b47a6b4bd None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:31.635143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4fff39d0-b989-4fca-914f-dd3b47a6b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:31.643728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1419/2858] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:31.648089 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e78356-e792-4099-b850-94a6231b28a2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:31.657958 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e78356-e792-4099-b850-94a6231b28a2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:31.662989 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecc70c-e09b-4456-9db1-d5b44c5b2463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:31.663589 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecc70c-e09b-4456-9db1-d5b44c5b2463 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:31.663867 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecc70c-e09b-4456-9db1-d5b44c5b2463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:31.664139 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecc70c-e09b-4456-9db1-d5b44c5b2463 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:31.664813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecc70c-e09b-4456-9db1-d5b44c5b2463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:26:31.665121 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecc70c-e09b-4456-9db1-d5b44c5b2463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:31.666777 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecc70c-e09b-4456-9db1-d5b44c5b2463 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:31.678575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1440/2859] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 01:26:31.682804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff39d0-b989-4fca-914f-dd3b47a6b4bd None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:31.692484 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff39d0-b989-4fca-914f-dd3b47a6b4bd None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:31.698966 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2510ee-b044-46e2-916e-671d66d4fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:31.699567 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2510ee-b044-46e2-916e-671d66d4fff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:31.699843 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2510ee-b044-46e2-916e-671d66d4fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:31.700113 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2510ee-b044-46e2-916e-671d66d4fff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:31.700774 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2510ee-b044-46e2-916e-671d66d4fff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:31.702718 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2510ee-b044-46e2-916e-671d66d4fff4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:31.733566 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1420/2860] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:26:31 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:31.737955 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecc70c-e09b-4456-9db1-d5b44c5b2463 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:31.748343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecc70c-e09b-4456-9db1-d5b44c5b2463 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:31.806575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9a0e-1eaa-4c54-b0e6-de505653bbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:31.807197 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9a0e-1eaa-4c54-b0e6-de505653bbaf admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:31.807452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9a0e-1eaa-4c54-b0e6-de505653bbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:31.807720 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9a0e-1eaa-4c54-b0e6-de505653bbaf admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:31.808369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b9a0e-1eaa-4c54-b0e6-de505653bbaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:31.810356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b9a0e-1eaa-4c54-b0e6-de505653bbaf admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:31.833525 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1441/2861] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:26:31 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:31.837861 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2510ee-b044-46e2-916e-671d66d4fff4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:31.848379 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2510ee-b044-46e2-916e-671d66d4fff4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:31.853603 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b927c48-9c89-4319-aa6a-f0232c486b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:31.854201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b927c48-9c89-4319-aa6a-f0232c486b3c admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:31.854471 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b927c48-9c89-4319-aa6a-f0232c486b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:31.854736 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b927c48-9c89-4319-aa6a-f0232c486b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:31.855373 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b927c48-9c89-4319-aa6a-f0232c486b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:31.857106 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b927c48-9c89-4319-aa6a-f0232c486b3c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:31.867610 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1421/2862] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:31.871686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9a0e-1eaa-4c54-b0e6-de505653bbaf admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:31.882861 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9a0e-1eaa-4c54-b0e6-de505653bbaf admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:31.887949 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24332ce3-c5e4-4e61-92e5-8c96245c83c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:31.888583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24332ce3-c5e4-4e61-92e5-8c96245c83c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:31.888862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24332ce3-c5e4-4e61-92e5-8c96245c83c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:31.889135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24332ce3-c5e4-4e61-92e5-8c96245c83c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:31.889785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24332ce3-c5e4-4e61-92e5-8c96245c83c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:31.891769 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24332ce3-c5e4-4e61-92e5-8c96245c83c0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:31.903417 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1442/2863] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:31.908613 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b927c48-9c89-4319-aa6a-f0232c486b3c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:31.925816 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b927c48-9c89-4319-aa6a-f0232c486b3c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:31.932217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ae664-8bc8-4a7d-8571-e835ce82a704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:31.932920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ae664-8bc8-4a7d-8571-e835ce82a704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:31.933196 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ae664-8bc8-4a7d-8571-e835ce82a704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:31.933469 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ae664-8bc8-4a7d-8571-e835ce82a704 admin admin] PATH_INFO: `/v3/projects/85d0572c1fc245de9553d0c2596b7d60/users/b4e8d14744fd4bee949f91b757829972/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:31.949796 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ae664-8bc8-4a7d-8571-e835ce82a704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d0572c1fc245de9553d0c2596b7d60, user_id=b4e8d14744fd4bee949f91b757829972, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:31.952611 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ae664-8bc8-4a7d-8571-e835ce82a704 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:31.969632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1422/2864] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:26:31 2022] PUT /identity/v3/projects/85d0572c1fc245de9553d0c2596b7d60/users/b4e8d14744fd4bee949f91b757829972/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:31.981267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4541bc-05d7-4799-9175-92b1856b70f0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:31.981547 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4541bc-05d7-4799-9175-92b1856b70f0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:31.981810 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4541bc-05d7-4799-9175-92b1856b70f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:32.013838 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1d4541bc-05d7-4799-9175-92b1856b70f0 None None] MFA Rules not processed for user `b4e8d14744fd4bee949f91b757829972`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:32.015075 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1d4541bc-05d7-4799-9175-92b1856b70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:32.082491 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1443/2865] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:32.089632 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ae664-8bc8-4a7d-8571-e835ce82a704 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:32.104807 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:32.166986 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ae664-8bc8-4a7d-8571-e835ce82a704 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:32.172637 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5655b8-4de4-4d74-aa21-8384e1c3f7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:32.173227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5655b8-4de4-4d74-aa21-8384e1c3f7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:32.173502 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5655b8-4de4-4d74-aa21-8384e1c3f7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:32.173775 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5655b8-4de4-4d74-aa21-8384e1c3f7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:32.174411 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5655b8-4de4-4d74-aa21-8384e1c3f7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:32.176380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5655b8-4de4-4d74-aa21-8384e1c3f7d3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:32.212786 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1423/2866] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:26:32 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:32.216936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4541bc-05d7-4799-9175-92b1856b70f0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:32.228504 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4541bc-05d7-4799-9175-92b1856b70f0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:32.279485 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:32.295076 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a3b5d-69b6-4386-be45-9f09e0644713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:32.295689 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a3b5d-69b6-4386-be45-9f09e0644713 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:32.295969 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a3b5d-69b6-4386-be45-9f09e0644713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:32.296227 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a3b5d-69b6-4386-be45-9f09e0644713 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:32.296909 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a3b5d-69b6-4386-be45-9f09e0644713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:32.298899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a3b5d-69b6-4386-be45-9f09e0644713 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:32.325601 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1444/2867] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:26:32 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:32.331650 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5655b8-4de4-4d74-aa21-8384e1c3f7d3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:32.349314 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5655b8-4de4-4d74-aa21-8384e1c3f7d3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:32.354641 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cccc0e-05aa-4598-bbd2-5ffe52a6cdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:32.355294 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cccc0e-05aa-4598-bbd2-5ffe52a6cdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:32.355537 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cccc0e-05aa-4598-bbd2-5ffe52a6cdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:32.355808 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cccc0e-05aa-4598-bbd2-5ffe52a6cdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:32.356491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cccc0e-05aa-4598-bbd2-5ffe52a6cdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:32.358162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cccc0e-05aa-4598-bbd2-5ffe52a6cdb8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:32.369669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1424/2868] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:32.373950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a3b5d-69b6-4386-be45-9f09e0644713 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:32.384985 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a3b5d-69b6-4386-be45-9f09e0644713 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:32.391049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4017e0-fef2-4ecd-9207-e993a974169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:32.391699 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4017e0-fef2-4ecd-9207-e993a974169d admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:32.391975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4017e0-fef2-4ecd-9207-e993a974169d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:32.392221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4017e0-fef2-4ecd-9207-e993a974169d admin admin] PATH_INFO: `/v3/projects/65c47858d1ae42a5a13cbcb6d698a460/users/9a890f7cde2642e99f22a8faefc337ac/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:32.407669 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4017e0-fef2-4ecd-9207-e993a974169d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c47858d1ae42a5a13cbcb6d698a460, user_id=9a890f7cde2642e99f22a8faefc337ac, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:32.410426 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4017e0-fef2-4ecd-9207-e993a974169d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:32.424599 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1445/2869] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:26:32 2022] PUT /identity/v3/projects/65c47858d1ae42a5a13cbcb6d698a460/users/9a890f7cde2642e99f22a8faefc337ac/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:32.429498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cccc0e-05aa-4598-bbd2-5ffe52a6cdb8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:32.444083 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cccc0e-05aa-4598-bbd2-5ffe52a6cdb8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:32.505160 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbbf42-aa8e-471d-bae2-6c22874c76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:32.505439 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbbf42-aa8e-471d-bae2-6c22874c76ac admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:32.505710 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbbf42-aa8e-471d-bae2-6c22874c76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:32.505979 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbbf42-aa8e-471d-bae2-6c22874c76ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:32.506615 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbbf42-aa8e-471d-bae2-6c22874c76ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:32.508421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbbf42-aa8e-471d-bae2-6c22874c76ac admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:32.519428 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1425/2870] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:32.523847 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4017e0-fef2-4ecd-9207-e993a974169d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:32.534566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4017e0-fef2-4ecd-9207-e993a974169d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:32.539388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30323f1c-3a57-44bf-bd92-c1cf43b56012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:32.540031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30323f1c-3a57-44bf-bd92-c1cf43b56012 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:32.540308 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30323f1c-3a57-44bf-bd92-c1cf43b56012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:32.540595 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30323f1c-3a57-44bf-bd92-c1cf43b56012 admin admin] PATH_INFO: `/v3/projects/65c47858d1ae42a5a13cbcb6d698a460/users/9a890f7cde2642e99f22a8faefc337ac/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:32.542577 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30323f1c-3a57-44bf-bd92-c1cf43b56012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c47858d1ae42a5a13cbcb6d698a460, user_id=9a890f7cde2642e99f22a8faefc337ac, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:32.545327 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30323f1c-3a57-44bf-bd92-c1cf43b56012 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:32.555435 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1446/2871] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:26:32 2022] PUT /identity/v3/projects/65c47858d1ae42a5a13cbcb6d698a460/users/9a890f7cde2642e99f22a8faefc337ac/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:32.565910 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6db0b5-341f-4f76-937e-671b55767ec0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:32.566198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6db0b5-341f-4f76-937e-671b55767ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:32.566476 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6db0b5-341f-4f76-937e-671b55767ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:32.594889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ce6db0b5-341f-4f76-937e-671b55767ec0 None None] MFA Rules not processed for user `9a890f7cde2642e99f22a8faefc337ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:32.596101 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ce6db0b5-341f-4f76-937e-671b55767ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:32.667510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1426/2872] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:32.678514 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30323f1c-3a57-44bf-bd92-c1cf43b56012 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:32.680518 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-30323f1c-3a57-44bf-bd92-c1cf43b56012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:32.741336 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30323f1c-3a57-44bf-bd92-c1cf43b56012 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:32.745398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6ebc0-9a27-45fa-b6d1-9d6a4a4fc038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:32.746007 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6ebc0-9a27-45fa-b6d1-9d6a4a4fc038 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:32.746283 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6ebc0-9a27-45fa-b6d1-9d6a4a4fc038 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:32.746554 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6ebc0-9a27-45fa-b6d1-9d6a4a4fc038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:32.755950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6ebc0-9a27-45fa-b6d1-9d6a4a4fc038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:32.757471 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6ebc0-9a27-45fa-b6d1-9d6a4a4fc038 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:32.767343 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1447/2873] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:26:32.873783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6db0b5-341f-4f76-937e-671b55767ec0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:32.878776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:32.886013 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6db0b5-341f-4f76-937e-671b55767ec0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:32.890165 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3f6a5-b998-44e7-83e6-7045d730d37a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:32.891125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3f6a5-b998-44e7-83e6-7045d730d37a service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:32.891406 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3f6a5-b998-44e7-83e6-7045d730d37a service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:32.891679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3f6a5-b998-44e7-83e6-7045d730d37a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:32.950954 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3f6a5-b998-44e7-83e6-7045d730d37a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:32.952441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3f6a5-b998-44e7-83e6-7045d730d37a service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:32.964162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1427/2874] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:26:35.581660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6ebc0-9a27-45fa-b6d1-9d6a4a4fc038 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:35.649733 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6ebc0-9a27-45fa-b6d1-9d6a4a4fc038 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:35.655744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:35.656421 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:35.656702 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:35.656963 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] PATH_INFO: `/v3/users/b4e8d14744fd4bee949f91b757829972` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:35.658311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e8d14744fd4bee949f91b757829972)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:35.660391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:35.712997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:35.714910 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e8d14744fd4bee949f91b757829972'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:35.715630 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e8d14744fd4bee949f91b757829972'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:35.725744 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e8d14744fd4bee949f91b757829972'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:35.733148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e8d14744fd4bee949f91b757829972'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:35.733782 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e8d14744fd4bee949f91b757829972'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:35.751180 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1448/2875] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:26:35 2022] DELETE /identity/v3/users/b4e8d14744fd4bee949f91b757829972 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:35.755920 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25685d7-1327-4e2a-8c09-079cff12c5d0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:35.756441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25685d7-1327-4e2a-8c09-079cff12c5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:35.756539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25685d7-1327-4e2a-8c09-079cff12c5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:35.778598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a25685d7-1327-4e2a-8c09-079cff12c5d0 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:35.779792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a25685d7-1327-4e2a-8c09-079cff12c5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:35.853900 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1428/2876] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:35.863698 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:35.865362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:35.926398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ee7e6-8965-48a5-bd03-1e510801276d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:35.930732 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909c24-66ca-4916-8a57-987055c6918b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:35.931338 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909c24-66ca-4916-8a57-987055c6918b service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:35.931611 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909c24-66ca-4916-8a57-987055c6918b service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:35.931887 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909c24-66ca-4916-8a57-987055c6918b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:35.941393 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df909c24-66ca-4916-8a57-987055c6918b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:35.943109 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df909c24-66ca-4916-8a57-987055c6918b service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:35.953248 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1449/2877] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:26:36.234586 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25685d7-1327-4e2a-8c09-079cff12c5d0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:36.236140 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a25685d7-1327-4e2a-8c09-079cff12c5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:36.248928 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25685d7-1327-4e2a-8c09-079cff12c5d0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:36.255421 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:36.256059 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:36.256341 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:36.256612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] PATH_INFO: `/v3/projects/85d0572c1fc245de9553d0c2596b7d60` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:36.257817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d0572c1fc245de9553d0c2596b7d60)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:36.260831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:36.312695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d0572c1fc245de9553d0c2596b7d60', 'request_id': 'req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.319422 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d0572c1fc245de9553d0c2596b7d60', 'request_id': 'req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.329011 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d0572c1fc245de9553d0c2596b7d60', 'request_id': 'req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.340577 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] The token cache is being invalidate because project 85d0572c1fc245de9553d0c2596b7d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:26:36.340857 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.341481 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.342958 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1429/2878] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:26:36 2022] DELETE /identity/v3/projects/85d0572c1fc245de9553d0c2596b7d60 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:36.347031 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909c24-66ca-4916-8a57-987055c6918b service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:36.356932 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909c24-66ca-4916-8a57-987055c6918b service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:36.416311 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd7ae3-d784-4b23-973d-1e0f2987da39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:36.416942 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd7ae3-d784-4b23-973d-1e0f2987da39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:36.417204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd7ae3-d784-4b23-973d-1e0f2987da39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:36.417481 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd7ae3-d784-4b23-973d-1e0f2987da39 admin admin] PATH_INFO: `/v3/users/9a890f7cde2642e99f22a8faefc337ac` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:36.418671 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd7ae3-d784-4b23-973d-1e0f2987da39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a890f7cde2642e99f22a8faefc337ac)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:36.420719 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd7ae3-d784-4b23-973d-1e0f2987da39 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:36.474614 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-27dd7ae3-d784-4b23-973d-1e0f2987da39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a890f7cde2642e99f22a8faefc337ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.475245 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-27dd7ae3-d784-4b23-973d-1e0f2987da39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a890f7cde2642e99f22a8faefc337ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.484903 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-27dd7ae3-d784-4b23-973d-1e0f2987da39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a890f7cde2642e99f22a8faefc337ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.492470 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-27dd7ae3-d784-4b23-973d-1e0f2987da39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a890f7cde2642e99f22a8faefc337ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.493096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-27dd7ae3-d784-4b23-973d-1e0f2987da39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a890f7cde2642e99f22a8faefc337ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.497393 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:36.513649 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1450/2879] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:26:36 2022] DELETE /identity/v3/users/9a890f7cde2642e99f22a8faefc337ac => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:36.800944 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:36.802521 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:36.820927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf006f-6dd8-465e-8455-d9ed2a91ebab admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:36.844645 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:36.883659 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d619b73-6769-4203-9d30-c35929a2a3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:36.884215 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d619b73-6769-4203-9d30-c35929a2a3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:36.884517 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d619b73-6769-4203-9d30-c35929a2a3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:36.884783 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d619b73-6769-4203-9d30-c35929a2a3f5 admin admin] PATH_INFO: `/v3/projects/65c47858d1ae42a5a13cbcb6d698a460` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:36.886031 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d619b73-6769-4203-9d30-c35929a2a3f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c47858d1ae42a5a13cbcb6d698a460)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:36.888020 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d619b73-6769-4203-9d30-c35929a2a3f5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:36.937074 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6d619b73-6769-4203-9d30-c35929a2a3f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c47858d1ae42a5a13cbcb6d698a460', 'request_id': 'req-6d619b73-6769-4203-9d30-c35929a2a3f5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.943259 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6d619b73-6769-4203-9d30-c35929a2a3f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c47858d1ae42a5a13cbcb6d698a460', 'request_id': 'req-6d619b73-6769-4203-9d30-c35929a2a3f5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.951819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6d619b73-6769-4203-9d30-c35929a2a3f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c47858d1ae42a5a13cbcb6d698a460', 'request_id': 'req-6d619b73-6769-4203-9d30-c35929a2a3f5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.961882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6d619b73-6769-4203-9d30-c35929a2a3f5 admin admin] The token cache is being invalidate because project 65c47858d1ae42a5a13cbcb6d698a460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:26:36.962187 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6d619b73-6769-4203-9d30-c35929a2a3f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.962777 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6d619b73-6769-4203-9d30-c35929a2a3f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:36.964227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1430/2880] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:26:36 2022] DELETE /identity/v3/projects/65c47858d1ae42a5a13cbcb6d698a460 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:36.969148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6972-29f4-4434-8e53-42c5fe084fe1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:36.969640 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6972-29f4-4434-8e53-42c5fe084fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:36.969738 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6972-29f4-4434-8e53-42c5fe084fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:36.989757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fa7b6972-29f4-4434-8e53-42c5fe084fe1 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:36.990944 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fa7b6972-29f4-4434-8e53-42c5fe084fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:37.057134 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1451/2881] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:37.065288 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2321a9-63c1-4021-bb4c-e70d5df89632 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.065582 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2321a9-63c1-4021-bb4c-e70d5df89632 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.065831 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2321a9-63c1-4021-bb4c-e70d5df89632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.088491 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3a2321a9-63c1-4021-bb4c-e70d5df89632 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:37.089715 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3a2321a9-63c1-4021-bb4c-e70d5df89632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:37.100183 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1431/2882] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:37.104779 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6972-29f4-4434-8e53-42c5fe084fe1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:37.114757 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6972-29f4-4434-8e53-42c5fe084fe1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:37.120334 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88587aa-146a-47a5-ad82-af16775d76e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:37.120950 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88587aa-146a-47a5-ad82-af16775d76e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.121226 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88587aa-146a-47a5-ad82-af16775d76e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.121496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88587aa-146a-47a5-ad82-af16775d76e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.122148 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88587aa-146a-47a5-ad82-af16775d76e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:26:37.122452 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88587aa-146a-47a5-ad82-af16775d76e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:37.124106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88587aa-146a-47a5-ad82-af16775d76e9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:37.136185 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1452/2883] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:26:37.141007 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2321a9-63c1-4021-bb4c-e70d5df89632 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:37.150512 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2321a9-63c1-4021-bb4c-e70d5df89632 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:37.155598 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c09f5-b311-44b1-8f0f-a447aba5b7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:37.156201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c09f5-b311-44b1-8f0f-a447aba5b7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.156504 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c09f5-b311-44b1-8f0f-a447aba5b7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.156791 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c09f5-b311-44b1-8f0f-a447aba5b7c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.157401 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c09f5-b311-44b1-8f0f-a447aba5b7c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:37.159338 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c09f5-b311-44b1-8f0f-a447aba5b7c5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:37.189124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1432/2884] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:26:37 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:37.193508 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88587aa-146a-47a5-ad82-af16775d76e9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:37.203625 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88587aa-146a-47a5-ad82-af16775d76e9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:37.261528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65618cbd-ac86-43a4-9fc9-dec8632adef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:37.262118 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65618cbd-ac86-43a4-9fc9-dec8632adef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.262391 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65618cbd-ac86-43a4-9fc9-dec8632adef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.262660 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65618cbd-ac86-43a4-9fc9-dec8632adef6 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.263317 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65618cbd-ac86-43a4-9fc9-dec8632adef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:37.265325 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65618cbd-ac86-43a4-9fc9-dec8632adef6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:37.288551 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1453/2885] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:26:37 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 01:26:37.292723 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c09f5-b311-44b1-8f0f-a447aba5b7c5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:37.302878 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c09f5-b311-44b1-8f0f-a447aba5b7c5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:37.307496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a6a9c-2455-478d-a541-d5de30ee40a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:37.308094 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a6a9c-2455-478d-a541-d5de30ee40a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.308397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a6a9c-2455-478d-a541-d5de30ee40a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.308669 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a6a9c-2455-478d-a541-d5de30ee40a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.309302 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a6a9c-2455-478d-a541-d5de30ee40a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:37.310935 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a6a9c-2455-478d-a541-d5de30ee40a0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:37.321006 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1433/2886] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:37.324972 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65618cbd-ac86-43a4-9fc9-dec8632adef6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:37.335164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65618cbd-ac86-43a4-9fc9-dec8632adef6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:37.340110 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b472-550d-4e62-88b3-875a07938346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:37.340718 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b472-550d-4e62-88b3-875a07938346 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.340993 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b472-550d-4e62-88b3-875a07938346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.341262 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b472-550d-4e62-88b3-875a07938346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.341899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6b472-550d-4e62-88b3-875a07938346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:37.343533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6b472-550d-4e62-88b3-875a07938346 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:37.354477 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1454/2887] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:37.358600 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a6a9c-2455-478d-a541-d5de30ee40a0 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:37.369019 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a6a9c-2455-478d-a541-d5de30ee40a0 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:37.373655 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f358229-e320-460d-9aaf-7e7368ac016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:37.374315 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f358229-e320-460d-9aaf-7e7368ac016f admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.374591 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f358229-e320-460d-9aaf-7e7368ac016f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.374862 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f358229-e320-460d-9aaf-7e7368ac016f admin admin] PATH_INFO: `/v3/projects/a3cd4ef5d67a47ffb5dc3de5d3e87238/users/9eb116e484964f7eb346e56ba35cd2b0/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.389638 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f358229-e320-460d-9aaf-7e7368ac016f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cd4ef5d67a47ffb5dc3de5d3e87238, user_id=9eb116e484964f7eb346e56ba35cd2b0, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:37.392700 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f358229-e320-460d-9aaf-7e7368ac016f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:37.408882 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1434/2888] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:26:37 2022] PUT /identity/v3/projects/a3cd4ef5d67a47ffb5dc3de5d3e87238/users/9eb116e484964f7eb346e56ba35cd2b0/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:26:37.473981 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb77d3-5d98-40cb-8751-90e0b3202373 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.474264 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb77d3-5d98-40cb-8751-90e0b3202373 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.474545 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb77d3-5d98-40cb-8751-90e0b3202373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.504593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e9bb77d3-5d98-40cb-8751-90e0b3202373 None None] MFA Rules not processed for user `9eb116e484964f7eb346e56ba35cd2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:37.506046 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e9bb77d3-5d98-40cb-8751-90e0b3202373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:37.547740 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:37.574926 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1455/2889] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:37.579625 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f358229-e320-460d-9aaf-7e7368ac016f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:37.634065 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:37.647410 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f358229-e320-460d-9aaf-7e7368ac016f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:37.652927 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f1700-85c7-4b96-b89b-043fdb1ebc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:37.653250 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f1700-85c7-4b96-b89b-043fdb1ebc7b admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.653535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f1700-85c7-4b96-b89b-043fdb1ebc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.653806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f1700-85c7-4b96-b89b-043fdb1ebc7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.654486 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f1700-85c7-4b96-b89b-043fdb1ebc7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:37.656500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f1700-85c7-4b96-b89b-043fdb1ebc7b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:37.687213 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1435/2890] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:26:37 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:37.691565 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb77d3-5d98-40cb-8751-90e0b3202373 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:37.702560 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb77d3-5d98-40cb-8751-90e0b3202373 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:37.758781 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4d52e-71d8-4174-9f0a-49abcf530f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:37.759685 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4d52e-71d8-4174-9f0a-49abcf530f27 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.759992 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4d52e-71d8-4174-9f0a-49abcf530f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.760332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4d52e-71d8-4174-9f0a-49abcf530f27 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.761289 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4d52e-71d8-4174-9f0a-49abcf530f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:37.764467 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4d52e-71d8-4174-9f0a-49abcf530f27 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:37.795388 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1456/2891] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:26:37 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:37.799760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f1700-85c7-4b96-b89b-043fdb1ebc7b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:37.810992 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f1700-85c7-4b96-b89b-043fdb1ebc7b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:37.816620 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddd131-931f-46ee-a61f-fef74d1075ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:37.817225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddd131-931f-46ee-a61f-fef74d1075ac admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.817494 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddd131-931f-46ee-a61f-fef74d1075ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.817855 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddd131-931f-46ee-a61f-fef74d1075ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.818588 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddd131-931f-46ee-a61f-fef74d1075ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:37.820147 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddd131-931f-46ee-a61f-fef74d1075ac admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:37.831047 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1436/2892] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:37.835288 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4d52e-71d8-4174-9f0a-49abcf530f27 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:37.845870 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4d52e-71d8-4174-9f0a-49abcf530f27 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:37.851755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d9579-472c-4129-9e50-9e333c662ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:37.852428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d9579-472c-4129-9e50-9e333c662ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.852703 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d9579-472c-4129-9e50-9e333c662ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.852970 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d9579-472c-4129-9e50-9e333c662ea4 admin admin] PATH_INFO: `/v3/projects/e3f055bd18f443b2ab61c26eff06e5a8/users/b13626a57aa24543a8c7f1e6759e6f2e/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.868190 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d9579-472c-4129-9e50-9e333c662ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f055bd18f443b2ab61c26eff06e5a8, user_id=b13626a57aa24543a8c7f1e6759e6f2e, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:37.870925 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d9579-472c-4129-9e50-9e333c662ea4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:37.886137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1457/2893] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:26:37 2022] PUT /identity/v3/projects/e3f055bd18f443b2ab61c26eff06e5a8/users/b13626a57aa24543a8c7f1e6759e6f2e/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:37.890695 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddd131-931f-46ee-a61f-fef74d1075ac admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:37.901305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddd131-931f-46ee-a61f-fef74d1075ac admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:37.962098 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7efd3-2854-4ef8-817a-65e36a65d2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:37.962728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7efd3-2854-4ef8-817a-65e36a65d2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:37.963002 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7efd3-2854-4ef8-817a-65e36a65d2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:37.963271 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7efd3-2854-4ef8-817a-65e36a65d2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:37.963891 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7efd3-2854-4ef8-817a-65e36a65d2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:37.965880 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7efd3-2854-4ef8-817a-65e36a65d2b4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:37.977303 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1437/2894] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:37.981890 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d9579-472c-4129-9e50-9e333c662ea4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:37.993855 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d9579-472c-4129-9e50-9e333c662ea4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:37.999785 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6b161-675d-4df6-a727-0a2e7eb289f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:38.000476 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6b161-675d-4df6-a727-0a2e7eb289f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:38.000768 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6b161-675d-4df6-a727-0a2e7eb289f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:38.001023 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6b161-675d-4df6-a727-0a2e7eb289f0 admin admin] PATH_INFO: `/v3/projects/e3f055bd18f443b2ab61c26eff06e5a8/users/b13626a57aa24543a8c7f1e6759e6f2e/roles/8c3e1d1e8c74417c922e6978cdf1c28c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:38.003156 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6b161-675d-4df6-a727-0a2e7eb289f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f055bd18f443b2ab61c26eff06e5a8, user_id=b13626a57aa24543a8c7f1e6759e6f2e, role_id=8c3e1d1e8c74417c922e6978cdf1c28c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:38.005906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6b161-675d-4df6-a727-0a2e7eb289f0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:38.020636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1458/2895] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:26:37 2022] PUT /identity/v3/projects/e3f055bd18f443b2ab61c26eff06e5a8/users/b13626a57aa24543a8c7f1e6759e6f2e/roles/8c3e1d1e8c74417c922e6978cdf1c28c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:38.031014 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadbfd3-0ef8-42ed-848a-79452f7b2e65 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:38.031323 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadbfd3-0ef8-42ed-848a-79452f7b2e65 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:38.031624 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadbfd3-0ef8-42ed-848a-79452f7b2e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:38.061649 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9fadbfd3-0ef8-42ed-848a-79452f7b2e65 None None] MFA Rules not processed for user `b13626a57aa24543a8c7f1e6759e6f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:38.062889 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9fadbfd3-0ef8-42ed-848a-79452f7b2e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:38.142380 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1438/2896] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:38.154826 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6b161-675d-4df6-a727-0a2e7eb289f0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:38.156765 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e9f6b161-675d-4df6-a727-0a2e7eb289f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:38.218261 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6b161-675d-4df6-a727-0a2e7eb289f0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:38.222240 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b2a2-3b61-44c3-bc0f-b4b58e5996b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:38.222844 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b2a2-3b61-44c3-bc0f-b4b58e5996b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:38.223098 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b2a2-3b61-44c3-bc0f-b4b58e5996b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:38.223387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b2a2-3b61-44c3-bc0f-b4b58e5996b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:38.233090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4b2a2-3b61-44c3-bc0f-b4b58e5996b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:38.234578 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4b2a2-3b61-44c3-bc0f-b4b58e5996b5 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:38.244503 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1459/2897] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:26:38.880018 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadbfd3-0ef8-42ed-848a-79452f7b2e65 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:38.930819 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:38.946072 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadbfd3-0ef8-42ed-848a-79452f7b2e65 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:38.950652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:38.951283 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:38.951559 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:38.951833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] PATH_INFO: `/v3/users/9eb116e484964f7eb346e56ba35cd2b0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:38.952983 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb116e484964f7eb346e56ba35cd2b0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:38.954950 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:39.006991 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb116e484964f7eb346e56ba35cd2b0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.007652 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb116e484964f7eb346e56ba35cd2b0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.015852 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb116e484964f7eb346e56ba35cd2b0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.016612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb116e484964f7eb346e56ba35cd2b0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.029592 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb116e484964f7eb346e56ba35cd2b0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.044306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1439/2898] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:26:38 2022] DELETE /identity/v3/users/9eb116e484964f7eb346e56ba35cd2b0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:39.049008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e5938-8fd9-4e17-856f-9b14cef5fd98 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:39.049456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e5938-8fd9-4e17-856f-9b14cef5fd98 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:39.049549 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e5938-8fd9-4e17-856f-9b14cef5fd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:39.071369 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6b9e5938-8fd9-4e17-856f-9b14cef5fd98 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:39.072856 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6b9e5938-8fd9-4e17-856f-9b14cef5fd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:39.104173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:39.134841 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1460/2899] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:39.145304 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:39.146877 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:39.207613 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698cd2-9566-434e-ab95-d5e4f17c2e2f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:39.211655 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be94d6-a900-4a9e-959b-3bbfb6a96373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:39.212238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be94d6-a900-4a9e-959b-3bbfb6a96373 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:39.212624 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be94d6-a900-4a9e-959b-3bbfb6a96373 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:39.212901 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be94d6-a900-4a9e-959b-3bbfb6a96373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:39.222344 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be94d6-a900-4a9e-959b-3bbfb6a96373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:39.223817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be94d6-a900-4a9e-959b-3bbfb6a96373 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:39.233367 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1440/2900] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:26:39.513144 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e5938-8fd9-4e17-856f-9b14cef5fd98 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:39.514695 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6b9e5938-8fd9-4e17-856f-9b14cef5fd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:39.533008 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e5938-8fd9-4e17-856f-9b14cef5fd98 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:39.538566 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:39.539260 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:39.540157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:39.540157 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] PATH_INFO: `/v3/projects/a3cd4ef5d67a47ffb5dc3de5d3e87238` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:39.541179 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3cd4ef5d67a47ffb5dc3de5d3e87238)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:39.543258 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:39.594363 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3cd4ef5d67a47ffb5dc3de5d3e87238', 'request_id': 'req-a569e215-0d26-41eb-8da6-1aa768434761'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.602332 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3cd4ef5d67a47ffb5dc3de5d3e87238', 'request_id': 'req-a569e215-0d26-41eb-8da6-1aa768434761'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.608642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3cd4ef5d67a47ffb5dc3de5d3e87238', 'request_id': 'req-a569e215-0d26-41eb-8da6-1aa768434761'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.627300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] The token cache is being invalidate because project a3cd4ef5d67a47ffb5dc3de5d3e87238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:26:39.627717 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.628831 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.631105 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1461/2901] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:26:39 2022] DELETE /identity/v3/projects/a3cd4ef5d67a47ffb5dc3de5d3e87238 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:39.637208 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be94d6-a900-4a9e-959b-3bbfb6a96373 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:39.647833 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be94d6-a900-4a9e-959b-3bbfb6a96373 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:39.708125 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c301da9-5205-4581-8b75-d76d163ef908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:39.708787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c301da9-5205-4581-8b75-d76d163ef908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:39.709064 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c301da9-5205-4581-8b75-d76d163ef908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:39.709335 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c301da9-5205-4581-8b75-d76d163ef908 admin admin] PATH_INFO: `/v3/users/b13626a57aa24543a8c7f1e6759e6f2e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:39.710496 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c301da9-5205-4581-8b75-d76d163ef908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13626a57aa24543a8c7f1e6759e6f2e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:39.713034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c301da9-5205-4581-8b75-d76d163ef908 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:39.724192 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:39.771532 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5c301da9-5205-4581-8b75-d76d163ef908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13626a57aa24543a8c7f1e6759e6f2e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.772412 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5c301da9-5205-4581-8b75-d76d163ef908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13626a57aa24543a8c7f1e6759e6f2e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.782536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5c301da9-5205-4581-8b75-d76d163ef908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13626a57aa24543a8c7f1e6759e6f2e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.783628 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5c301da9-5205-4581-8b75-d76d163ef908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13626a57aa24543a8c7f1e6759e6f2e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.799132 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5c301da9-5205-4581-8b75-d76d163ef908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13626a57aa24543a8c7f1e6759e6f2e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:39.814925 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1441/2902] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:26:39 2022] DELETE /identity/v3/users/b13626a57aa24543a8c7f1e6759e6f2e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:40.097095 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:40.098829 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:40.114106 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e215-0d26-41eb-8da6-1aa768434761 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:40.184723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac516035-d449-4e0a-b303-80821c85ba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:40.185482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac516035-d449-4e0a-b303-80821c85ba3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:40.185635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac516035-d449-4e0a-b303-80821c85ba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:40.185905 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac516035-d449-4e0a-b303-80821c85ba3a admin admin] PATH_INFO: `/v3/projects/e3f055bd18f443b2ab61c26eff06e5a8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:40.187150 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac516035-d449-4e0a-b303-80821c85ba3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f055bd18f443b2ab61c26eff06e5a8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:40.189208 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac516035-d449-4e0a-b303-80821c85ba3a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:40.243370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ac516035-d449-4e0a-b303-80821c85ba3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f055bd18f443b2ab61c26eff06e5a8', 'request_id': 'req-ac516035-d449-4e0a-b303-80821c85ba3a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:40.248953 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ac516035-d449-4e0a-b303-80821c85ba3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f055bd18f443b2ab61c26eff06e5a8', 'request_id': 'req-ac516035-d449-4e0a-b303-80821c85ba3a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:40.250778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:40.255657 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ac516035-d449-4e0a-b303-80821c85ba3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f055bd18f443b2ab61c26eff06e5a8', 'request_id': 'req-ac516035-d449-4e0a-b303-80821c85ba3a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:40.270616 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ac516035-d449-4e0a-b303-80821c85ba3a admin admin] The token cache is being invalidate because project e3f055bd18f443b2ab61c26eff06e5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:26:40.270898 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ac516035-d449-4e0a-b303-80821c85ba3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:40.271533 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ac516035-d449-4e0a-b303-80821c85ba3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:40.273067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1462/2903] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:26:40 2022] DELETE /identity/v3/projects/e3f055bd18f443b2ab61c26eff06e5a8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:40.278278 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4d72f-dfe5-4f82-a896-dc66b6c74f6b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:40.278774 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4d72f-dfe5-4f82-a896-dc66b6c74f6b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:40.278888 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4d72f-dfe5-4f82-a896-dc66b6c74f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:40.299051 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-05c4d72f-dfe5-4f82-a896-dc66b6c74f6b None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:40.300171 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-05c4d72f-dfe5-4f82-a896-dc66b6c74f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:40.361267 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1442/2904] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:26:40.369635 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c941a-c217-423c-af43-6ef6aa01afbd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:40.369924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c941a-c217-423c-af43-6ef6aa01afbd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:40.370295 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c941a-c217-423c-af43-6ef6aa01afbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:40.391934 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c38c941a-c217-423c-af43-6ef6aa01afbd None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:40.393242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c38c941a-c217-423c-af43-6ef6aa01afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:40.403312 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1463/2905] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:40.408324 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4d72f-dfe5-4f82-a896-dc66b6c74f6b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:40.422999 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4d72f-dfe5-4f82-a896-dc66b6c74f6b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:40.431283 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1652a-09d6-4e60-98a2-c8def52a738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:40.431883 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1652a-09d6-4e60-98a2-c8def52a738e admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:40.432155 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1652a-09d6-4e60-98a2-c8def52a738e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:40.432402 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1652a-09d6-4e60-98a2-c8def52a738e admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:40.433081 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1652a-09d6-4e60-98a2-c8def52a738e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:26:40.433384 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1652a-09d6-4e60-98a2-c8def52a738e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:40.435017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1652a-09d6-4e60-98a2-c8def52a738e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:40.447993 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1443/2906] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:26:40.452472 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c941a-c217-423c-af43-6ef6aa01afbd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:40.461883 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c941a-c217-423c-af43-6ef6aa01afbd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:40.466868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21dab0-78d4-403d-957f-373bd8913c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:40.467456 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21dab0-78d4-403d-957f-373bd8913c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:40.467729 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21dab0-78d4-403d-957f-373bd8913c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:40.467997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21dab0-78d4-403d-957f-373bd8913c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:40.468658 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21dab0-78d4-403d-957f-373bd8913c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:40.470596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21dab0-78d4-403d-957f-373bd8913c26 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:40.499528 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1464/2907] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:26:40 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:40.503916 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1652a-09d6-4e60-98a2-c8def52a738e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:40.516541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1652a-09d6-4e60-98a2-c8def52a738e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:40.576139 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3030d-0e11-4487-b439-b3606c5b3cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:40.576704 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3030d-0e11-4487-b439-b3606c5b3cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:40.576974 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3030d-0e11-4487-b439-b3606c5b3cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:40.577232 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3030d-0e11-4487-b439-b3606c5b3cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:40.577864 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3030d-0e11-4487-b439-b3606c5b3cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:40.579822 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3030d-0e11-4487-b439-b3606c5b3cc4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:40.603839 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1444/2908] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:26:40 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:40.608137 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21dab0-78d4-403d-957f-373bd8913c26 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:40.619465 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21dab0-78d4-403d-957f-373bd8913c26 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:40.624968 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e699f-8143-4e68-893d-cb1bd69336f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:40.625586 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e699f-8143-4e68-893d-cb1bd69336f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:40.625876 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e699f-8143-4e68-893d-cb1bd69336f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:40.626135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e699f-8143-4e68-893d-cb1bd69336f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:40.626766 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e699f-8143-4e68-893d-cb1bd69336f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:40.628458 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e699f-8143-4e68-893d-cb1bd69336f7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:40.639370 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1465/2909] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:40.643729 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3030d-0e11-4487-b439-b3606c5b3cc4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:40.650287 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:40.654274 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3030d-0e11-4487-b439-b3606c5b3cc4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:40.660958 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eef50-573e-4be1-8f40-460f6a9ec425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:40.661520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eef50-573e-4be1-8f40-460f6a9ec425 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:40.661794 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eef50-573e-4be1-8f40-460f6a9ec425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:40.662052 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eef50-573e-4be1-8f40-460f6a9ec425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:40.662707 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eef50-573e-4be1-8f40-460f6a9ec425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:40.664782 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eef50-573e-4be1-8f40-460f6a9ec425 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:40.676416 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1445/2910] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:40.681766 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e699f-8143-4e68-893d-cb1bd69336f7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:40.691792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e699f-8143-4e68-893d-cb1bd69336f7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:40.697004 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c67d6a-cb2c-415b-8e43-8d1c278e5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:40.697654 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c67d6a-cb2c-415b-8e43-8d1c278e5914 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:40.697927 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c67d6a-cb2c-415b-8e43-8d1c278e5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:40.698198 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c67d6a-cb2c-415b-8e43-8d1c278e5914 admin admin] PATH_INFO: `/v3/projects/43e26208e06b436ea20105341bb60993/users/e8a804ccede144cfa30d3ba50fd58fa9/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:40.712996 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c67d6a-cb2c-415b-8e43-8d1c278e5914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e26208e06b436ea20105341bb60993, user_id=e8a804ccede144cfa30d3ba50fd58fa9, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:40.715771 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c67d6a-cb2c-415b-8e43-8d1c278e5914 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:40.731555 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1466/2911] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:26:40 2022] PUT /identity/v3/projects/43e26208e06b436ea20105341bb60993/users/e8a804ccede144cfa30d3ba50fd58fa9/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:26:40.743236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a3a61-d324-4f9a-a92f-eb257104bc89 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:40.743524 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a3a61-d324-4f9a-a92f-eb257104bc89 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:40.743793 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a3a61-d324-4f9a-a92f-eb257104bc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:40.773026 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-974a3a61-d324-4f9a-a92f-eb257104bc89 None None] MFA Rules not processed for user `e8a804ccede144cfa30d3ba50fd58fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:40.774463 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-974a3a61-d324-4f9a-a92f-eb257104bc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:40.847000 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1446/2912] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:40.858413 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c67d6a-cb2c-415b-8e43-8d1c278e5914 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:40.860320 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f1c67d6a-cb2c-415b-8e43-8d1c278e5914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:40.922531 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c67d6a-cb2c-415b-8e43-8d1c278e5914 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:40.926797 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f66890-176c-4572-9ef0-da63b269c203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:40.927400 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f66890-176c-4572-9ef0-da63b269c203 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:40.927673 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f66890-176c-4572-9ef0-da63b269c203 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:40.927938 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f66890-176c-4572-9ef0-da63b269c203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:40.937019 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f66890-176c-4572-9ef0-da63b269c203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:40.938496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f66890-176c-4572-9ef0-da63b269c203 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:40.947395 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1467/2913] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:26:40.972656 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a3a61-d324-4f9a-a92f-eb257104bc89 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:41.040634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a3a61-d324-4f9a-a92f-eb257104bc89 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:41.045599 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:41.046241 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:41.046510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:41.046780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] PATH_INFO: `/v3/users/e8a804ccede144cfa30d3ba50fd58fa9` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:41.048030 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a804ccede144cfa30d3ba50fd58fa9)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:41.050017 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:41.113546 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a804ccede144cfa30d3ba50fd58fa9'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:41.114178 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a804ccede144cfa30d3ba50fd58fa9'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:41.121728 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a804ccede144cfa30d3ba50fd58fa9'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:41.122397 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a804ccede144cfa30d3ba50fd58fa9'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:41.134587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a804ccede144cfa30d3ba50fd58fa9'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:41.149810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1447/2914] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:26:40 2022] DELETE /identity/v3/users/e8a804ccede144cfa30d3ba50fd58fa9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:41.154346 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31d16-ad44-4274-bc9d-32a8be6ba7c4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:41.154862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31d16-ad44-4274-bc9d-32a8be6ba7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:41.154862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31d16-ad44-4274-bc9d-32a8be6ba7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:41.174667 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-52d31d16-ad44-4274-bc9d-32a8be6ba7c4 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:41.175857 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-52d31d16-ad44-4274-bc9d-32a8be6ba7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:41.237988 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1468/2915] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:41.250210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:41.252536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:41.260766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:41.316601 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2731496-ab6c-4b2a-9796-704da633164c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:41.320574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdeed46-dfb9-488b-afdb-b6c567d7fd67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:41.321263 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeed46-dfb9-488b-afdb-b6c567d7fd67 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:41.321503 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeed46-dfb9-488b-afdb-b6c567d7fd67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:41.321779 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeed46-dfb9-488b-afdb-b6c567d7fd67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:41.331381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdeed46-dfb9-488b-afdb-b6c567d7fd67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:41.332906 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdeed46-dfb9-488b-afdb-b6c567d7fd67 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:41.342513 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1448/2916] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:26:41.628204 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d31d16-ad44-4274-bc9d-32a8be6ba7c4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:41.629906 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-52d31d16-ad44-4274-bc9d-32a8be6ba7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:41.642812 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d31d16-ad44-4274-bc9d-32a8be6ba7c4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:41.647373 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd8637-9725-4785-9d01-e7434737d9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:41.648013 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd8637-9725-4785-9d01-e7434737d9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:41.648316 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd8637-9725-4785-9d01-e7434737d9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:41.648593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd8637-9725-4785-9d01-e7434737d9ba admin admin] PATH_INFO: `/v3/projects/43e26208e06b436ea20105341bb60993` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:41.649709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd8637-9725-4785-9d01-e7434737d9ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e26208e06b436ea20105341bb60993)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:41.651994 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd8637-9725-4785-9d01-e7434737d9ba admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:41.676576 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:41.705290 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a8cd8637-9725-4785-9d01-e7434737d9ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e26208e06b436ea20105341bb60993', 'request_id': 'req-a8cd8637-9725-4785-9d01-e7434737d9ba'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:41.711622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a8cd8637-9725-4785-9d01-e7434737d9ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e26208e06b436ea20105341bb60993', 'request_id': 'req-a8cd8637-9725-4785-9d01-e7434737d9ba'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:41.717954 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a8cd8637-9725-4785-9d01-e7434737d9ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e26208e06b436ea20105341bb60993', 'request_id': 'req-a8cd8637-9725-4785-9d01-e7434737d9ba'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:41.731182 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a8cd8637-9725-4785-9d01-e7434737d9ba admin admin] The token cache is being invalidate because project 43e26208e06b436ea20105341bb60993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:26:41.731461 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a8cd8637-9725-4785-9d01-e7434737d9ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:41.732090 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a8cd8637-9725-4785-9d01-e7434737d9ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:26:41.739087 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1469/2917] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:26:41 2022] DELETE /identity/v3/projects/43e26208e06b436ea20105341bb60993 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:26:41.739231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15419e0-909b-46a1-9fdf-974757e7ea6e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:41.739231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15419e0-909b-46a1-9fdf-974757e7ea6e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:41.739231 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15419e0-909b-46a1-9fdf-974757e7ea6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:41.760483 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a15419e0-909b-46a1-9fdf-974757e7ea6e None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:41.761679 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a15419e0-909b-46a1-9fdf-974757e7ea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:41.825435 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1449/2918] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:41.833596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7dba8-7be7-4f81-a72f-d831384735ae None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:41.833881 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7dba8-7be7-4f81-a72f-d831384735ae None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:41.834173 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7dba8-7be7-4f81-a72f-d831384735ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:41.856310 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b0e7dba8-7be7-4f81-a72f-d831384735ae None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:41.857517 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b0e7dba8-7be7-4f81-a72f-d831384735ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:41.866383 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1470/2919] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:41.870938 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15419e0-909b-46a1-9fdf-974757e7ea6e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:41.881282 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15419e0-909b-46a1-9fdf-974757e7ea6e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:41.887617 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8952887-b6af-4574-9d32-bdb21cae5ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:41.888227 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8952887-b6af-4574-9d32-bdb21cae5ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:41.888536 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8952887-b6af-4574-9d32-bdb21cae5ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:41.888806 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8952887-b6af-4574-9d32-bdb21cae5ab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:41.889441 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8952887-b6af-4574-9d32-bdb21cae5ab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 01:26:41.889744 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8952887-b6af-4574-9d32-bdb21cae5ab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:41.891780 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8952887-b6af-4574-9d32-bdb21cae5ab3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:41.904667 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1450/2920] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 6 01:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 01:26:41.910952 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7dba8-7be7-4f81-a72f-d831384735ae None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:41.924153 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7dba8-7be7-4f81-a72f-d831384735ae None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:41.933398 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dbff7-4dc3-400f-876f-e660748508e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:41.934209 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dbff7-4dc3-400f-876f-e660748508e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:41.934513 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dbff7-4dc3-400f-876f-e660748508e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:41.934832 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dbff7-4dc3-400f-876f-e660748508e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:41.935723 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dbff7-4dc3-400f-876f-e660748508e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:41.938810 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dbff7-4dc3-400f-876f-e660748508e8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:41.972929 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1471/2921] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 6 01:26:41 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:41.977220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8952887-b6af-4574-9d32-bdb21cae5ab3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:41.987867 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8952887-b6af-4574-9d32-bdb21cae5ab3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:42.051917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33d68e-48ae-4645-99be-830ca1b90720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:42.052572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33d68e-48ae-4645-99be-830ca1b90720 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:42.052853 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33d68e-48ae-4645-99be-830ca1b90720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:42.053164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33d68e-48ae-4645-99be-830ca1b90720 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:42.053804 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33d68e-48ae-4645-99be-830ca1b90720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:42.055760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33d68e-48ae-4645-99be-830ca1b90720 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:42.081539 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1451/2922] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 6 01:26:41 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 01:26:42.087318 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dbff7-4dc3-400f-876f-e660748508e8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:42.098583 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dbff7-4dc3-400f-876f-e660748508e8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:42.104056 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1d9e-8a02-44a0-a565-89569d4bae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:42.104510 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1d9e-8a02-44a0-a565-89569d4bae33 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:42.104795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1d9e-8a02-44a0-a565-89569d4bae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:42.105097 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1d9e-8a02-44a0-a565-89569d4bae33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:42.105743 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c1d9e-8a02-44a0-a565-89569d4bae33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:42.107402 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c1d9e-8a02-44a0-a565-89569d4bae33 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:42.117267 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1472/2923] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:42.121758 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33d68e-48ae-4645-99be-830ca1b90720 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:42.132602 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33d68e-48ae-4645-99be-830ca1b90720 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:42.138056 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22f61b-7167-4e75-8d84-74ff421ebd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:42.138658 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22f61b-7167-4e75-8d84-74ff421ebd87 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:42.138931 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22f61b-7167-4e75-8d84-74ff421ebd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:42.139201 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22f61b-7167-4e75-8d84-74ff421ebd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:42.139832 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22f61b-7167-4e75-8d84-74ff421ebd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:42.141848 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22f61b-7167-4e75-8d84-74ff421ebd87 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:42.152792 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1452/2924] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 6 01:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 01:26:42.157183 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1d9e-8a02-44a0-a565-89569d4bae33 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:42.167874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1d9e-8a02-44a0-a565-89569d4bae33 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:42.172792 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de6ce7-d0c1-4e99-a172-f5e3860d5a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:42.173437 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de6ce7-d0c1-4e99-a172-f5e3860d5a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:42.173709 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de6ce7-d0c1-4e99-a172-f5e3860d5a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:42.173982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de6ce7-d0c1-4e99-a172-f5e3860d5a22 admin admin] PATH_INFO: `/v3/projects/cb91d77b40c041b2b98792001ec6364d/users/ca2058f3688542a1bcb09735b9e65323/roles/948a63d9dffa4bdb815a397570a1d381` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:42.189428 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de6ce7-d0c1-4e99-a172-f5e3860d5a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb91d77b40c041b2b98792001ec6364d, user_id=ca2058f3688542a1bcb09735b9e65323, role_id=948a63d9dffa4bdb815a397570a1d381)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:42.192192 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de6ce7-d0c1-4e99-a172-f5e3860d5a22 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:42.207542 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1473/2925] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 6 01:26:42 2022] PUT /identity/v3/projects/cb91d77b40c041b2b98792001ec6364d/users/ca2058f3688542a1bcb09735b9e65323/roles/948a63d9dffa4bdb815a397570a1d381 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:26:42.219217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d757b-2823-48df-b017-47f93fcf437a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:42.219498 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d757b-2823-48df-b017-47f93fcf437a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:42.219767 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d757b-2823-48df-b017-47f93fcf437a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:42.241237 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:42.249749 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6e9d757b-2823-48df-b017-47f93fcf437a None None] MFA Rules not processed for user `ca2058f3688542a1bcb09735b9e65323`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:42.251490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6e9d757b-2823-48df-b017-47f93fcf437a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:42.321684 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1453/2926] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 01:26:42.332822 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de6ce7-d0c1-4e99-a172-f5e3860d5a22 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:26:42.334736 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b3de6ce7-d0c1-4e99-a172-f5e3860d5a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:42.402842 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de6ce7-d0c1-4e99-a172-f5e3860d5a22 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:26:42.407541 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ae3e2-86f4-4f5a-8594-e693b6cb4fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae9814386a444678a292becdfe07332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:26:42.408135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ae3e2-86f4-4f5a-8594-e693b6cb4fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:42.408455 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ae3e2-86f4-4f5a-8594-e693b6cb4fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:42.408728 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ae3e2-86f4-4f5a-8594-e693b6cb4fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:42.418073 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ae3e2-86f4-4f5a-8594-e693b6cb4fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:26:42.419593 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ae3e2-86f4-4f5a-8594-e693b6cb4fe1 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:26:42.428866 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1474/2927] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:26:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:26:43.809345 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6d7dc-39c5-4474-bcaa-c4532aa72c67 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:26:43.809903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6d7dc-39c5-4474-bcaa-c4532aa72c67 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:26:43.809903 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6d7dc-39c5-4474-bcaa-c4532aa72c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:26:43.831179 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a4a6d7dc-39c5-4474-bcaa-c4532aa72c67 None None] MFA Rules not processed for user `ca2058f3688542a1bcb09735b9e65323`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:26:43.832413 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a4a6d7dc-39c5-4474-bcaa-c4532aa72c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:26:43.840890 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1454/2928] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:26:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:26:52.424814 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:26:53.825305 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=30 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:27:04.390120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98775c26-ef50-4691-8276-f82e0070480c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:27:04.390629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98775c26-ef50-4691-8276-f82e0070480c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:27:04.390629 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98775c26-ef50-4691-8276-f82e0070480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:27:04.411846 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-98775c26-ef50-4691-8276-f82e0070480c None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:27:04.413135 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-98775c26-ef50-4691-8276-f82e0070480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:27:04.475432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1475/2929] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:27:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:27:04.533937 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6d7dc-39c5-4474-bcaa-c4532aa72c67 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:27:04.535445 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a4a6d7dc-39c5-4474-bcaa-c4532aa72c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:27:04.612164 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6d7dc-39c5-4474-bcaa-c4532aa72c67 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:27:04.617520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f67245-4587-47ce-afde-7e385cd03ecc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:27:04.618129 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f67245-4587-47ce-afde-7e385cd03ecc service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:27:04.618407 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f67245-4587-47ce-afde-7e385cd03ecc service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:27:04.618681 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f67245-4587-47ce-afde-7e385cd03ecc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:27:04.627492 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f67245-4587-47ce-afde-7e385cd03ecc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:27:04.629159 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f67245-4587-47ce-afde-7e385cd03ecc service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:27:04.637787 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1455/2930] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:27:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:27:05.192024 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bbb01-99f1-4cbb-a348-c029992cf2c6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:27:05.192362 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bbb01-99f1-4cbb-a348-c029992cf2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:27:05.192636 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bbb01-99f1-4cbb-a348-c029992cf2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:27:05.212705 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e01bbb01-99f1-4cbb-a348-c029992cf2c6 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:27:05.213901 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e01bbb01-99f1-4cbb-a348-c029992cf2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:27:05.221874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1476/2931] 10.222.0.25 () {58 vars in 967 bytes} [Tue Sep 6 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:27:05.234060 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f67245-4587-47ce-afde-7e385cd03ecc service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:27:05.245337 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f67245-4587-47ce-afde-7e385cd03ecc service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:27:05.251933 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91c11f-7ed5-4e5b-9e23-6638852d0813 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:27:05.252574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91c11f-7ed5-4e5b-9e23-6638852d0813 service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:27:05.252849 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91c11f-7ed5-4e5b-9e23-6638852d0813 service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:27:05.253113 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91c11f-7ed5-4e5b-9e23-6638852d0813 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:27:05.261531 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91c11f-7ed5-4e5b-9e23-6638852d0813 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:27:05.263162 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91c11f-7ed5-4e5b-9e23-6638852d0813 service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:27:05.272049 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1456/2932] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:27:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:27:05.519389 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebf7cb-8134-4452-b9eb-cd944f109c68 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:27:05.519874 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebf7cb-8134-4452-b9eb-cd944f109c68 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:27:05.519982 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebf7cb-8134-4452-b9eb-cd944f109c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:27:05.540276 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-22ebf7cb-8134-4452-b9eb-cd944f109c68 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:27:05.541496 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-22ebf7cb-8134-4452-b9eb-cd944f109c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:27:05.549862 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1477/2933] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 6 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:27:05.562556 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91c11f-7ed5-4e5b-9e23-6638852d0813 service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:27:05.573520 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91c11f-7ed5-4e5b-9e23-6638852d0813 service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:27:05.580128 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ba547-12cf-46e5-a45c-0d909d77c41c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:27:05.580817 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ba547-12cf-46e5-a45c-0d909d77c41c service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:27:05.581092 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ba547-12cf-46e5-a45c-0d909d77c41c service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:27:05.581359 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ba547-12cf-46e5-a45c-0d909d77c41c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:27:05.591024 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ba547-12cf-46e5-a45c-0d909d77c41c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:27:05.592919 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ba547-12cf-46e5-a45c-0d909d77c41c service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:27:05.601198 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1457/2934] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:27:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:27:05.945849 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b52580-bc2e-490e-ad6a-ba4ea2417640 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:27:05.946138 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b52580-bc2e-490e-ad6a-ba4ea2417640 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:27:05.946412 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b52580-bc2e-490e-ad6a-ba4ea2417640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:27:05.966556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-94b52580-bc2e-490e-ad6a-ba4ea2417640 None None] MFA Rules not processed for user `d56912bcbf0b4ce9b29ace7606deb827`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:27:05.967734 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-94b52580-bc2e-490e-ad6a-ba4ea2417640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:27:05.976537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1478/2935] 10.222.0.25 () {58 vars in 967 bytes} [Tue Sep 6 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:27:05.990375 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ba547-12cf-46e5-a45c-0d909d77c41c service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:27:06.001472 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ba547-12cf-46e5-a45c-0d909d77c41c service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:27:06.007622 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ef789-2130-4eb8-9548-cb95f8a1d193 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e2ea2ab4ae4a14be9bd35af20080c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:27:06.008230 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ef789-2130-4eb8-9548-cb95f8a1d193 service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:27:06.008541 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ef789-2130-4eb8-9548-cb95f8a1d193 service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:27:06.008813 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ef789-2130-4eb8-9548-cb95f8a1d193 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:27:06.017894 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ef789-2130-4eb8-9548-cb95f8a1d193 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:27:06.019535 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ef789-2130-4eb8-9548-cb95f8a1d193 service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:27:06.027583 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1458/2936] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 6 01:27:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 01:27:08.373686 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b52580-bc2e-490e-ad6a-ba4ea2417640 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:27:08.441246 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b52580-bc2e-490e-ad6a-ba4ea2417640 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:27:08.446242 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:27:08.446875 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:27:08.447151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:27:08.447424 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] PATH_INFO: `/v3/users/ca2058f3688542a1bcb09735b9e65323` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:27:08.448606 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2058f3688542a1bcb09735b9e65323)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:27:08.450587 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:27:08.503933 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2058f3688542a1bcb09735b9e65323'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:27:08.504609 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2058f3688542a1bcb09735b9e65323'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:27:08.513221 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2058f3688542a1bcb09735b9e65323'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:27:08.521329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2058f3688542a1bcb09735b9e65323'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:27:08.522044 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2058f3688542a1bcb09735b9e65323'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:27:08.539899 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1479/2937] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:27:08 2022] DELETE /identity/v3/users/ca2058f3688542a1bcb09735b9e65323 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:27:08.544630 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c203-e7af-475a-a136-d377921f06d5 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:27:08.545124 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c203-e7af-475a-a136-d377921f06d5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:27:08.545238 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c203-e7af-475a-a136-d377921f06d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:27:08.566490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9a30c203-e7af-475a-a136-d377921f06d5 None None] MFA Rules not processed for user `c84cb4aedf5f40eeb73ee0c384202e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 01:27:08.567687 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9a30c203-e7af-475a-a136-d377921f06d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:27:08.629627 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1459/2938] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 6 01:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 01:27:08.639550 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:27:08.641096 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:27:08.648155 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:27:08.701430 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db674b0-0b9f-4edc-bb79-c5e6815577bd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:27:08.705804 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a03068-ae6c-46b2-aa5e-672303d46eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:27:08.706405 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a03068-ae6c-46b2-aa5e-672303d46eed service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:27:08.706678 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a03068-ae6c-46b2-aa5e-672303d46eed service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:27:08.706935 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a03068-ae6c-46b2-aa5e-672303d46eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:27:08.716386 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a03068-ae6c-46b2-aa5e-672303d46eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:27:08.717860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a03068-ae6c-46b2-aa5e-672303d46eed service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:27:08.727591 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1480/2939] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:27:08.909947 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c203-e7af-475a-a136-d377921f06d5 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:27:08.911572 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9a30c203-e7af-475a-a136-d377921f06d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:27:08.926917 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c203-e7af-475a-a136-d377921f06d5 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:27:08.931673 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:27:08.932360 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:27:08.932634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:27:08.932907 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] PATH_INFO: `/v3/projects/cb91d77b40c041b2b98792001ec6364d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:27:08.934104 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb91d77b40c041b2b98792001ec6364d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:27:08.936077 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:27:08.982220 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:27:08.985493 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb91d77b40c041b2b98792001ec6364d', 'request_id': 'req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:27:08.993587 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb91d77b40c041b2b98792001ec6364d', 'request_id': 'req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:27:09.002776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb91d77b40c041b2b98792001ec6364d', 'request_id': 'req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:27:09.015769 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] The token cache is being invalidate because project cb91d77b40c041b2b98792001ec6364d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:27:09.016057 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:27:09.017192 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:27:09.019089 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1460/2940] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:27:08 2022] DELETE /identity/v3/projects/cb91d77b40c041b2b98792001ec6364d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:27:18.723701 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=24 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:27:19.010836 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:28:28.916186 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a03068-ae6c-46b2-aa5e-672303d46eed service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:28:28.917860 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-06a03068-ae6c-46b2-aa5e-672303d46eed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:28:28.930282 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a03068-ae6c-46b2-aa5e-672303d46eed service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:28:28.984049 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de969b9-36a8-42b1-b690-59fb7f63d10a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:28:28.984613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de969b9-36a8-42b1-b690-59fb7f63d10a service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:28:28.984892 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de969b9-36a8-42b1-b690-59fb7f63d10a service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:28:28.985161 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de969b9-36a8-42b1-b690-59fb7f63d10a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:28:28.987285 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7de969b9-36a8-42b1-b690-59fb7f63d10a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:28:29.064414 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de969b9-36a8-42b1-b690-59fb7f63d10a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:28:29.065936 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de969b9-36a8-42b1-b690-59fb7f63d10a service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:28:29.077387 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1481/2941] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:28:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:28:30.295747 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:28:30.297451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:28:30.311431 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc01d7f-e25a-4996-be9b-67fa1474ebe2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:28:30.315709 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6d11-5e70-430d-90df-cc0648c6f574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:28:30.316339 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6d11-5e70-430d-90df-cc0648c6f574 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:28:30.316616 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6d11-5e70-430d-90df-cc0648c6f574 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:28:30.316915 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6d11-5e70-430d-90df-cc0648c6f574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:28:30.318956 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0d4e6d11-5e70-430d-90df-cc0648c6f574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:28:30.332457 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e6d11-5e70-430d-90df-cc0648c6f574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:28:30.333958 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e6d11-5e70-430d-90df-cc0648c6f574 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:28:30.345151 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1461/2942] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:28:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:28:36.009755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de969b9-36a8-42b1-b690-59fb7f63d10a service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:28:36.011453 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7de969b9-36a8-42b1-b690-59fb7f63d10a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:28:36.026556 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de969b9-36a8-42b1-b690-59fb7f63d10a service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:28:36.031164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125c98-a21c-42c0-b1c4-31cd0e369663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:28:36.031778 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125c98-a21c-42c0-b1c4-31cd0e369663 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:28:36.032054 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125c98-a21c-42c0-b1c4-31cd0e369663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:28:36.032335 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125c98-a21c-42c0-b1c4-31cd0e369663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:28:36.034448 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8d125c98-a21c-42c0-b1c4-31cd0e369663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:28:36.045653 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d125c98-a21c-42c0-b1c4-31cd0e369663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:28:36.047162 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d125c98-a21c-42c0-b1c4-31cd0e369663 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:28:36.056263 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1482/2943] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:28:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:28:40.340233 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:28:42.572210 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6d11-5e70-430d-90df-cc0648c6f574 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:28:42.581887 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6d11-5e70-430d-90df-cc0648c6f574 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:28:42.586451 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175da6fc-cb92-446e-bdd8-49e00fd91218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:28:42.587221 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175da6fc-cb92-446e-bdd8-49e00fd91218 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:28:42.587561 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175da6fc-cb92-446e-bdd8-49e00fd91218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:28:42.587895 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175da6fc-cb92-446e-bdd8-49e00fd91218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:28:42.590619 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-175da6fc-cb92-446e-bdd8-49e00fd91218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:28:42.601474 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175da6fc-cb92-446e-bdd8-49e00fd91218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:28:42.603061 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175da6fc-cb92-446e-bdd8-49e00fd91218 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:28:42.612392 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1462/2944] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:28:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:28:42.698354 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125c98-a21c-42c0-b1c4-31cd0e369663 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:28:42.706638 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125c98-a21c-42c0-b1c4-31cd0e369663 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:28:42.710151 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c04720-54f3-4a36-95c1-695b1f887ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:28:42.710755 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c04720-54f3-4a36-95c1-695b1f887ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:28:42.711029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c04720-54f3-4a36-95c1-695b1f887ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:28:42.711299 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c04720-54f3-4a36-95c1-695b1f887ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:28:42.713141 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-12c04720-54f3-4a36-95c1-695b1f887ad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:28:42.726595 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c04720-54f3-4a36-95c1-695b1f887ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:28:42.728067 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c04720-54f3-4a36-95c1-695b1f887ad0 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:28:42.739202 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1483/2945] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:28:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:28:42.813612 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175da6fc-cb92-446e-bdd8-49e00fd91218 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:28:42.815509 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-175da6fc-cb92-446e-bdd8-49e00fd91218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:28:42.891648 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175da6fc-cb92-446e-bdd8-49e00fd91218 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:28:42.897490 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b61743-2024-40a7-aa45-6f59619981e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:28:42.898087 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b61743-2024-40a7-aa45-6f59619981e2 service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:28:42.898363 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b61743-2024-40a7-aa45-6f59619981e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:28:42.898624 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b61743-2024-40a7-aa45-6f59619981e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:28:42.900689 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-56b61743-2024-40a7-aa45-6f59619981e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:28:42.912046 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b61743-2024-40a7-aa45-6f59619981e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:28:42.913674 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b61743-2024-40a7-aa45-6f59619981e2 service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:28:42.923500 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1463/2946] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:28:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:28:52.734613 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=66 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:28:52.919599 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=38 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:30:24.749992 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c04720-54f3-4a36-95c1-695b1f887ad0 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:30:24.770820 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c04720-54f3-4a36-95c1-695b1f887ad0 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:30:24.774918 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8c9c8-fa89-4dea-a572-0a831ec0e3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:30:24.775519 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8c9c8-fa89-4dea-a572-0a831ec0e3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:30:24.775795 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8c9c8-fa89-4dea-a572-0a831ec0e3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:30:24.776064 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8c9c8-fa89-4dea-a572-0a831ec0e3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:30:24.778152 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ffa8c9c8-fa89-4dea-a572-0a831ec0e3b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:30:24.868485 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8c9c8-fa89-4dea-a572-0a831ec0e3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:30:24.869997 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8c9c8-fa89-4dea-a572-0a831ec0e3b3 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:30:24.879088 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1484/2947] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:30:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:30:25.781905 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b61743-2024-40a7-aa45-6f59619981e2 service placement] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:30:25.783766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-56b61743-2024-40a7-aa45-6f59619981e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:30:25.871702 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b61743-2024-40a7-aa45-6f59619981e2 service placement] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:30:25.879095 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dff86-1f64-4350-b4cc-ad3cea4a5c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b9c25e98fe4b1bbc33a601d4150071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:30:25.880640 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dff86-1f64-4350-b4cc-ad3cea4a5c67 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:30:25.880981 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dff86-1f64-4350-b4cc-ad3cea4a5c67 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:30:25.881325 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dff86-1f64-4350-b4cc-ad3cea4a5c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:30:25.883766 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-682dff86-1f64-4350-b4cc-ad3cea4a5c67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:30:25.899279 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dff86-1f64-4350-b4cc-ad3cea4a5c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:30:25.901307 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dff86-1f64-4350-b4cc-ad3cea4a5c67 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:30:25.918716 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1464/2948] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:30:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:30:29.651725 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8c9c8-fa89-4dea-a572-0a831ec0e3b3 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:30:29.660975 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8c9c8-fa89-4dea-a572-0a831ec0e3b3 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:30:29.665760 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06f177-7181-4ad3-a1fb-2dce866c8b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc30f3a335f428082e9178227dcb4e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:30:29.666475 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06f177-7181-4ad3-a1fb-2dce866c8b5b service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:30:29.666756 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06f177-7181-4ad3-a1fb-2dce866c8b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:30:29.667111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06f177-7181-4ad3-a1fb-2dce866c8b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:30:29.669129 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7e06f177-7181-4ad3-a1fb-2dce866c8b5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:30:29.733833 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06f177-7181-4ad3-a1fb-2dce866c8b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:30:29.735324 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06f177-7181-4ad3-a1fb-2dce866c8b5b service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:30:29.745390 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1485/2949] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:30:32.958309 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dff86-1f64-4350-b4cc-ad3cea4a5c67 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:30:32.960034 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-682dff86-1f64-4350-b4cc-ad3cea4a5c67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:30:32.976453 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dff86-1f64-4350-b4cc-ad3cea4a5c67 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:30:32.982306 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2daa6-0fab-4bfd-91b9-704fc3e9d8d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:30:32.982965 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2daa6-0fab-4bfd-91b9-704fc3e9d8d6 service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:30:32.983246 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2daa6-0fab-4bfd-91b9-704fc3e9d8d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:30:32.983523 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2daa6-0fab-4bfd-91b9-704fc3e9d8d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:30:32.985381 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e7c2daa6-0fab-4bfd-91b9-704fc3e9d8d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:30:32.999143 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2daa6-0fab-4bfd-91b9-704fc3e9d8d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:30:33.000840 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2daa6-0fab-4bfd-91b9-704fc3e9d8d6 service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:30:33.012802 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1465/2950] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:30:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:30:36.327509 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06f177-7181-4ad3-a1fb-2dce866c8b5b service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:30:36.355527 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06f177-7181-4ad3-a1fb-2dce866c8b5b service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:30:36.366357 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87596eb-1d4d-4870-99d3-3e4bfa125343 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:30:36.367232 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87596eb-1d4d-4870-99d3-3e4bfa125343 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:30:36.367642 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87596eb-1d4d-4870-99d3-3e4bfa125343 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:30:36.368029 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87596eb-1d4d-4870-99d3-3e4bfa125343 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:30:36.370224 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d87596eb-1d4d-4870-99d3-3e4bfa125343 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:30:36.400644 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87596eb-1d4d-4870-99d3-3e4bfa125343 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:30:36.400776 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2daa6-0fab-4bfd-91b9-704fc3e9d8d6 service placement] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:30:36.403126 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87596eb-1d4d-4870-99d3-3e4bfa125343 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:30:36.404070 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e7c2daa6-0fab-4bfd-91b9-704fc3e9d8d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:30:36.428898 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1486/2951] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:30:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:30:36.448001 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2daa6-0fab-4bfd-91b9-704fc3e9d8d6 service placement] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:30:36.456533 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:30:36.457110 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:30:36.457389 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:30:36.457662 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] PATH_INFO: `/v3/users/1fbbb58e018442c38b89a18beefafc37` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:30:36.459858 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbbb58e018442c38b89a18beefafc37)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:30:36.465398 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:30:36.528795 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbbb58e018442c38b89a18beefafc37'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:36.536487 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbbb58e018442c38b89a18beefafc37'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:36.543399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbbb58e018442c38b89a18beefafc37'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:36.544510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbbb58e018442c38b89a18beefafc37'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:36.571751 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbbb58e018442c38b89a18beefafc37'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:36.590386 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1466/2952] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:30:36 2022] DELETE /identity/v3/users/1fbbb58e018442c38b89a18beefafc37 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:30:36.787300 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87596eb-1d4d-4870-99d3-3e4bfa125343 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:30:36.801868 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87596eb-1d4d-4870-99d3-3e4bfa125343 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:30:36.852622 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:30:36.866164 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:30:36.866806 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:30:36.867086 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:30:36.867356 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] PATH_INFO: `/v3/projects/17ef3e5fc9b244f3b5ae58ec313b9eaf` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:30:36.868546 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ef3e5fc9b244f3b5ae58ec313b9eaf)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:30:36.870515 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:30:36.919523 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ef3e5fc9b244f3b5ae58ec313b9eaf', 'request_id': 'req-6423574c-bac8-4f8d-bbf6-abce731c8235'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:36.925924 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ef3e5fc9b244f3b5ae58ec313b9eaf', 'request_id': 'req-6423574c-bac8-4f8d-bbf6-abce731c8235'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:36.932432 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ef3e5fc9b244f3b5ae58ec313b9eaf', 'request_id': 'req-6423574c-bac8-4f8d-bbf6-abce731c8235'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:36.952120 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] The token cache is being invalidate because project 17ef3e5fc9b244f3b5ae58ec313b9eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:30:36.952608 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:36.953347 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:36.954858 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1487/2953] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:30:36 2022] DELETE /identity/v3/projects/17ef3e5fc9b244f3b5ae58ec313b9eaf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:30:36.959225 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:30:36.960880 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:30:36.977510 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520fbfb-ae26-4e3f-8ae2-c3e95c7b3229 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:30:37.028217 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:30:37.041574 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:30:37.042785 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:30:37.043252 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:30:37.043760 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] PATH_INFO: `/v3/users/6d836b15e2d449dbb53fe086a9cc9b19` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:30:37.045004 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d836b15e2d449dbb53fe086a9cc9b19)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:30:37.046997 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:30:37.096698 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d836b15e2d449dbb53fe086a9cc9b19'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:37.097374 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d836b15e2d449dbb53fe086a9cc9b19'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:37.104768 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d836b15e2d449dbb53fe086a9cc9b19'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:37.105433 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d836b15e2d449dbb53fe086a9cc9b19'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:37.117705 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d836b15e2d449dbb53fe086a9cc9b19'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:37.135898 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1467/2954] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 6 01:30:36 2022] DELETE /identity/v3/users/6d836b15e2d449dbb53fe086a9cc9b19 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 01:30:37.319596 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:30:37.322530 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:30:37.339138 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423574c-bac8-4f8d-bbf6-abce731c8235 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:30:37.410886 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4be5ca-31be-4070-8f08-97c15420c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb4aedf5f40eeb73ee0c384202e9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e2411eaf2541e38a8d727a7403f2f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:30:37.411537 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4be5ca-31be-4070-8f08-97c15420c1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:30:37.411913 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4be5ca-31be-4070-8f08-97c15420c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:30:37.413033 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4be5ca-31be-4070-8f08-97c15420c1c4 admin admin] PATH_INFO: `/v3/projects/7795649abf7a4f979f5dc068c78735a9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:30:37.413482 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4be5ca-31be-4070-8f08-97c15420c1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7795649abf7a4f979f5dc068c78735a9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:30:37.415505 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4be5ca-31be-4070-8f08-97c15420c1c4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:30:37.465761 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6a4be5ca-31be-4070-8f08-97c15420c1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7795649abf7a4f979f5dc068c78735a9', 'request_id': 'req-6a4be5ca-31be-4070-8f08-97c15420c1c4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:37.471194 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6a4be5ca-31be-4070-8f08-97c15420c1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7795649abf7a4f979f5dc068c78735a9', 'request_id': 'req-6a4be5ca-31be-4070-8f08-97c15420c1c4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:37.478433 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6a4be5ca-31be-4070-8f08-97c15420c1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7795649abf7a4f979f5dc068c78735a9', 'request_id': 'req-6a4be5ca-31be-4070-8f08-97c15420c1c4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:37.493813 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6a4be5ca-31be-4070-8f08-97c15420c1c4 admin admin] The token cache is being invalidate because project 7795649abf7a4f979f5dc068c78735a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 01:30:37.494111 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6a4be5ca-31be-4070-8f08-97c15420c1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:37.494708 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6a4be5ca-31be-4070-8f08-97c15420c1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 01:30:37.496329 dv-cinder-847732-2-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1488/2955] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 6 01:30:37 2022] DELETE /identity/v3/projects/7795649abf7a4f979f5dc068c78735a9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 01:30:47.129575 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:30:47.490575 dv-cinder-847732-2-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:31:30.277236 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 01:31:30.278748 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:31:30.371450 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd53aff-b18c-409c-bc23-9703883c9426 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 01:31:30.433518 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40d1d0-7f02-4925-869c-69bce966d32e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1823402195ab4e89aa865967afc62b9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd31b0823b61d4895accd0f27e6006b08', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 01:31:30.434131 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40d1d0-7f02-4925-869c-69bce966d32e service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 01:31:30.434400 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40d1d0-7f02-4925-869c-69bce966d32e service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 01:31:30.434664 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40d1d0-7f02-4925-869c-69bce966d32e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 01:31:30.436634 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8d40d1d0-7f02-4925-869c-69bce966d32e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 01:31:30.447810 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40d1d0-7f02-4925-869c-69bce966d32e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 01:31:30.449461 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40d1d0-7f02-4925-869c-69bce966d32e service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 01:31:30.459399 dv-cinder-847732-2-smb devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1468/2956] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 6 01:31:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 01:31:40.455138 dv-cinder-847732-2-smb devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=67 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}